LD_PRELOAD=/usr/local/lib/libdarshan.so mpirun -np 4 ./build/mpitest && h5dump -p example.h5 [archlinux:194978] *** Process received signal *** [archlinux:194978] Signal: Floating point exception (8) [archlinux:194978] Signal code: Integer divide-by-zero (1) [archlinux:194978] Failing at address: 0x7f94de1894bf [archlinux:194979] *** Process received signal *** [archlinux:194979] Signal: Floating point exception (8) [archlinux:194979] Signal code: Integer divide-by-zero (1) [archlinux:194979] Failing at address: 0x7fdad4af04bf [archlinux:194978] [ 0] [archlinux:194979] [ 0] /usr/lib/libpthread.so.0(+0x13960)[0x7fdad6f4e960] [archlinux:194979] /usr/lib/libpthread.so.0(+0x13960)[0x7f94e05e7960] [archlinux:194978] [ 1] /usr/lib/openmpi/openmpi/mca_io_ompio.so(mca_io_ompio_file_get_byte_offset+0x3f)[0x7f94de1894bf] [archlinux:194978] [ 1] /usr/lib/openmpi/openmpi/mca_io_ompio.so(mca_io_ompio_file_get_byte_offset+0x3f)[0x7fdad4af04bf] [archlinux:194979] [ 2] [ 2] /usr/lib/openmpi/libmpi.so.40(PMPI_File_get_byte_offset+0x70)[0x7fdad73055b0] [archlinux:194979] [ 3] /usr/lib/openmpi/libmpi.so.40(PMPI_File_get_byte_offset+0x70)[0x7f94e099e5b0] [archlinux:194978] [ 3] /usr/local/lib/libdarshan.so(MPI_File_write_at_all+0x197)[0x7f94e0ee16b7] [archlinux:194978] /usr/local/lib/libdarshan.so(MPI_File_write_at_all+0x197)[0x7fdad78486b7] [archlinux:194979] [ 4] [ 4] /usr/lib/libhdf5.so.200(+0x31a28c)[0x7fdad76f828c] [archlinux:194979] [ 5] /usr/lib/libhdf5.so.200(H5FD_write+0xc0)[0x7fdad74feaf0] [archlinux:194979] [ 6] /usr/lib/libhdf5.so.200(H5F__accum_write+0x1d5)[0x7fdad74dc0c5] [archlinux:194979] [ 7] /usr/lib/libhdf5.so.200(+0x31a28c)[0x7f94e0d9128c] [archlinux:194978] [ 5] /usr/lib/libhdf5.so.200(H5FD_write+0xc0)[0x7f94e0b97af0] [archlinux:194978] [ 6] /usr/lib/libhdf5.so.200(H5F__accum_write+0x1d5)[0x7f94e0b750c5] [archlinux:194978] [ 7] /usr/lib/libhdf5.so.200(H5PB_write+0x8dc)[0x7fdad75e3abc] [archlinux:194979] [ 8] /usr/lib/libhdf5.so.200(H5PB_write+0x8dc)[0x7f94e0c7cabc] [archlinux:194978] [ 8] /usr/lib/libhdf5.so.200(H5F_shared_block_write+0xaa)[0x7fdad74e757a] [archlinux:194979] [ 9] /usr/lib/libhdf5.so.200(H5F_shared_block_write+0xaa)[0x7f94e0b8057a] [archlinux:194978] [ 9] /usr/lib/libhdf5.so.200(H5D__chunk_allocate+0x1252)[0x7fdad7493ac2] [archlinux:194979] [10] /usr/lib/libhdf5.so.200(H5D__chunk_allocate+0x1252)[0x7f94e0b2cac2] [archlinux:194978] [10] /usr/lib/libhdf5.so.200(+0xc4e14)[0x7fdad74a2e14] [archlinux:194979] [11] /usr/lib/libhdf5.so.200(+0xc4e14)[0x7f94e0b3be14] [archlinux:194978] [11] /usr/lib/libhdf5.so.200(H5D__alloc_storage+0x1eb)[0x7fdad74a931b] [archlinux:194979] [12] /usr/lib/libhdf5.so.200(H5D__alloc_storage+0x1eb)[0x7f94e0b4231b] [archlinux:194978] [12] /usr/lib/libhdf5.so.200(H5D__layout_oh_create+0x416)[0x7fdad74afe46] [archlinux:194979] [13] /usr/lib/libhdf5.so.200(H5D__create+0x721)[0x7fdad74a45c1] [archlinux:194979] [14] /usr/lib/libhdf5.so.200(+0xd2b5b)[0x7fdad74b0b5b] [archlinux:194979] [15] /usr/lib/libhdf5.so.200(H5O_obj_create+0x9a)[0x7fdad759868a] [archlinux:194979] [16] /usr/lib/libhdf5.so.200(H5D__layout_oh_create+0x416)[0x7f94e0b48e46] [archlinux:194978] [13] /usr/lib/libhdf5.so.200(H5D__create+0x721)[0x7f94e0b3d5c1] [archlinux:194978] [14] /usr/lib/libhdf5.so.200(+0xd2b5b)[0x7f94e0b49b5b] [archlinux:194978] [15] /usr/lib/libhdf5.so.200(H5O_obj_create+0x9a)[0x7f94e0c3168a] [archlinux:194978] [16] /usr/lib/libhdf5.so.200(+0x17f76c)[0x7fdad755d76c] [archlinux:194979] [17] /usr/lib/libhdf5.so.200(+0x153406)[0x7fdad7531406] [archlinux:194979] [18] /usr/lib/libhdf5.so.200(H5G_traverse+0xfb)[0x7fdad75318db] [archlinux:194979] [19] /usr/lib/libhdf5.so.200(+0x17b2c7)[0x7fdad75592c7] [archlinux:194979] [20] /usr/lib/libhdf5.so.200(H5L_link_object+0x6a)[0x7fdad755eefa] [archlinux:194979] [21] /usr/lib/libhdf5.so.200(H5D__create_named+0x74)[0x7fdad74a3e24] [archlinux:194979] [22] /usr/lib/libhdf5.so.200(H5VL__native_dataset_create+0x91)[0x7fdad76c8601] [archlinux:194979] [23] /usr/lib/libhdf5.so.200(+0x2d3558)[0x7fdad76b1558] [archlinux:194979] [24] /usr/lib/libhdf5.so.200(H5VL_dataset_create+0xd3)[0x7fdad76b6c53] [archlinux:194979] [25] /usr/lib/libhdf5.so.200(H5Dcreate2+0x133)[0x7fdad7481293] [archlinux:194979] [26] /usr/local/lib/libdarshan.so(H5Dcreate2+0x76)[0x7fdad7852756] [archlinux:194979] [27] ./build/mpitest(main+0x2fa)[0x55b95f9f95e3] [archlinux:194979] [28] /usr/lib/libc.so.6(__libc_start_main+0xd5)[0x7fdad6d95b25] [archlinux:194979] [29] ./build/mpitest(_start+0x2e)[0x55b95f9f921e] [archlinux:194979] *** End of error message *** /usr/lib/libhdf5.so.200(+0x17f76c)[0x7f94e0bf676c] [archlinux:194978] [17] /usr/lib/libhdf5.so.200(+0x153406)[0x7f94e0bca406] [archlinux:194978] [18] /usr/lib/libhdf5.so.200(H5G_traverse+0xfb)[0x7f94e0bca8db] [archlinux:194978] [19] /usr/lib/libhdf5.so.200(+0x17b2c7)[0x7f94e0bf22c7] [archlinux:194978] [20] /usr/lib/libhdf5.so.200(H5L_link_object+0x6a)[0x7f94e0bf7efa] [archlinux:194978] [21] /usr/lib/libhdf5.so.200(H5D__create_named+0x74)[0x7f94e0b3ce24] [archlinux:194978] [22] /usr/lib/libhdf5.so.200(H5VL__native_dataset_create+0x91)[0x7f94e0d61601] [archlinux:194978] [23] /usr/lib/libhdf5.so.200(+0x2d3558)[0x7f94e0d4a558] [archlinux:194978] [24] /usr/lib/libhdf5.so.200(H5VL_dataset_create+0xd3)[0x7f94e0d4fc53] [archlinux:194978] [25] /usr/lib/libhdf5.so.200(H5Dcreate2+0x133)[0x7f94e0b1a293] [archlinux:194978] [26] /usr/local/lib/libdarshan.so(H5Dcreate2+0x76)[0x7f94e0eeb756] [archlinux:194978] [27] ./build/mpitest(main+0x2fa)[0x559c8ef745e3] [archlinux:194978] [28] /usr/lib/libc.so.6(__libc_start_main+0xd5)[0x7f94e042eb25] [archlinux:194978] [29] ./build/mpitest(_start+0x2e)[0x559c8ef7421e] [archlinux:194978] *** End of error message *** -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpirun noticed that process rank 3 with PID 0 on node archlinux exited on signal 8 (Floating point exception). --------------------------------------------------------------------------