MPI and segfault #46

jtlz2 · 2014-09-26T10:23:41Z

Hi - trying to run pymultinest demo script (and own code) on Ubuntu 12.04 with openmpi 1.8.2, python 2.7, multinest v3.5 and pymultinest cloned today from github.

The multinest gaussian example runs fine for nprocs > 1, but with pymultinest we get the following heap segfault (it affects your minimal demo script also):

Total Samples: 1728
Nested Sampling ln(Z): 135.834567
Importance Nested Sampling ln(Z): 235.236389 +/- Acceptance Rate: 0.744212
Replacements: 1350
Total Samples: 1814
Nested Sampling ln(Z): 142.906738
Importance Nested Sampling ln(Z): 235.442346 +/- *** glibc detected * python: free(): ======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x7e846)[0x7f8727a238 /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /usr/lib/python2.7/lib-dynload/_ctypes.so(ffi_call_uni /usr/lib/python2.7/lib-dynload/_ctypes.so(ffi_call+0x1 /usr/lib/python2.7/lib-dynload/_ctypes.so(_ctypes_call /usr/lib/python2.7/lib-dynload/_ctypes.so(+0xbaa2)[0x7 python(PyObject_Call+0x36)[0x4d91b6]
python(PyEval_EvalFrameEx+0x86a)[0x54c0da]
python(PyEval_EvalCodeEx+0x1a2)[0x575d92]
python(PyEval_EvalFrameEx+0x7b8)[0x54c028]
python(PyEval_EvalCodeEx+0x1a2)[0x575d92]
python(PyRun_SimpleFileExFlags+0x292)[0x4c1352]
python(Py_Main+0x87f)[0x4c754f]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed python[0x41ba41]
======= Memory map: ========
00400000-00672000 r-xp 00000000 08:03 53091941 00871000-00872000 r--p 00271000 08:03 53091941 00872000-008db000 rw-p 00272000 08:03 53091941 008db000-008ed000 rw-p 00000000 00:00 0
01159000-0281f000 rw-p 00000000 00:00 0 7f871b0cf000-7f871b134000 r-xp 00000000 08:03 56234703 7f871b134000-7f871b333000 ---p 00065000 08:03 56234703 7f871b333000-7f871b336000 r--p 00064000 08:03 56234703 7f871b336000-7f871b337000 rw-p 00067000 08:03 56234703 7f871b337000-7f871b357000 r-xp 00000000 08:03 56234704 7f871b357000-7f871b556000 ---p 00020000 08:03 56234704 7f871b556000-7f871b558000 r--p 0001f000 08:03 56234704 7f871b558000-7f871b559000 rw-p 00021000 08:03 56234704 7f871b559000-7f871b55a000 ---p 00000000 00:00 0
7f871b55a000-7f871bd5a000 rwxp 00000000 00:00 0
7f871bd5a000-7f871bd5f000 r-xp 00000000 08:03 53092554 7f871bd5f000-7f871bf5e000 ---p 00005000 08:03 53092554 7f871bf5e000-7f871bf5f000 r--p 00004000 08:03 53092554 7f871bf5f000-7f871bf60000 rw-p 00005000 08:03 53092554 7f871bf60000-7f871bf62000 r-xp 00000000 08:03 53092543 7f871bf62000-7f871c161000 ---p 00002000 08:03 53092543 7f871c161000-7f871c162000 r--p 00001000 08:03 53092543 7f871c162000-7f871c163000 rw-p 00002000 08:03 53092543 7f871c163000-7f871c18a000 r-xp 00000000 08:03 9568279 7f871c18a000-7f871c38a000 ---p 00027000 08:03 9568279 7f871c38a000-7f871c38c000 r--p 00027000 08:03 9568279 7f871c38c000-7f871c38d000 rw-p 00029000 08:03 9568279 7f871c38d000-7f871c396000 r-xp 00000000 08:03 53086345 7f871c396000-7f871c595000 ---p 00009000 08:03 53086345 7f871c595000-7f871c596000 r--p 00008000 08:03 53086345 7f871c596000-7f871c597000 rw-p 00009000 08:03 53086345 7f871c597000-7f871c5a7000 r-xp 00000000 08:03 53086290 7f871c5a7000-7f871c7a6000 ---p 00010000 08:03 53086290 7f871c7a6000-7f871c7a7000 r--p 0000f000 08:03 53086290 7f871c7a7000-7f871c7a8000 rw-p 00010000 08:03 53086290 7f871c7a8000-7f871c7c5000 r-xp 00000000 08:03 53086286 7f871c7c5000-7f871c9c4000 ---p 0001d000 08:03 53086286 7f871c9c4000-7f871c9c5000 r--p 0001c000 08:03 53086286 7f871c9c5000-7f871c9c6000 rw-p 0001d000 08:03 53086286 7f871c9c6000-7f871c9fa000 r-xp 00000000 08:03 53086452 7f871c9fa000-7f871cbfa000 ---p 00034000 08:03 53086452 7f871cbfa000-7f871cbfb000 r--p 00034000 08:03 53086452 7f871cbfb000-7f871cbfc000 rw-p 00035000 08:03 53086452 7f871cbfc000-7f871cc10000 r-xp 00000000 08:03 53092560 7f871cc10000-7f871ce0f000 ---p 00014000 08:03 53092560 7f871ce0f000-7f871ce10000 r--p 00013000 08:03 53092560 7f871ce10000-7f871ce11000 rw-p 00014000 08:03 53092560 7f871ce11000-7f871ce13000 r-xp 00000000 08:03 53085233 7f871ce13000-7f871d013000 ---p 00002000 08:03 53085233 7f871d013000-7f871d014000 r--p 00002000 08:03 53085233 7f871d014000-7f871d015000 rw-p 00003000 08:03 53085233 7f871d015000-7f871d145000 r-xp 00000000 08:03 53086288 7f871d145000-7f871d345000 ---p 00130000 08:03 53086288 7f871d345000-7f871d346000 r--p 00130000 08:03 53086288 7f871d346000-7f871d34a000 rw-p 00131000 08:03 53086288 7f871d34a000-7f871d458000 r-xp 00000000 08:03 53092034 7f871d458000-7f871d657000 ---p 0010e000 08:03 53092034 7f871d657000-7f871d65b000 r--p 0010d000 08:03 53092034 7f871d65b000-7f871d662000 rw-p 00111000 08:03 53092034 7f871d662000-7f871d663000 rw-p 00000000 00:00 0
7f871d663000-7f871d78a000 r-xp 00000000 08:03 53092040 7f871d78a000-7f871d989000 ---p 00127000 08:03 53092040 7f871d989000-7f871d994000 r--p 00126000 08:03 53092040 7f871d994000-7f871d9a8000 rw-p 00131000 08:03 53092040 7f871d9a8000-7f871dab0000 r-xp 00000000 08:03 53092044 7f871dab0000-7f871dcaf000 ---p 00108000 08:03 53092044 7f871dcaf000-7f871dcb0000 r--p 00107000 08:03 53092044 7f871dcb0000-7f871dccd000 rw-p 00108000 08:03 53092044 7f871dccd000-7f871dcce000 rw-p 00000000 00:00 0
7f871dcce000-7f871dcda000 r-xp 00000000 08:03 53216120 7f871dcda000-7f871ded9000 ---p 0000c000 08:03 53216120 7f871ded9000-7f871deda000 r--p 0000b000 08:03 53216120 7f871deda000-7f871dedc000 rw-p 0000c000 08:03 53216120 7f871dedc000-7f871df13000 r-xp 00000000 08:03 56101243 7f871df13000-7f871e113000 ---p 00037000 08:03 56101243 7f871e113000-7f871e115000 r--p 00037000 08:03 56101243 7f871e115000-7f871e116000 rw-p 00039000 08:03 56101243 7f871e116000-7f871e124000 r-xp 00000000 08:03 56101245 7f871e124000-7f871e323000 ---p 0000e000 08:03 56101245 7f871e323000-7f871e324000 r--p 0000d000 08:03 56101245 7f871e324000-7f871e325000 rw-p 0000e000 08:03 56101245 7f871e325000-7f871e626000 rw-p 00000000 00:00 0
7f871e626000-7f871e668000 r-xp 00000000 08:03 56101244 7f871e668000-7f871e868000 ---p 00042000 08:03 56101244 7f871e868000-7f871e86a000 r--p 00042000 08:03 56101244 7f871e86a000-7f871e86c000 rw-p 00044000 08:03 56101244 7f871e86c000-7f871e871000 r-xp 00000000 08:03 56101248 7f871e871000-7f871ea71000 ---p 00005000 08:03 56101248 7f871ea71000-7f871ea72000 r--p 00005000 08:03 56101248 7f871ea72000-7f871ea73000 rw-p 00006000 08:03 56101248 7f871ea73000-7f871ea99000 r-xp 00000000 08:03 9571901 7f871ea99000-7f871ec99000 ---p 00026000 08:03 9571901 7f871ec99000-7f871ec9a000 r--p 00026000 08:03 9571901 7f871ec9a000-7f871ec9b000 rw-p 00027000 08:03 9571901 7f871ec9b000-7f871ecc1000 r-xp 00000000 08:03 56101241 7f871ecc1000-7f871eec0000 ---p 00026000 08:03 56101241 7f871eec0000-7f871eec2000 r--p 00025000 08:03 56101241 7f871eec2000-7f871eec3000 rw-p 00027000 08:03 56101241 7f871eec3000-7f871eec9000 r-xp 00000000 08:03 53223346 7f871eec9000-7f871f0c8000 ---p 00006000 08:03 53223346 7f871f0c8000-7f871f0c9000 r--p 00005000 08:03 53223346 7f871f0c9000-7f871f0cb000 rw-p 00006000 08:03 53223346 7f871f0cb000-7f871f0cd000 r-xp 00000000 08:03 56101247 7f871f0cd000-7f871f2cc000 ---p 00002000 08:03 56101247 7f871f2cc000-7f871f2cd000 r--p 00001000 08:03 56101247 7f871f2cd000-7f871f2ce000 rw-p 00002000 08:03 56101247 7f871f2ce000-7f871f364000 r-xp 00000000 08:03 53086331 7f871f364000-7f871f563000 ---p 00096000 08:03 53086331 7f871f563000-7f871f569000 r--p 00095000 08:03 53086331 7f871f569000-7f871f56a000 rw-p 0009b000 08:03 53086331 7f871f56a000-7f871f5ae000 r-xp 00000000 08:03 56101246 7f871f5ae000-7f871f7ad000 ---p 00044000 08:03 56101246 7f871f7ad000-7f871f7b0000 r--p 00043000 08:03 56101246 7f871f7b0000-7f871f7b2000 rw-p 00046000 08:03 56101246 7f871f7b2000-7f871f7b3000 rw-p 00000000 00:00 0
7f871f7b3000-7f871f7f5000 r-xp 00000000 08:03 56101249 7f871f7f5000-7f871f9f5000 ---p 00042000 08:03 56101249 7f871f9f5000-7f871f9f7000 r--p 00042000 08:03 56101249 7f871f9f7000-7f871f9f8000 rw-p 00044000 08:03 56101249 7f871f9f8000-7f871fa0c000 r-xp 00000000 08:03 53223351 7f871fa0c000-7f871fc0b000 ---p 00014000 08:03 53223351 7f871fc0b000-7f871fc0c000 r--p 00013000 08:03 53223351 7f871fc0c000-7f871fc10000 rw-p 00014000 08:03 53223351 7f871fc10000-7f871fc19000 r-xp 00000000 08:03 59115538 7f871fc19000-7f871fe19000 ---p 00009000 08:03 59115538 7f871fe19000-7f871fe1a000 r--p 00009000 08:03 59115538 ======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x7e846)[0x7fe46570c8 /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /home/gianni/sw/JZ/jz/MultiNest_v3.5_CMake/multinest/l /usr/lib/python2.7/lib-dynload/_ctypes.so(ffi_call_uni /usr/lib/python2.7/lib-dynload/_ctypes.so(ffi_call+0x1 /usr/lib/python2.7/lib-dynload/_ctypes.so(_ctypes_call /usr/lib/python2.7/lib-dynload/_ctypes.so(+0xbaa2)[0x7 python(PyObject_Call+0x36)[0x4d91b6]
python(PyEval_EvalFrameEx+0x86a)[0x54c0da]
python(PyEval_EvalCodeEx+0x1a2)[0x575d92]
python(PyEval_EvalFrameEx+0x7b8)[0x54c028]
python(PyEval_EvalCodeEx+0x1a2)[0x575d92]
python(PyRun_SimpleFileExFlags+0x292)[0x4c1352]
python(Py_Main+0x87f)[0x4c754f]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed python[0x41ba41]
======= Memory map: ========
00400000-00672000 r-xp 00000000 08:03 53091941 00871000-00872000 r--p 00271000 08:03 53091941 00872000-008db000 rw-p 00272000 08:03 53091941 008db000-008ed000 rw-p 00000000 00:00 0
00f1f000-025d7000 rw-p 00000000 00:00 0 7fe458db8000-7fe458e1d000 r-xp 00000000 08:03 56234703 7fe458e1d000-7fe45901c000 ---p 00065000 08:03 56234703 7fe45901c000-7fe45901f000 r--p 00064000 08:03 56234703 7fe45901f000-7fe459020000 rw-p 00067000 08:03 56234703 7fe459020000-7fe459040000 r-xp 00000000 08:03 56234704 7fe459040000-7fe45923f000 ---p 00020000 08:03 56234704 7fe45923f000-7fe459241000 r--p 0001f000 08:03 56234704 7fe459241000-7fe459242000 rw-p 00021000 08:03 56234704 7fe459242000-7fe459243000 ---p 00000000 00:00 0
7fe459243000-7fe459a43000 rwxp 00000000 00:00 0
7fe459a43000-7fe459a48000 r-xp 00000000 08:03 53092554 7fe459a48000-7fe459c47000 ---p 00005000 08:03 53092554 7fe459c47000-7fe459c48000 r--p 00004000 08:03 53092554 7fe459c48000-7fe459c49000 rw-p 00005000 08:03 53092554 7fe459c49000-7fe459c4b000 r-xp 00000000 08:03 53092543 7fe459c4b000-7fe459e4a000 ---p 00002000 08:03 53092543 7fe459e4a000-7fe459e4b000 r--p 00001000 08:03 53092543 7fe459e4b000-7fe459e4c000 rw-p 00002000 08:03 53092543 7fe459e4c000-7fe459e73000 r-xp 00000000 08:03 9568279 7fe459e73000-7fe45a073000 ---p 00027000 08:03 9568279 7fe45a073000-7fe45a075000 r--p 00027000 08:03 9568279 7fe45a075000-7fe45a076000 rw-p 00029000 08:03 9568279 7fe45a076000-7fe45a07f000 r-xp 00000000 08:03 53086345 7fe45a07f000-7fe45a27e000 ---p 00009000 08:03 53086345 7fe45a27e000-7fe45a27f000 r--p 00008000 08:03 53086345 7fe45a27f000-7fe45a280000 rw-p 00009000 08:03 53086345 7fe45a280000-7fe45a290000 r-xp 00000000 08:03 53086290 7fe45a290000-7fe45a48f000 ---p 00010000 08:03 53086290 7fe45a48f000-7fe45a490000 r--p 0000f000 08:03 53086290 7fe45a490000-7fe45a491000 rw-p 00010000 08:03 53086290 7fe45a491000-7fe45a4ae000 r-xp 00000000 08:03 53086286 7fe45a4ae000-7fe45a6ad000 ---p 0001d000 08:03 53086286 7fe45a6ad000-7fe45a6ae000 r--p 0001c000 08:03 53086286 7fe45a6ae000-7fe45a6af000 rw-p 0001d000 08:03 53086286 7fe45a6af000-7fe45a6e3000 r-xp 00000000 08:03 53086452 7fe45a6e3000-7fe45a8e3000 ---p 00034000 08:03 53086452 7fe45a8e3000-7fe45a8e4000 r--p 00034000 08:03 53086452 7fe45a8e4000-7fe45a8e5000 rw-p 00035000 08:03 53086452 7fe45a8e5000-7fe45a8f9000 r-xp 00000000 08:03 53092560 7fe45a8f9000-7fe45aaf8000 ---p 00014000 08:03 53092560 7fe45aaf8000-7fe45aaf9000 r--p 00013000 08:03 53092560 7fe45aaf9000-7fe45aafa000 rw-p 00014000 08:03 53092560 7fe45aafa000-7fe45aafc000 r-xp 00000000 08:03 53085233 7fe45aafc000-7fe45acfc000 ---p 00002000 08:03 53085233 7fe45acfc000-7fe45acfd000 r--p 00002000 08:03 53085233 7fe45acfd000-7fe45acfe000 rw-p 00003000 08:03 53085233 7fe45acfe000-7fe45ae2e000 r-xp 00000000 08:03 53086288 7fe45ae2e000-7fe45b02e000 ---p 00130000 08:03 53086288 7fe45b02e000-7fe45b02f000 r--p 00130000 08:03 53086288 7fe45b02f000-7fe45b033000 rw-p 00131000 08:03 53086288 7fe45b033000-7fe45b141000 r-xp 00000000 08:03 53092034 7fe45b141000-7fe45b340000 ---p 0010e000 08:03 53092034 7fe45b340000-7fe45b344000 r--p 0010d000 08:03 53092034 7fe45b344000-7fe45b34b000 rw-p 00111000 08:03 53092034 7fe45b34b000-7fe45b34c000 rw-p 00000000 00:00 0
7fe45b34c000-7fe45b473000 r-xp 00000000 08:03 53092040 7fe45b473000-7fe45b672000 ---p 00127000 08:03 53092040 7fe45b672000-7fe45b67d000 r--p 00126000 08:03 53092040 7fe45b67d000-7fe45b691000 rw-p 00131000 08:03 53092040 7fe45b691000-7fe45b799000 r-xp 00000000 08:03 53092044 7fe45b799000-7fe45b998000 ---p 00108000 08:03 53092044 7fe45b998000-7fe45b999000 r--p 00107000 08:03 53092044 7fe45b999000-7fe45b9b6000 rw-p 00108000 08:03 53092044 7fe45b9b6000-7fe45b9b7000 rw-p 00000000 00:00 0
7fe45b9b7000-7fe45b9c3000 r-xp 00000000 08:03 53216120 7fe45b9c3000-7fe45bbc2000 ---p 0000c000 08:03 53216120 7fe45bbc2000-7fe45bbc3000 r--p 0000b000 08:03 53216120 7fe45bbc3000-7fe45bbc5000 rw-p 0000c000 08:03 53216120 7fe45bbc5000-7fe45bbfc000 r-xp 00000000 08:03 56101243 7fe45bbfc000-7fe45bdfc000 ---p 00037000 08:03 56101243 7fe45bdfc000-7fe45bdfe000 r--p 00037000 08:03 56101243 7fe45bdfe000-7fe45bdff000 rw-p 00039000 08:03 56101243 7fe45bdff000-7fe45be0d000 r-xp 00000000 08:03 56101245 7fe45be0d000-7fe45c00c000 ---p 0000e000 08:03 56101245 7fe45c00c000-7fe45c00d000 r--p 0000d000 08:03 56101245 7fe45c00d000-7fe45c00e000 rw-p 0000e000 08:03 56101245 7fe45c00e000-7fe45c30f000 rw-p 00000000 00:00 0
7fe45c30f000-7fe45c351000 r-xp 00000000 08:03 56101244 7fe45c351000-7fe45c551000 ---p 00042000 08:03 56101244 7fe45c551000-7fe45c553000 r--p 00042000 08:03 56101244 7fe45c553000-7fe45c555000 rw-p 00044000 08:03 56101244 7fe45c555000-7fe45c55a000 r-xp 00000000 08:03 56101248 7fe45c55a000-7fe45c75a000 ---p 00005000 08:03 56101248 0.517489
0.427753
invalid next size (normal): 0x00000000027809d0 ***
46]
ib/libmultinest.so(__posterior_MOD_pos_samp+0x7cfa)[0x7f872705e804]
ib/libmultinest.so(__nested_MOD_clusterednest+0x2176a)[0x7f872708eeb0]
ib/libmultinest.so(__nested_MOD_nestsample+0xfc1)[0x7f8727093a4f]
ib/libmultinest.so(__nested_MOD_nestrun+0x16c6)[0x7f8727095511]
ib/libmultinest.so(run+0x36e)[0x7f872703c0cf]
x64+0x4c)[0x7f87272baea4]
e5)[0x7f87272ba8c5]
proc+0x4d2)[0x7f87272ab2c2]
f87272abaa2]
)[0x7f87279c676d]
/usr/bin/python2.7
/usr/bin/python2.7
/usr/bin/python2.7
[heap]
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so
/lib/x86_64-linux-gnu/libpng12.so.0.46.0
/lib/x86_64-linux-gnu/libpng12.so.0.46.0
/lib/x86_64-linux-gnu/libpng12.so.0.46.0
/lib/x86_64-linux-gnu/libpng12.so.0.46.0
/usr/lib/pyshared/python2.7/matplotlib/_png.so
/usr/lib/pyshared/python2.7/matplotlib/_png.so
/usr/lib/pyshared/python2.7/matplotlib/_png.so
/usr/lib/pyshared/python2.7/matplotlib/_png.so
/usr/lib/python2.7/lib-dynload/_csv.so
/usr/lib/python2.7/lib-dynload/_csv.so
/usr/lib/python2.7/lib-dynload/_csv.so
/usr/lib/python2.7/lib-dynload/_csv.so
/usr/lib/pyshared/python2.7/matplotlib/nxutils.so
/usr/lib/pyshared/python2.7/matplotlib/nxutils.so
/usr/lib/pyshared/python2.7/matplotlib/nxutils.so
/usr/lib/pyshared/python2.7/matplotlib/nxutils.so
/usr/lib/x86_64-linux-gnu/libfreetype.so.6.8.0
/usr/lib/x86_64-linux-gnu/libfreetype.so.6.8.0
/usr/lib/x86_64-linux-gnu/libfreetype.so.6.8.0
/usr/lib/x86_64-linux-gnu/libfreetype.so.6.8.0
/usr/lib/pyshared/python2.7/matplotlib/ft2font.so
/usr/lib/pyshared/python2.7/matplotlib/ft2font.so
/usr/lib/pyshared/python2.7/matplotlib/ft2font.so
/usr/lib/pyshared/python2.7/matplotlib/ft2font.so
/usr/lib/pyshared/python2.7/matplotlib/_path.so
/usr/lib/pyshared/python2.7/matplotlib/_path.so
/usr/lib/pyshared/python2.7/matplotlib/_path.so
/usr/lib/pyshared/python2.7/matplotlib/_path.so
/usr/lib/python2.7/lib-dynload/datetime.so
/usr/lib/python2.7/lib-dynload/datetime.so
/usr/lib/python2.7/lib-dynload/datetime.so
/usr/lib/python2.7/lib-dynload/datetime.so
/usr/lib/python2.7/dist-packages/scipy/spatial/_distance_wrap.so
/usr/lib/python2.7/dist-packages/scipy/spatial/_distance_wrap.so
/usr/lib/python2.7/dist-packages/scipy/spatial/_distance_wrap.so* glibc detected *** python: free(): invalid next size (normal): 0x0000000002546a80 ***
46]
ib/libmultinest.so(__posterior_MOD_pos_samp+0x7cfa)[0x7fe464d47804]
ib/libmultinest.so(__nested_MOD_clusterednest+0x2176a)[0x7fe464d77eb0]
ib/libmultinest.so(__nested_MOD_nestsample+0xfc1)[0x7fe464d7ca4f]
ib/libmultinest.so(__nested_MOD_nestrun+0x16c6)[0x7fe464d7e511]
ib/libmultinest.so(run+0x36e)[0x7fe464d250cf]
x64+0x4c)[0x7fe464fa3ea4]
e5)[0x7fe464fa38c5]
proc+0x4d2)[0x7fe464f942c2]
fe464f94aa2]
)[0x7fe4656af76d]
/usr/bin/python2.7
/usr/bin/python2.7
/usr/bin/python2.7
[heap]
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_backend_agg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/pyshared/python2.7/matplotlib/backends/_tkagg.so
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/lib/x86_64-linux-gnu/libexpat.so.1.5.2
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXrender.so.1.3.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libXext.so.6.4.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libfontconfig.so.1.4.4
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXft.so.2.2.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libXss.so.1.0.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtcl8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libtk8.5.so.0
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/libBLT.2.4.so.8.5
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/python2.7/lib-dynload/_tkinter.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_tri.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_delaunay.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_image.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so
/usr/lib/pyshared/python2.7/matplotlib/_cntr.so--------------------------------------------------------------------------

mpirun noticed that process rank 0 with PID 21820 on node gianni-Precision-M6700 exited on signal 6 (Aborted).

Any ideas?

JohannesBuchner · 2014-09-27T08:29:38Z

Same as issue #45

jtlz2 · 2014-09-27T09:43:50Z

Really..? The crash happens before any expected exit, in either case.

Practical Astronomy with your Calculator or Spreadsheet, Peter
Duffett-Smith, Jonathan Zwart
For more information see www.cambridge.org/practicalastronomy

jtlz2 · 2014-09-28T07:54:50Z

@JohannesBuchner - what makes you think this is to do with exiting? The code terminates well before it should exit, and multinest itself runs fine under MPI with this setup...

JohannesBuchner · 2014-09-28T08:48:42Z

Hmm. The other bug seems to occur exactly when MultiNest is done and is exiting. So I thought it might have something to do with terminating MPI instances. However, I am not very experienced with MPI.

Another possibility is that python, for some reason, frees some variable another instance still needs. I am not sure how MPI creates multiple python processes. They should not share any memory, because in Python, only one process/thread can work at a time (Global Interpreter Lock).

JohannesBuchner closed this as completed Sep 27, 2014

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

MPI and segfault #46

MPI and segfault #46

jtlz2 commented Sep 26, 2014

JohannesBuchner commented Sep 27, 2014

jtlz2 commented Sep 27, 2014

jtlz2 commented Sep 28, 2014

JohannesBuchner commented Sep 28, 2014

MPI and segfault #46

MPI and segfault #46

Comments

jtlz2 commented Sep 26, 2014

mpirun noticed that process rank 0 with PID 21820 on node gianni-Precision-M6700 exited on signal 6 (Aborted).

JohannesBuchner commented Sep 27, 2014

jtlz2 commented Sep 27, 2014

jtlz2 commented Sep 28, 2014

JohannesBuchner commented Sep 28, 2014