Info

MongoDB server crashed with signal 11. I will upload diagnotics data and full log file if you need. # uname -a Linux hostname 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux 2017-06-22T20:50:15.422+0900 F - [NetworkInterfaceASIO-RS-0] Invalid access at address: 0 2017-06-22T20:50:15.439+0900 F - [NetworkInterfaceASIO-RS-0] Got signal: 11 (Segmentation fault). 0x7f7980c595ca 0x7f7980c58849 0x7f7980c58e8f 0x7f797e707370 0x7f79809b4093 0x7f7980d35d1c 0x7f7980d38915 0x7f7980d38ce1 0x7f79809c9970 0x7f79816c48df 0x7f797e6ffdc5 0x7f797e42e73d ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"7F797F763000","o":"14F65CA","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F797F763000","o":"14F5849"},{"b":"7F797F763000","o":"14F5E8F"},{"b":"7F797E6F8000","o":"F370"},{"b":"7F797F763000","o":"1251093","s":"_ZN4asio6detail11timer_queueINS0_18chrono_time_traitsINSt6chrono3_V212system_clockENS_11wait_traitsIS5_EEEEE16get_ready_timersERNS0_8op_queueINS0_19scheduler_operationEEE"},{"b":"7F797F763000","o":"15D2D1C","s":"_ZN4asio6detail13epoll_reactor3runEbRNS0_8op_queueINS0_19scheduler_operationEEE"},{"b":"7F797F763000","o":"15D5915","s":"_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code"},{"b":"7F797F763000","o":"15D5CE1","s":"_ZN4asio6detail9scheduler3runERSt10error_code"},{"b":"7F797F763000","o":"1266970"},{"b":"7F797F763000","o":"1F618DF"},{"b":"7F797E6F8000","o":"7DC5"},{"b":"7F797E337000","o":"F773D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.4-kakao", "gitVersion" : "888390515874a9debd1b6c5d36559ca86b44babd", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.0-514.16.1.el7.x86_64", "version" : "#1 SMP Wed Apr 12 15:04:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "b" : "7F797F763000", "elfType" : 3, "buildId" : "ACE65D1BE5A49573AC50D3472F8CD399B34E9E1F" }, { "b" : "7FFF2598B000", "elfType" : 3, "buildId" : "B1A473E77A06C30ABAADD55464231F0FCFA9D0BF" }, { "b" : "7F797F339000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "82E77ADE22BC9FFF8D3458BD37331E7EDF174C28" }, { "b" : "7F797F135000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "C5F560504E1AF52E29679C3B52FF11121015D6BB" }, { "b" : "7F797EE2C000", "path" : "/lib64/libstdc++.so.6", "elfType" : 3, "buildId" : "913C54197A79038476BCA584355952C7C3B719F9" }, { "b" : "7F797EB2A000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "721C7CC9488EFA25F83B48AF713AB27DBE48EF3E" }, { "b" : "7F797E914000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "408B46E291B2D4C9612E27C0509D165D7E186D40" }, { "b" : "7F797E6F8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "C3DEB1FA27CD0C1C3CC575B944ABACBA0698B0F2" }, { "b" : "7F797E337000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "8B2C421716985B927AA0CAF2A05D0B1F452367F7" }, { "b" : "7F797F541000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "8F3E366E2DB73C330A3791DEAE31AE9579099B44" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x3A) [0x7f7980c595ca] mongod(+0x14F5849) [0x7f7980c58849] mongod(+0x14F5E8F) [0x7f7980c58e8f] libpthread.so.0(+0xF370) [0x7f797e707370] mongod(_ZN4asio6detail11timer_queueINS0_18chrono_time_traitsINSt6chrono3_V212system_clockENS_11wait_traitsIS5_EEEEE16get_ready_timersERNS0_8op_queueINS0_19scheduler_operationEEE+0x213) [0x7f79809b4093] mongod(_ZN4asio6detail13epoll_reactor3runEbRNS0_8op_queueINS0_19scheduler_operationEEE+0x13C) [0x7f7980d35d1c] mongod(_ZN4asio6detail9scheduler10do_run_oneERNS0_11scoped_lockINS0_11posix_mutexEEERNS0_21scheduler_thread_infoERKSt10error_code+0x155) [0x7f7980d38915] mongod(_ZN4asio6detail9scheduler3runERSt10error_code+0xD1) [0x7f7980d38ce1] mongod(+0x1266970) [0x7f79809c9970] mongod(+0x1F618DF) [0x7f79816c48df] libpthread.so.0(+0x7DC5) [0x7f797e6ffdc5] libc.so.6(clone+0x6D) [0x7f797e42e73d] ----- END BACKTRACE -----

Top User Comments

thomas.schubert commented on Mon, 26 Jun 2017 05:42:09 +0000: Thanks for letting us know that changing the hardware of the system resolved the issue. I'm closing this ticket per your comment on SERVER-29707. Kind regards, Thomas sunguck.lee@gmail.com commented on Fri, 23 Jun 2017 05:43:06 +0000: Hi Thomas. (Related to SERVER-29707 issue) We suffered 3 times mongod crash (on different thread stack) on the same server machine. So I am can't help being doubtful of hardware or somewhere of linux os. First of all, we will change the memory of the machine, and watching this issue for a while. I will comment in a few days again. Regards, Matt. sunguck.lee@gmail.com commented on Fri, 23 Jun 2017 01:12:52 +0000: Hi Thomas. Coredump could not be written to disk because of the free disk space. I have added some code(online backup) but which is different code path from above stack trace. And added feature is not activated on this server. I have prepared more free disk for coredump, I will get back if this crash happen again. Thanks. thomas.schubert commented on Thu, 22 Jun 2017 14:21:32 +0000: Hi matt.lee, Could you please provide a more detailed stack trace as well as a description of the changes that have been made to the source code? Thank you, Thomas

Steps to Reproduce