...
os version:7.2 mongodb version:3.4.6 when i restart the machine after power failure and initialise the replication member,it issue: 2017-09-29T10:55:05.045+0800 F - [thread3] Invalid access at address: 0x400000 2017-09-29T10:55:05.249+0800 F - [thread3] Got signal: 11 (Segmentation fault). 0x7f9ce13d4a41 0x7f9ce13d3c59 0x7f9ce13d42c6 0x7f9cdeab7370 0x7f9ce1d9954d 0x7f9ce1d99e26 0x7f9ce1d9a408 0x7f9ce1d9b5c9 0x7f9ce1d5dcab 0x7f9ce1d59143 0x7f9ce1d594d7 0x7f9ce1d5ae83 0x7f9ce1dc4f46 0x7f9cdeaafdc5 0x7f9cde7de76d ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"7F9CDFE63000","o":"1571A41","s":"_ZN5mongo15printStackTraceERSo"},{"b":"7F9CDFE63000","o":"1570C59"},{"b":"7F9CDFE63000","o":"15712C6"},{"b":"7F9CDEAA8000","o":"F370"},{"b":"7F9CDFE63000","o":"1F3654D"},{"b":"7F9CDFE63000","o":"1F36E26"},{"b":"7F9CDFE63000","o":"1F37408"},{"b":"7F9CDFE63000","o":"1F385C9","s":"__wt_reconcile"},{"b":"7F9CDFE63000","o":"1EFACAB","s":"__wt_evict"},{"b":"7F9CDFE63000","o":"1EF6143"},{"b":"7F9CDFE63000","o":"1EF64D7"},{"b":"7F9CDFE63000","o":"1EF7E83","s":"__wt_evict_thread_run"},{"b":"7F9CDFE63000","o":"1F61F46","s":"__wt_thread_run"},{"b":"7F9CDEAA8000","o":"7DC5"},{"b":"7F9CDE6E7000","o":"F776D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.6", "gitVersion" : "c55eb86ef46ee7aede3b1e2a5d184a7df4bfb5b5", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.10.0-327.el7.x86_64", "version" : "#1 SMP Thu Nov 19 22:10:57 UTC 2015", "machine" : "x86_64" }, "somap" : [ { "b" : "7F9CDFE63000", "elfType" : 3, "buildId" : "60D7165C62663B8B732487CBB271FFEC7B04C8A6" }, { "b" : "7FFFCF2DE000", "elfType" : 3, "buildId" : "0F488C85309E4AB293D3B758748A3037B01F9885" }, { "b" : "7F9CDF9D2000", "path" : "/lib64/libssl.so.10", "elfType" : 3, "buildId" : "90EAF65D9B0EEEB1424241281F7F197451D4317D" }, { "b" : "7F9CDF5E8000", "path" : "/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "7278C69EE161D98DDD0FA00F92B67AD78C7B7F40" }, { "b" : "7F9CDF3E0000", "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "82E77ADE22BC9FFF8D3458BD37331E7EDF174C28" }, { "b" : "7F9CDF1DC000", "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "C5F560504E1AF52E29679C3B52FF11121015D6BB" }, { "b" : "7F9CDEEDA000", "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "721C7CC9488EFA25F83B48AF713AB27DBE48EF3E" }, { "b" : "7F9CDECC4000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "408B46E291B2D4C9612E27C0509D165D7E186D40" }, { "b" : "7F9CDEAA8000", "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "C3DEB1FA27CD0C1C3CC575B944ABACBA0698B0F2" }, { "b" : "7F9CDE6E7000", "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "1CC0E171FD5E7E28A6BB49667AFBD730CDBF22A0" }, { "b" : "7F9CDFC40000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "0874508AA13D28E3F48637C1D5BF067BA8D9FD3A" }, { "b" : "7F9CDE499000", "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "A2499C359AA179EE23324ED949C0E508E4434F10" }, { "b" : "7F9CDE1B2000", "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "E09A34D9083DC6FEAF7018C09D55631DEEE2836D" }, { "b" : "7F9CDDFAE000", "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "3A1166709F88740C49E060731832E3FAD2DFB66B" }, { "b" : "7F9CDDD7C000", "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "BF8F00D7CB849ADB0B7A4703BC7B8D66AEE6A49C" }, { "b" : "7F9CDDB66000", "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "EA8E45DC8E395CC5E26890470112D97A1F1E0B65" }, { "b" : "7F9CDD957000", "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "1E7A92FDD6FB3871DA97F4BCA2E147E72B6B6E1F" }, { "b" : "7F9CDD753000", "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "2E01D5AC08C1280D013AAB96B292AC58BC30A263" }, { "b" : "7F9CDD539000", "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "FE7AE845A123A3DFC0FDC2408BCBC2BA8B61B158" }, { "b" : "7F9CDD312000", "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "76687CA31A406854DF3BCF8D03055656F56E6892" }, { "b" : "7F9CDD0B1000", "path" : "/lib64/libpcre.so.1", "elfType" : 3, "buildId" : "30FA397B01197ECABC647CBD8E75FDD5B743D730" } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x7f9ce13d4a41] mongod(+0x1570C59) [0x7f9ce13d3c59] mongod(+0x15712C6) [0x7f9ce13d42c6] libpthread.so.0(+0xF370) [0x7f9cdeab7370] mongod(+0x1F3654D) [0x7f9ce1d9954d] mongod(+0x1F36E26) [0x7f9ce1d99e26] mongod(+0x1F37408) [0x7f9ce1d9a408] mongod(__wt_reconcile+0x1E9) [0x7f9ce1d9b5c9] mongod(__wt_evict+0xDB) [0x7f9ce1d5dcab] mongod(+0x1EF6143) [0x7f9ce1d59143] mongod(+0x1EF64D7) [0x7f9ce1d594d7] mongod(__wt_evict_thread_run+0xD3) [0x7f9ce1d5ae83] mongod(__wt_thread_run+0x16) [0x7f9ce1dc4f46] libpthread.so.0(+0x7DC5) [0x7f9cdeaafdc5] libc.so.6(clone+0x6D) [0x7f9cde7de76d] ----- END BACKTRACE -----
su commented on Sat, 30 Sep 2017 02:09:50 +0000: thanks for you help! I think this problem is the hardware too,because we rebuild the os yesterday,but when after we add the member with this machine,issue still error, when use the other server add this replication,it can use normal. The error log see we can find some memory issue,so we want change memory first,thank you very much. thomas.schubert commented on Fri, 29 Sep 2017 20:25:25 +0000: Hi Su, Thank you for providing the additional log messages. These errors indicate a hardware issue external to mongod. To better understand what is happening, would you please upload the complete syslog from the affected machine? Kind regards, Kelsey su commented on Fri, 29 Sep 2017 03:56:43 +0000: thanks for you help. I update the log in the attachment,but i am sorry we lose the log during power failure. and the first.log is the first issue log,the second.txt is the second time, third is the last log. And it have the different error. we rm the data_path and initialization the member, it still have issue with the second.txt and third.txt. So i do not know how can do? thomas.schubert commented on Fri, 29 Sep 2017 03:34:27 +0000: Hi Su, Would you please provide the complete log files starting before the power failure? I've created a secure upload portal for you to use. Files uploaded to this portal are only visible to MongoDB employees investigating this issue and are routinely deleted after some time. Thank you, Kelsey