Info

When running against a server with a large number of databases (in this case over 2,500), mongotop dies immediately: $ mongotop connected to: 127.0.0.1 assertion: 13106 nextSafe(): { $err: "BSONObj size: 31507783 (0x1E0C547) is invalid. Size must be between 0 and 16793600(16MB)", code: 10334 }

Top User Comments

gregmurphy commented on Tue, 8 Sep 2015 16:28:42 +0000: Server logs from the relevant connection: Sep 8 16:00:02 mongod.27017[1176]: [conn705013] Assertion: 10334:BSONObj size: 31507599 (0x1E0C48F) is invalid. Size must be between 0 and 16793600(16MB) First element: note: "all times in microseconds" Sep 8 16:00:02 mongod.27017[1176]: [conn705013] 0x1219651 0x11ba9d9 0x119f736 0x119fc9c 0x774543 0xf0b76d 0xa31b8a 0xa3364a 0xa35468 0xd74992 0xbb2bd2 0xbb41f0 0x7728f8 0x11cedeb 0x7f93190a9182 0x7f93183ae47d #012 /usr/bin/mongod(ZN5mongo15printStackTraceERSo+0x21) [0x1219651]#012 /usr/bin/mongod(_ZN5mongo10logContextEPKc+0x159) [0x11ba9d9]#012 /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x119f736]#012 /usr/bin/mongod() [0x119fc9c]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x473) [0x774543]#012 /usr/bin/mongod(_ZN5mongo6TopCmd3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2cd) [0xf0b76d]#012 /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0xa31b8a]#012 /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xfba) [0xa3364a]#012 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6f8) [0xa35468]#012 /usr/bin/mongod(_ZN5mongo11newRunQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x23d2) [0xd74992]#012 /usr/bin/mongod() [0xbb2bd2]#012 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x5a0) [0xbb41f0]#012 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x7728f8]#012 /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x50b) [0x11cedeb]#012 /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f93190a9182]#012 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f93183ae47d] Sep 8 16:00:02 mongod.27017[1176]: [conn705013] Assertion: 10334:BSONObj size: 31507599 (0x1E0C48F) is invalid. Size must be between 0 and 16793600(16MB) First element: note: "all times in microseconds" Sep 8 16:00:02 mongod.27017[1176]: [conn705013] 0x1219651 0x11ba9d9 0x119f736 0x119fc9c 0x774543 0x775726 0x77443c 0x91f18f 0xa3365f 0xa35468 0xd74992 0xbb2bd2 0xbb41f0 0x7728f8 0x11cedeb 0x7f93190a9182 0x7f93183ae47d #012 /usr/bin/mongod(ZN5mongo15printStackTraceERSo+0x21) [0x1219651]#012 /usr/bin/mongod(_ZN5mongo10logContextEPKc+0x159) [0x11ba9d9]#012 /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x119f736]#012 /usr/bin/mongod() [0x119fc9c]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x473) [0x774543]#012 /usr/bin/mongod(_ZNK5mongo11BSONElement8toStringERNS_17StringBuilderImplINS_16TrivialAllocatorEEEbbi+0x826) [0x775726]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x36c) [0x77443c]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderEbRKSs+0x59f) [0x91f18f]#012 /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xfcf) [0xa3365f]#012 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6f8) [0xa35468]#012 /usr/bin/mongod(_ZN5mongo11newRunQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x23d2) [0xd74992]#012 /usr/bin/mongod() [0xbb2bd2]#012 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x5a0) [0xbb41f0]#012 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x7728f8]#012 /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x50b) [0x11cedeb]#012 /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f93190a9182]#012 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f93183ae47d] Sep 8 16:00:02 mongod.27017[1176]: [conn705013] Assertion: 10334:BSONObj size: 31507783 (0x1E0C547) is invalid. Size must be between 0 and 16793600(16MB) Sep 8 16:00:02 mongod.27017[1176]: [conn705013] 0x1219651 0x11ba9d9 0x119f736 0x119fc9c 0x774543 0x91f18f 0xa3365f 0xa35468 0xd74992 0xbb2bd2 0xbb41f0 0x7728f8 0x11cedeb 0x7f93190a9182 0x7f93183ae47d #012 /usr/bin/mongod(ZN5mongo15printStackTraceERSo+0x21) [0x1219651]#012 /usr/bin/mongod(_ZN5mongo10logContextEPKc+0x159) [0x11ba9d9]#012 /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x119f736]#012 /usr/bin/mongod() [0x119fc9c]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x473) [0x774543]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderEbRKSs+0x59f) [0x91f18f]#012 /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xfcf) [0xa3365f]#012 /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6f8) [0xa35468]#012 /usr/bin/mongod(_ZN5mongo11newRunQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x23d2) [0xd74992]#012 /usr/bin/mongod() [0xbb2bd2]#012 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x5a0) [0xbb41f0]#012 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x7728f8]#012 /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x50b) [0x11cedeb]#012 /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f93190a9182]#012 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f93183ae47d] Sep 8 16:00:02 mongod.27017[1176]: [conn705013] Assertion: 10334:BSONObj size: 31507599 (0x1E0C48F) is invalid. Size must be between 0 and 16793600(16MB) First element: note: "all times in microseconds" Sep 8 16:00:02 mongod.27017[1176]: [conn705013] 0x1219651 0x11ba9d9 0x119f736 0x119fc9c 0x774543 0x775726 0x77443c 0x91f18f 0x91fe34 0xd75f07 0xbb2bd2 0xbb41f0 0x7728f8 0x11cedeb 0x7f93190a9182 0x7f93183ae47d #012 /usr/bin/mongod(ZN5mongo15printStackTraceERSo+0x21) [0x1219651]#012 /usr/bin/mongod(_ZN5mongo10logContextEPKc+0x159) [0x11ba9d9]#012 /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x119f736]#012 /usr/bin/mongod() [0x119fc9c]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x473) [0x774543]#012 /usr/bin/mongod(_ZNK5mongo11BSONElement8toStringERNS_17StringBuilderImplINS_16TrivialAllocatorEEEbbi+0x826) [0x775726]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x36c) [0x77443c]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderEbRKSs+0x59f) [0x91f18f]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderERKNS_6StatusE+0x54) [0x91fe34]#012 /usr/bin/mongod(_ZN5mongo11newRunQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x3947) [0xd75f07]#012 /usr/bin/mongod() [0xbb2bd2]#012 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x5a0) [0xbb41f0]#012 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x7728f8]#012 /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x50b) [0x11cedeb]#012 /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f93190a9182]#012 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f93183ae47d] Sep 8 16:00:02 mongod.27017[1176]: [conn705013] Assertion: 10334:BSONObj size: 31507783 (0x1E0C547) is invalid. Size must be between 0 and 16793600(16MB) Sep 8 16:00:02 mongod.27017[1176]: [conn705013] 0x1219651 0x11ba9d9 0x119f736 0x119fc9c 0x774543 0x91f18f 0x91fe34 0xd75f07 0xbb2bd2 0xbb41f0 0x7728f8 0x11cedeb 0x7f93190a9182 0x7f93183ae47d #012 /usr/bin/mongod(ZN5mongo15printStackTraceERSo+0x21) [0x1219651]#012 /usr/bin/mongod(_ZN5mongo10logContextEPKc+0x159) [0x11ba9d9]#012 /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0xe6) [0x119f736]#012 /usr/bin/mongod() [0x119fc9c]#012 /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x473) [0x774543]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderEbRKSs+0x59f) [0x91f18f]#012 /usr/bin/mongod(_ZN5mongo7Command19appendCommandStatusERNS_14BSONObjBuilderERKNS_6StatusE+0x54) [0x91fe34]#012 /usr/bin/mongod(_ZN5mongo11newRunQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x3947) [0xd75f07]#012 /usr/bin/mongod() [0xbb2bd2]#012 /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x5a0) [0xbb41f0]#012 /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x7728f8]#012 /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x50b) [0x11cedeb]#012 /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f93190a9182]#012 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f93183ae47d] Sep 8 16:00:02 mongod.27017[1176]: [conn705013] assertion 10334 BSONObj size: 31507783 (0x1E0C547) is invalid. Size must be between 0 and 16793600(16MB) ns:admin.$cmd query: { top: 1 } Sep 8 16:00:02 mongod.27017[1176]: [conn705013] ntoskip:0 ntoreturn:1 Sep 8 16:00:02 mongod.27017[1176]: [conn705013] query admin.$cmd query: { top: 1 } ntoreturn:1 keyUpdates:0 exception: BSONObj size: 31507783 (0x1E0C547) is invalid. Size must be between 0 and 16793600(16MB) code:10334 numYields:0 reslen:134 366ms Sep 8 16:00:02 mongod.27017[1176]: [conn705013] end connection 127.0.0.1:35350 (129 connections now open)

Steps to Reproduce