OPERATIONAL DEFECT DATABASE
...
...
In sharded 7.2 clusters, the object inside $searchMeta is not being correctly passed to shards after PlanShardedSearch When running an aggregation pipeline like [ { '$searchMeta': { index: 'drugs', facet: { operator: { exists: { path: 'id' } }, facets: { manufacturers: { type: 'string', path: 'openfda.manufacturer_name', numBuckets: 10 }, routes: { type: 'string', path: 'openfda.route', numBuckets: 10 } } } } } ] We can see this line in logs (verbosity set to 5): mongos_1 | {"t":{"$date":"2024-01-24T23:16:42.756+00:00"},"s":"D4", "c":"ASIO", "id":22596, "ctx":"conn63","msg":"startCommand","attr":{"request":"RemoteCommand 3610 -- target:[mongod3.internal:27017] db:ClinicalTrials cmd:{ aggregate: \"drug_data\", pipeline: [ { $searchMeta: { mongotQuery: { index: \"drugs\", facet: { operator: { exists: { path: \"id\" } }, facets: { manufacturers: { type: \"string\", path: \"openfda.manufacturer_name\", numBuckets: 10 }, routes: { type: \"string\", path: \"openfda.route\", numBuckets: 10 } } } }, metadataMergeProtocolVersion: 1, limit: 0, sortSpec: { $searchScore: -1 } } } ], cursor: { batchSize: 101 }, let: { NOW: { $literal: new Date(1706138202749) }, CLUSTER_TIME: { $literal: Timestamp(1706138199, 1) } }, fromMongos: true, readConcern: { level: \"local\", provenance: \"implicitDefault\" }, writeConcern: { w: \"majority\", wtimeout: 0, provenance: \"implicitDefault\" }, shardVersion: { e: ObjectId('000000000000000000000000'), t: Timestamp(0, 0), v: Timestamp(0, 0) }, databaseVersion: { uuid: UUID(\"d802bb99-99e8-459c-9cbe-f2f0022b87ba\"), timestamp: Timestamp(1706136857, 2), lastMod: 1 }, clientOperationKey: UUID(\"b007cb63-4766-4610-ad39-7581861db2b5\"), lsid: { id: UUID(\"b3530e27-f57f-47a4-8fc0-04a7cc551bed\"), uid: BinData(0, A009A5C38A39FA832F5D8E5FA067A58CC80A0E8F29A0F501773556AC0B1B33AD) } }"}} The relevant part of this line, post-formatting, is: { pipeline: [ { $searchMeta: { mongotQuery: { index: "drugs", facet: { operator: { exists: { path: "id" } }, facets: { manufacturers: { type: "string", path: "openfda.manufacturer_name", numBuckets: 10 }, routes: { type: "string", path: "openfda.route", numBuckets: 10 } } } }, metadataMergeProtocolVersion: 1, limit: 0, sortSpec: { $searchScore: -1 } } } ] } Notice that in this pipeline, there is a "mongotQuery" object inside $searchMeta - this object should not exist. Keys+values inside this mongotQuery object should be children of the $searchMeta object. This is making it so that users are unable to use search facets on sharded clusters on version 7.2.0.
xgen-internal-githook commented on Mon, 18 Mar 2024 17:44:44 +0000: Author: {'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com', 'username': 'cswanson310'} Message: SERVER-85694 Ability to parse serialized output for $searchMeta (#18633) GitOrigin-RevId: 57e0107998c45c39dcd8b90ed97a99b326aaa5df Branch: v7.3testCopybaraCreateNewBranch https://github.com/mongodb/mongo/commit/161a61b79903e5700e98e225b7a38df1609c5be2 xgen-internal-githook commented on Thu, 8 Feb 2024 00:14:09 +0000: Author: {'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com', 'username': 'cswanson310'} Message: SERVER-85694 Ability to parse serialized output for $searchMeta (cherry picked from commit ea677d2a0a6d94b798da18dfb269f679ff67df57) Branch: v7.2 https://github.com/mongodb/mongo/commit/ddaeb72a9a1130c09ab79b4cb61634c457ceebc1 xgen-internal-githook commented on Fri, 2 Feb 2024 21:51:44 +0000: Author: {'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com', 'username': 'cswanson310'} Message: SERVER-85694 Ability to parse serialized output for $searchMeta (#18633) GitOrigin-RevId: 57e0107998c45c39dcd8b90ed97a99b326aaa5df Branch: v7.3 https://github.com/mongodb/mongo/commit/ad6e38e8d7d1ea6c7287a38a09e5744a3110243e xgen-internal-githook commented on Fri, 2 Feb 2024 17:06:28 +0000: Author: {'name': 'Charlie Swanson', 'email': 'charlie.swanson@mongodb.com', 'username': 'cswanson310'} Message: SERVER-85694 Ability to parse serialized output for $searchMeta (#18633) GitOrigin-RevId: b9e1075e2679bc029ac593afc365f5b0b0ef46bc Branch: master https://github.com/mongodb/mongo/commit/ea677d2a0a6d94b798da18dfb269f679ff67df57 JIRAUSER1265798 commented on Sat, 27 Jan 2024 00:15:13 +0000: Sending back to evan.nixon@mongodb.com as this has been out of my knowledge now.
On a sharded cluster running 7.2.0: Insert a document in collection "drug data": { id: '12345', openfda: { manufacturer_name: 'CSS Pharmacy', route: [ 'ORAL' ] } } Create a search index named "drugs" over collection "drug_data": { "name": "drugs", "mappings": { "dynamic": false, "fields": { "id": { "analyzer": "lucene.keyword", "searchAnalyzer": "lucene.keyword", "type": "string" }, "openfda": { "fields": { "manufacturer_name": [ { "type": "string" }, { "type": "token" }, { "type": "stringFacet" } ], "route": [ { "type": "string" }, { "type": "stringFacet" } ] }, "type": "document" } } } } Run a query over collection "drug_data": db.drug_data.aggregate([ { '$searchMeta': { index: 'drugs', facet: { operator: { exists: { path: 'id' } }, facets: { manufacturers: { type: 'string', path: 'openfda.manufacturer_name', numBuckets: 10 }, routes: { type: 'string', path: 'openfda.route', numBuckets: 10 } } } } } ]) Observe error message: MongoServerError: mongot returned an error :: caused by :: Query should contain either operator or collector
MongoDB Integration
Learn more about where this data comes from
Bug Scrub Advisor
Streamline upgrades with automated vendor bug scrubs
BugZero Enterprise
Wish you caught this bug sooner? Get proactive today.
