If you use multiple mongos servers in a sharded cluster, be cautious upgrading to PyMongo 3. We’ve just discovered a critical bug related to our new mongos load-balancing feature.

Update: PyMongo 3.0.1 was released April 21, 2015 with fixes for this and other bugs.

If you create a MongoClient instance with PyMongo 3 and pass the addresses of several mongos servers, like so:

client = MongoClient('mongodb://mongos1,mongos2')

…then the client load-balances among the lowest-latency of them. Read the load-balancing documentation for details. This works correctly except when retrieving more than 101 documents, or more than 4MB of data, from a cursor:

collection = client.db.collection
for document in collection.find():
    # … do something with each document …

PyMongo wrongly tries to get subsequent batches of documents from random mongos servers, instead of streaming results from the same server it chose for the initial query. The symptom is an OperationFailure with a server error message, “could not find cursor in cache”:

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/pymongo/cursor.py", line 968, in next
        if len(self.data) or self._refresh():
  File "/usr/local/lib/python2.7/dist-packages/pymongo/cursor.py", line 922, in _refresh
  File "/usr/local/lib/python2.7/dist-packages/pymongo/cursor.py", line 838, in send_message
  File "/usr/local/lib/python2.7/dist-packages/pymongo/helpers.py", line 110, in _unpack_response
pymongo.errors.CursorNotFound: cursor id '1025112076089406867' not valid at server