How to save Cursor Object to resume later.

[Srj]

Suppose i have a cursor object like below.

tweets = tw.Cursor(api.search,
                  q = search_words,
                  lang="en",
                  since=date_since,).items(1000)

After extracting 200 tweets i will shutdown my machine and then i want to resume this operation(means extract last 800 tweets).
What is the best way to do it?
If i pickle the cursor object ( tweets in the code above), will it resume the extraction process or start over again?

[Harmon758]

If the pagination is by ID, as is the case with API.search:

tweepy/tweepy/binder.py

Lines 257 to 267 in 1a71938

	# Set pagination mode
	if 'cursor' in APIMethod.allowed_param:
	if APIMethod.payload_type == 'direct_message':
	_call.pagination_mode = 'dm_cursor'
	else:
	_call.pagination_mode = 'cursor'
	elif 'max_id' in APIMethod.allowed_param:
	if 'since_id' in APIMethod.allowed_param:
	_call.pagination_mode = 'id'
	elif 'page' in APIMethod.allowed_param:
	_call.pagination_mode = 'page'

Then the iterator you're using is an IdIterator returned by Cursor.pages:

tweepy/tweepy/cursor.py

Lines 9 to 23 in 1a71938

	class Cursor(object):
	"""Pagination helper class"""
	def __init__(self, method, *args, **kwargs):
	if hasattr(method, 'pagination_mode'):
	if method.pagination_mode == 'cursor':
	self.iterator = CursorIterator(method, *args, **kwargs)
	elif method.pagination_mode == 'dm_cursor':
	self.iterator = DMCursorIterator(method, *args, **kwargs)
	elif method.pagination_mode == 'id':
	self.iterator = IdIterator(method, *args, **kwargs)
	elif method.pagination_mode == "next":
	self.iterator = NextIterator(method, *args, **kwargs)
	elif method.pagination_mode == 'page':
	self.iterator = PageIterator(method, *args, **kwargs)

In which case, you can use the max_id attribute of the IdIterator:

tweepy/tweepy/cursor.py

Lines 116 to 120 in 1a71938

	class IdIterator(BaseIterator):
	def __init__(self, method, *args, **kwargs):
	BaseIterator.__init__(self, method, *args, **kwargs)
	self.max_id = self.kwargs.pop('max_id', None)

Alternatively, you can just use the ID of the last Tweet you previously processed and use it for the max_id parameter for API.search.