Exiting due to uncaught exception <class 'MemoryError'>

[alchimista]

Running category_redirect.py on toolforge, with python3, i'm getting the following traceback:
File "/data/project/shared/pywikibot/stable/scripts/category_redirect.py", line 526, in
main()
File "/data/project/shared/pywikibot/stable/scripts/category_redirect.py", line 522, in main
bot.run()
File "/data/project/shared/pywikibot/stable/scripts/category_redirect.py", line 495, in run
self.log_page.save(comment)
File "/shared/pywikipedia/core/pywikibot/tools/init.py", line 1449, in wrapper

File "/shared/pywikipedia/core/pywikibot/tools/init.py", line 1449, in wrapper

File "/shared/pywikipedia/core/pywikibot/page/init.py", line 1299, in save
if not force and not self.botMayEdit():
File "/shared/pywikipedia/core/pywikibot/page/init.py", line 1158, in botMayEdit
templates = self.templatesWithParams()
File "/shared/pywikipedia/core/pywikibot/tools/init.py", line 1449, in wrapper

File "/shared/pywikipedia/core/pywikibot/page/init.py", line 2360, in templatesWithParams
templates = self.raw_extracted_templates
File "/shared/pywikipedia/core/pywikibot/page/init.py", line 2335, in raw_extracted_templates
self.text, True, True)
File "/shared/pywikipedia/core/pywikibot/textlib.py", line 1657, in extract_templates_and_params
return extract_templates_and_params_mwpfh(text, strip)
File "/shared/pywikipedia/core/pywikibot/textlib.py", line 1675, in extract_templates_and_params_mwpfh
code = mwparserfromhell.parse(text)
File "/shared/pywikipedia/core/mwparserfromhell/utils.py", line 58, in parse_anything
return Parser().parse(value, context, skip_style_tags)
File "/shared/pywikipedia/core/mwparserfromhell/parser/init.py", line 93, in parse
tokens = self._tokenizer.tokenize(text, context, skip_style_tags)
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 1459, in tokenize
tokens = self._parse(context)
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 1337, in _parse
self._parse_wikilink()
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 328, in _parse_wikilink
link, extra, delta = self._really_parse_external_link(True)
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 453, in _really_parse_external_link
self._parse_bracketed_uri_scheme()
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 387, in _parse_bracketed_uri_scheme
self._fail_route()
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 162, in _fail_route
self._memoize_bad_route()
File "/shared/pywikipedia/core/mwparserfromhell/parser/tokenizer.py", line 153, in _memoize_bad_route
self._bad_routes.add(self._stack_ident)
MemoryError
CRITICAL: Exiting due to uncaught exception <class 'MemoryError'>

Seems to be related (if not duplicated) of #248 and #247.

[legoktm]

A memory error means you've run out of memory. Try increasing the amount of memory allocated to your job on Toolforge and see if that makes a difference.

[ghost]

Contributions toward fixing #209 would also help with memory issues!

[alchimista]

@legoktm i've tried that prior to this bug, and even with 750 Mb allocated it still occasionally runs out of memory. Somehow it became memory eager.

[legoktm]

I'd suggest allocating more memory than that, normally I try around 2G.