High memory usage for verify --delete
due to deletion occurring at end
#1283
Labels
verify --delete
due to deletion occurring at end
#1283
I had a PyPI mirror that hadn't ever had a run of
verify --delete
, so had grown to around 25 TB. Initially trying to runverify --delete
was exhausting all of my machine's memory. It only had 8 GB of RAM, but still, the algorithm should be able to delete during the run (and therefore using a relatively constant amount of memory regardless of the number of deletions needed) rather than building a list in memory and deleting everything at the end.I was able to get
verify --delete
to finish with 64 GB of RAM, but I don't know how much memory it actually needed. Now the PyPI mirror is somewhere less than 9.5 TB.The text was updated successfully, but these errors were encountered: