Bug: Deleted items re-appear if they are in the indexing queue

[235]

Describe the bug

Deleted items re-appear with a newer date when their indexing has commenced. Likely cause - the deleted items were sitting in the indexer queue, and deletion in the list did not renew the indexing queue.

Steps to reproduce

1. Import a set of URLS (~200 in my case)
2. Delete some items, as they are being retrieved
3. If a deleted item has not been indexed yet - it will re-appear with a newer date when indexer will get to it in the queue

ArchiveBox version

v0.7.1.

This bug could be related, as I've independently from this problem observed it on the latest version: #433

[pirate]

Ah yeah unfortunately this is a known bug. It's exactly as you guessed, the deleted items are not cleared from the import queue when deleted via the UI.

As a workaround I recommend tagging them with a tag to-delete instead, and then after the import completes you can filter for that tag and delete all the Snapshots that show up.

This should be fixed in the process of my upcoming refactor that moves us to a real job queue system https://github.com/gaiacoop/django-huey.