Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

harvest job shows gather errors from previous run #506

Open
sabinem opened this issue Jun 10, 2022 · 0 comments
Open

harvest job shows gather errors from previous run #506

sabinem opened this issue Jun 10, 2022 · 0 comments

Comments

@sabinem
Copy link

sabinem commented Jun 10, 2022

CKAN Version 2.8.10,
ckanext-harvest version v1.4.0

I have the following problem with my harvesters:

  • when I run it on a harvest source url that does not exist, I get a gather error which is correct
  • after that I fix the url and rerun the harvester: it still shows the same errors in the job log panel

The previous errors are created at this call:

publisher.send({'harvest_job_id': job['id']})

Before the call the harvester job is there, but it does not have any errors.
After the call the errors have been stored for the harvester, despite the fact that the gather method of the harvester has not even started yet.

This happened both for the run_test paster command but also when I start the harvester via the WebUI.

I suspect that it has something to do with redis. Is there any hint on what might cause the problem and how to prevent it?

@sabinem sabinem changed the title harvest job shows gather errors from previous runs harvest job shows gather errors from previous run Jun 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant