Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exception occurs when more threads are used than documents exists #466

Open
dr0i opened this issue Sep 16, 2022 · 0 comments
Open

Exception occurs when more threads are used than documents exists #466

dr0i opened this issue Sep 16, 2022 · 0 comments
Assignees

Comments

@dr0i
Copy link
Member

dr0i commented Sep 16, 2022

Reported at hbz/lobid-resources#1030 (comment):

When more threads are used than documents exists a NullPointerException occurs.

When calling closeStream(), a NullPointerException appears. This stops the ETL process finishing correctly and results in loss of processed documents.
A workaround is to catch the Exception.
However, as this is a problem can occur everywhere, it would be nicer to somehow control this probably at the ObjectPipeDecoupler.
Also, to say the least, it's rather unexpected to use more threads than documents, it may happen.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Metafacture alt
Awaiting triage
Development

No branches or pull requests

1 participant