Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Datafeed should retry failures while checking for missing data #107873

Open
jonathan-buttner opened this issue Apr 24, 2024 · 1 comment
Open
Labels
>enhancement :ml Machine learning Team:ML Meta label for the ML team

Comments

@jonathan-buttner
Copy link
Contributor

Description

When the datafeed executes, this run() method: https://github.com/elastic/elasticsearch/blob/8.12/x-pack/plugin/ml/src/main/java/org/elasticsearch/xpack/ml/datafeed/DatafeedJob.java#L354 executed. If it encounters a failure it will throw a ExtractionProblemException exception and it will be retried. However if the method checkForMissingDataIfNecessary() that immediately follows is executed and it encounters a failure, it will stop the datafeed. We should investigate whether we can retry failures that occur in checkForMissingDataIfNecessary.

@jonathan-buttner jonathan-buttner added >enhancement :ml Machine learning Team:ML Meta label for the ML team labels Apr 24, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml Machine learning Team:ML Meta label for the ML team
Projects
None yet
Development

No branches or pull requests

2 participants