Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Path does not exist: file:/data/sphynx/unordered/45ac5157-4de8-315f-829d-c016847e719d #388

Open
darabos opened this issue Apr 14, 2023 · 0 comments

Comments

@darabos
Copy link
Contributor

darabos commented Apr 14, 2023

There is a failure mode where a Sphynx operation completes "successfully" but doesn't generate the expected output. When we try to relocate it to Spark, it's not there, and SparkDomain.relocateFrom fails. This is bad for multiple reasons:

  • The error is not fit for users.
  • You can't retry the operation. It succeeded already! You can retry the relocation, but of course it will always fail.
  • The logs don't help in finding the problem.

I think the solution is to add an assertion in Sphynx operations to make sure the outputs are there. Don't report the operation as a success before this check.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant