Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delta lake ingestion failed (can't parse the string value 0E-18 to decimal) #10418

Open
alplatonov opened this issue May 2, 2024 · 0 comments
Labels
bug Bug report

Comments

@alplatonov
Copy link
Contributor

Describe the bug
When attempting to read or interact with a Delta table that contains a decimal datatype column with a value of 0, operations fail.
The error is "Exception: Parser error: can't parse the string value 0E-18 to decimal."
This issue prevents any interaction with tables that include such decimal values.

To Reproduce
Steps to reproduce the behaviour:

  1. Create a table in delta lake format with field decimal(38,18)
  2. try to read and see the error

Expected behaviour
The expectation is to be able to read from and interact with Delta tables regardless of the presence of decimal columns with a value of 0.

Screenshots

Additional context
pip freeze - pip.txt
data created with spark 3.4.2 and delta lake version 2.4.0

@alplatonov alplatonov added the bug Bug report label May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report
Projects
None yet
Development

No branches or pull requests

1 participant