Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SchemaMismatchError: Schema error: Cannot merge types long and double #2464

Open
Amar1404 opened this issue Apr 30, 2024 · 2 comments
Open
Labels
enhancement New feature or request

Comments

@Amar1404
Copy link

Amar1404 commented Apr 30, 2024

Environment

**Delta-rs version **: 0.17.2

**Binding **: Python

Environment:

  • Cloud provider: AWS
  • OS:
  • Other:

Bug

What happened:
Why doing write_to_deltalake(path,df,schema='merge', mode='append',engine='rust', partition_by=['date']) the df is not able to convert the schema of the table from long to double

What you expected to happen:
To Convert the evolution of schema
How to reproduce it:
Create a table with existing field contain int
change the field value to double
More details:

@Amar1404 Amar1404 added the bug Something isn't working label Apr 30, 2024
@Amar1404 Amar1404 changed the title SchemaMismatchError: Schema error: Cannot merge types long and double Schema error: Cannot merge types long and double SchemaMismatchError: Schema error: Cannot merge types long and double Apr 30, 2024
@ion-elgreco ion-elgreco added enhancement New feature or request and removed bug Something isn't working labels Apr 30, 2024
@ion-elgreco
Copy link
Collaborator

@ion-elgreco this isn't a bug, we don't allow type expansion yet.

@ihawn
Copy link

ihawn commented May 15, 2024

Is this on the roadmap?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants