Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use gcs with s3-compatible interface: commit error 411 Length Required #2394

Open
xxhZs opened this issue Apr 7, 2024 · 0 comments
Open
Labels
binding/rust Issues for the Rust crate bug Something isn't working storage/aws AWS S3 storage related

Comments

@xxhZs
Copy link

xxhZs commented Apr 7, 2024

Environment

Delta-rs version:

Binding:

Environment:

  • Cloud provider:
  • OS:
  • Other:

Bug

What happened:
I use s3-compatible interface gcs

such as:
url = 's3a://bucket/folder',
endpoint = 'https://storage.googleapis.com',
access.key = 'xxx',
secret.key = 'xxx'

We can write the data, but the commit reports an error.

72,2024-04-03T23:43:59.364971003Z,""", after 0 retries: HTTP status client error (411 Length Required) for url (https://storage.googleapis.com/**********/00000000000000000001.json)"
73,2024-04-03T23:43:59.364963133Z,

POST requests require a Content-length header. That’s all we know.
74,2024-04-03T23:43:59.364956416Z,

411. That’s an error.
75,2024-04-03T23:43:59.364950438Z,
76,2024-04-03T23:43:59.364942815Z, </style>
77,2024-04-03T23:43:59.364906Z," {margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px} > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}"
78,2024-04-03T23:43:59.364893291Z, <style>
79,2024-04-03T23:43:59.364883343Z, <title>Error 411 (Length Required)!!1</title>
80,2024-04-03T23:43:59.364877121Z," <meta name=viewport content=""initial-scale=1, minimum-scale=1, width=device-width"">"
81,2024-04-03T23:43:59.364871025Z,
82,2024-04-03T23:43:59.364862227Z,

What you expected to happen:

How to reproduce it:

More details:

@xxhZs xxhZs added the bug Something isn't working label Apr 7, 2024
@rtyler rtyler added binding/rust Issues for the Rust crate storage/aws AWS S3 storage related labels May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/rust Issues for the Rust crate bug Something isn't working storage/aws AWS S3 storage related
Projects
None yet
Development

No branches or pull requests

2 participants