Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

provider-storj: Getting error 'not found' for every uploaded file #521

Open
anaschaudhary33 opened this issue Dec 28, 2022 · 14 comments
Open
Assignees
Labels
bug docker docker related issue storage provider issue related to a specific storage backend

Comments

@anaschaudhary33
Copy link

I have setup storj as provider. I can successfully upload the file, (I can verify the uploaded file in the storj bucket) but when I open the output url it giving me error 'Not found'.
Log

 [transfer.sh]2022/12/28 06:16:09 Error metadata: EOF
 [transfer.sh]2022/12/28 06:16:08 Getting file 62bc21edb1deb.mp4.metadata from Storj Bucket
[transfer.sh]2022/12/28 06:16:04 47.31.141.30:0 - - [2022-12-28T06:16:04Z] "PUT /62bc21edb1deb.mp4 HTTP/1.1" 200  "https://*******.sh/"; "Mozilla/5.0 (Android 11; Mobile; rv:108.0) Gecko/108.0 Firefox/108.0"
 [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4 to Storj Bucket
 [transfer.sh]2022/12/28 06:15:51 Uploading Bdm5IY 62bc21edb1deb.mp4 11009799 
 [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4.metadata to Storj Bucket
@stefanbenten
Copy link
Collaborator

Could it be that your access grant does not allow list/download/deletes?
Did you try listing the bucket and downloading the file using the same access grant?

@stefanbenten stefanbenten self-assigned this Dec 28, 2022
@anaschaudhary33
Copy link
Author

I have recheck(using uplink cli) that the access grant is able to list+download+delete.
I have also changed the access grant after verifying it's able to list+download+delete, but the error remains same.

@stefanbenten
Copy link
Collaborator

Do you see both files in the bucket?
There should be the raw file and the .metadata file. The above suggests, that the metadata file isnt there. @anaschaudhary33

@anaschaudhary33
Copy link
Author

Both filename and filename.metadata are present in the storj bucket.

@stefanbenten
Copy link
Collaborator

Would you mind sharing the setup details (without the secrets of course)? Command line arguments would help to double check.
I just setup a test instance and it works as expected..

@anaschaudhary33
Copy link
Author

I have deployed docker image through northflank.com.

  1. Setup deployment source as dutchcoders/transfer.sh:latest.
  2. Setup runtime variables $PROVIDER $STORJ_ACCESS and $STORJ_BUCKET
  3. Runtime command is /go/bin/transfersh --listener :8080
  4. expose port 8080 to public

@anaschaudhary33
Copy link
Author

anaschaudhary33 commented Jan 5, 2023

Tried similar setup with fly.io but no luck.

@dillfrescott
Copy link

Same error for me using storj

@dillfrescott
Copy link

Both the file and the metadata file are in the bucket too

@dillfrescott
Copy link

Ok it has to do with the docker version. I ran it from the binary and it works fine...

@stefanbenten stefanbenten changed the title Getting error 'not found' for every uploaded file provider-storj: Getting error 'not found' for every uploaded file Jan 21, 2023
@stefanbenten stefanbenten added bug docker docker related issue storage provider issue related to a specific storage backend labels Jan 21, 2023
@aspacca
Copy link
Collaborator

aspacca commented Mar 1, 2023

@dillfrescott so we can close the issue, do we?

@stefanbenten
Copy link
Collaborator

Lemme troubleshoot it when i get some spare cycles. I cannot see why docker would do something different..

@aspacca
Copy link
Collaborator

aspacca commented Mar 10, 2023

@dillfrescott , @stefanbenten I had the same problem while testing #535

see my comment at #535 (comment)

I will try to reproduce with docker before and after #535 being merged

@dillfrescott
Copy link

Okay

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug docker docker related issue storage provider issue related to a specific storage backend
Projects
None yet
Development

No branches or pull requests

4 participants