Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pushing image to self-hosted Harbor fails with unknown blob and unauthorized: authentication required errors #18611

Closed
SinguJ opened this issue Apr 27, 2023 · 6 comments

Comments

@SinguJ
Copy link

SinguJ commented Apr 27, 2023

I've created a self-hosted Harbor instance and set up a project named test. I encountered an issue when trying to push images from my local computer (Windows) using WSL (Ubuntu):

When I try to run docker push my.harbor.com/test/example:v1, I get the following output:

root@MyPC:/mnt/c/Users/person# docker push my.harbor.com/test/example:v1
The push refers to repository [my.harbor.com/test/example]
8e5669d83291: Pushing [==================================================>]  3.584kB
9975392591f2: Pushing  2.048kB
529cdb636f61: Pushing [==================================================>]  27.75MB/27.75MB
4b8e2801e0f9: Pushing [==================================================>]  4.238MB/4.238MB
9b24afeb7c2f: Pushing [==================================================>]  338.4kB
2edcec3590a4: Waiting
unknown blob

However, when I try to run docker push my.harbor.com/test/path/example:v1, I get this output:

root@MyPC:/mnt/c/Users/person# docker push my.harbor.com/test/path/example:v1
The push refers to repository [my.harbor.com/test/path/example]
8e5669d83291: Pushing [==================================================>]  3.584kB
9975392591f2: Pushing  2.048kB
529cdb636f61: Pushing [==================================================>]  27.75MB/27.75MB
4b8e2801e0f9: Pushing [==================================================>]  4.238MB/4.238MB
9b24afeb7c2f: Pushing [==================================================>]  338.4kB
2edcec3590a4: Waiting
unauthorized: authentication required

I logged in with the admin account, and I can confirm that I was successfully authenticated. The token's validity period is 30 minutes, so it has not expired. This issue is consistently reproducible, as the error always occurs when the Pushing step is completed, regardless of how many times I try.

Additionally, I set up two layers of Nginx forwarding in front of Harbor, using a self-signed SSL certificate (which I've already trusted on my local computer). I've also configured AWS S3 storage for Harbor.

@SinguJ
Copy link
Author

SinguJ commented Apr 27, 2023

Oh, by the way, I have read some previous issues and removed all proxy_set_header X-Forwarded-Proto $scheme from the built-in Nginx in Harbor, but it still doesn't work. My Harbor version is v2.7.2.

@MinerYang
Copy link
Contributor

How did you deploy your harbor instance? Is it via offline-installer or harbor-helm?
for the blob_unknown issue is it occurred randomly or specific to this my.harbor.com/test/example:v1 images?
Also could you please provide the harbor-core and harbor-registry log for more details?

@SinguJ
Copy link
Author

SinguJ commented Apr 27, 2023

How did you deploy your harbor instance? Is it via offline-installer or harbor-helm? for the blob_unknown issue is it occurred randomly or specific to this my.harbor.com/test/example:v1 images? Also could you please provide the harbor-core and harbor-registry log for more details?

Yes, I can consistently reproduce it. I'm using an offline-installer. Below is the output of docker logs --tail 50 -f registry, but I didn't see any output from harbor-core.

192.168.0.8 - - [27/Apr/2023:09:44:04 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"
time="2023-04-27T09:44:07.529842215Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=7cfa3d3c-ac96-47c3-99ba-77105411ff4a http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:07.578209627Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=fa3be6de-0ee0-4230-825b-715cada41971 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:07.586937423Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=e9c88066-3a5e-457b-9cfc-b8aba74605b5 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:07.593406682Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6ebb3cd7-d0aa-4cac-ac96-bce404c8fe6f http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:07.597247252Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=c8c65e48-ffe6-46f6-9847-cb2aba333086 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:07.635014023Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=7cfa3d3c-ac96-47c3-99ba-77105411ff4a http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=113.197415ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:07.680924795Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=c8c65e48-ffe6-46f6-9847-cb2aba333086 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=87.380727ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:07.689263054Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=e9c88066-3a5e-457b-9cfc-b8aba74605b5 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=109.399189ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:07.692727819Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6ebb3cd7-d0aa-4cac-ac96-bce404c8fe6f http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=103.549513ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:07.696005521Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=fa3be6de-0ee0-4230-825b-715cada41971 http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=127.469725ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:07.861597292Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=842d3f61-e23d-4c95-b8f2-151243c7774a http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=lD6E5b0Fpdsc6pK-glV0xLqvU7yLmSGvd5w4JgmjU3x7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41MzM3Mjg3M1oifQ%3D%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=f6f1d878-0f96-44b3-a0eb-747400131359 
time="2023-04-27T09:44:07.921406213Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d2636e0f-ce4f-4aea-967b-e6a47e51855f http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=mlpWQoLrTHh1f6TLdOW48ScOM8E1yUgxtF8kYyFqb-F7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy42MDIwNDU0NTlaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=48662633-5c56-4582-aa67-6ba68b8b49fb 
time="2023-04-27T09:44:07.929334159Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6845bfd4-037f-4a25-9e92-f536ada4e38d http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=kh4d6Wq_mKDCqQPM9W299upm8DeTJC0-7SXq0YKbVf57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTk2MjM2NDZaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=6585cd86-7a51-40cb-a976-d0289d120817 
time="2023-04-27T09:44:07.985661502Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=842d3f61-e23d-4c95-b8f2-151243c7774a http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=lD6E5b0Fpdsc6pK-glV0xLqvU7yLmSGvd5w4JgmjU3x7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41MzM3Mjg3M1oifQ%3D%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=128.369828ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "PATCH /v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=lD6E5b0Fpdsc6pK-glV0xLqvU7yLmSGvd5w4JgmjU3x7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41MzM3Mjg3M1oifQ%3D%3D HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:08.049455252Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d2636e0f-ce4f-4aea-967b-e6a47e51855f http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=mlpWQoLrTHh1f6TLdOW48ScOM8E1yUgxtF8kYyFqb-F7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy42MDIwNDU0NTlaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=134.466832ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "PATCH /v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=mlpWQoLrTHh1f6TLdOW48ScOM8E1yUgxtF8kYyFqb-F7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy42MDIwNDU0NTlaIn0%3D HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:08.065747881Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6845bfd4-037f-4a25-9e92-f536ada4e38d http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=kh4d6Wq_mKDCqQPM9W299upm8DeTJC0-7SXq0YKbVf57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTk2MjM2NDZaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=142.611467ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:07 +0000] "PATCH /v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=kh4d6Wq_mKDCqQPM9W299upm8DeTJC0-7SXq0YKbVf57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTk2MjM2NDZaIn0%3D HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:08.371316894Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=b42e8a2f-7552-4106-baf2-52907905a311 http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=906c5GhGEATM8D1zUEUlqu8inwplc6wzX6okWnBRb3Z7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6NDA5LCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=f6f1d878-0f96-44b3-a0eb-747400131359 
time="2023-04-27T09:44:08.523233815Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6dd8b593-6bb2-40ab-a4e4-d4412acae37f http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=C6a88FS8fbM4kbcGNWpxfiIDMXAm76VoMAsnikgeAFJ7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MTMzLCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=6585cd86-7a51-40cb-a976-d0289d120817 
time="2023-04-27T09:44:08.528929631Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=f5adcba1-1e50-488f-9c41-af9fe9ca367e http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=GgAquGSC4ZkSBX1HnH285ebPOPRkLJ10PxBl3zwfXPR7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MTczMywiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3Ac7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=48662633-5c56-4582-aa67-6ba68b8b49fb 
time="2023-04-27T09:44:08.714817801Z" level=info msg="redis: connect redis:6379" go.version=go1.19.8 instance.id=0b3597fb-bbd3-4a4f-8b4b-18c746e170ad redis.connect.duration=1.302918ms service=registry version=v2.8.0.m 
time="2023-04-27T09:44:08.716512888Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=b42e8a2f-7552-4106-baf2-52907905a311 http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=906c5GhGEATM8D1zUEUlqu8inwplc6wzX6okWnBRb3Z7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6NDA5LCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=349.622617ms http.response.status=201 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:08 +0000] "PUT /v2/test/example/blobs/uploads/f6f1d878-0f96-44b3-a0eb-747400131359?_state=906c5GhGEATM8D1zUEUlqu8inwplc6wzX6okWnBRb3Z7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6ImY2ZjFkODc4LTBmOTYtNDRiMy1hMGViLTc0NzQwMDEzMTM1OSIsIk9mZnNldCI6NDA5LCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7 HTTP/1.1" 201 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:08.840629289Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=f5adcba1-1e50-488f-9c41-af9fe9ca367e http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=GgAquGSC4ZkSBX1HnH285ebPOPRkLJ10PxBl3zwfXPR7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MTczMywiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3Ac7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=315.62475ms http.response.status=201 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:08 +0000] "PUT /v2/test/example/blobs/uploads/48662633-5c56-4582-aa67-6ba68b8b49fb?_state=GgAquGSC4ZkSBX1HnH285ebPOPRkLJ10PxBl3zwfXPR7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjQ4NjYyNjMzLTVjNTYtNDU4Mi1hYTY3LTZiYTY4YjhiNDlmYiIsIk9mZnNldCI6MTczMywiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3Ac7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc HTTP/1.1" 201 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:08.863421115Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=6dd8b593-6bb2-40ab-a4e4-d4412acae37f http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=C6a88FS8fbM4kbcGNWpxfiIDMXAm76VoMAsnikgeAFJ7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MTMzLCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=345.962463ms http.response.status=201 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:08 +0000] "PUT /v2/test/example/blobs/uploads/6585cd86-7a51-40cb-a976-d0289d120817?_state=C6a88FS8fbM4kbcGNWpxfiIDMXAm76VoMAsnikgeAFJ7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjY1ODVjZDg2LTdhNTEtNDBjYi1hOTc2LWQwMjg5ZDEyMDgxNyIsIk9mZnNldCI6MTMzLCJTdGFydGVkQXQiOiIyMDIzLTA0LTI3VDA5OjQ0OjA3WiJ9&digest=sha256%3A413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c HTTP/1.1" 201 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:09.260690403Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=c93cbeee-9147-4666-9c4f-a7fe86d28626 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.digest="sha256:1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7" vars.name="test/example" 
192.168.0.8 - - [27/Apr/2023:09:44:09 +0000] "HEAD /v2/test/example/blobs/sha256:1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7 HTTP/1.1" 307 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:09.266952417Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=c93cbeee-9147-4666-9c4f-a7fe86d28626 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:1abfd3011519f249f36031faf78923801bc3c5419d71287adbae1c999ed4c3c7" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=14.873944ms http.response.status=307 http.response.written=0 
time="2023-04-27T09:44:09.478379569Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=7278ab1f-e7cc-44c1-8892-cf5d8732c96d http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:c7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.digest="sha256:c7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc" vars.name="test/example" 
time="2023-04-27T09:44:09.484502649Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=7278ab1f-e7cc-44c1-8892-cf5d8732c96d http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:c7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=11.541789ms http.response.status=307 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:09 +0000] "HEAD /v2/test/example/blobs/sha256:c7a4e438200131dd0653eec624ffe4969dba13e7b0ebcea90753a492d63e1ebc HTTP/1.1" 307 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:09.493976329Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=92934c9e-e8e0-448f-bb3e-37313f591794 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.digest="sha256:413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c" vars.name="test/example" 
time="2023-04-27T09:44:09.499429759Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=92934c9e-e8e0-448f-bb3e-37313f591794 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=12.188723ms http.response.status=307 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:09 +0000] "HEAD /v2/test/example/blobs/sha256:413c8bb60be23f9acacb3fa85f29bd4b7edc25731cbeeaf75f1403b7bb87585c HTTP/1.1" 307 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:10.089259257Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d2d3a836-37cd-4909-a286-f6a4a32ef242 http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=AL9xBSLt77J_gzOfIVmnOouhkaJmQ-__tLMaJpuOEh57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTc3MDc0OTlaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=0b80044b-980e-4d18-8c64-be52cbc004db 
time="2023-04-27T09:44:10.19218368Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d3e867a0-a613-4f5c-8e36-11700c54aaed http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" 
time="2023-04-27T09:44:10.259658626Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d3e867a0-a613-4f5c-8e36-11700c54aaed http.request.method=POST http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=71.354173ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:10 +0000] "POST /v2/test/example/blobs/uploads/ HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:10.321360648Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=d2d3a836-37cd-4909-a286-f6a4a32ef242 http.request.method=PATCH http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=AL9xBSLt77J_gzOfIVmnOouhkaJmQ-__tLMaJpuOEh57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTc3MDc0OTlaIn0%3D" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=237.927467ms http.response.status=202 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:10 +0000] "PATCH /v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=AL9xBSLt77J_gzOfIVmnOouhkaJmQ-__tLMaJpuOEh57Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowNy41OTc3MDc0OTlaIn0%3D HTTP/1.1" 202 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:10.550017377Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=a76123c9-504d-4073-adae-6d14999084f0 http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=HQ8NnwHvvBjGseIoTl5bHZogLPwtUEauE8swKLTn_IV7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MTQ0MjM0NiwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3A4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.name="test/example" vars.uuid=0b80044b-980e-4d18-8c64-be52cbc004db 
time="2023-04-27T09:44:10.851155672Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=a76123c9-504d-4073-adae-6d14999084f0 http.request.method=PUT http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=HQ8NnwHvvBjGseIoTl5bHZogLPwtUEauE8swKLTn_IV7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MTQ0MjM0NiwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3A4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.duration=305.485596ms http.response.status=201 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:10 +0000] "PUT /v2/test/example/blobs/uploads/0b80044b-980e-4d18-8c64-be52cbc004db?_state=HQ8NnwHvvBjGseIoTl5bHZogLPwtUEauE8swKLTn_IV7Ik5hbWUiOiJ0ZXN0L3JlZGlzIiwiVVVJRCI6IjBiODAwNDRiLTk4MGUtNGQxOC04YzY0LWJlNTJjYmMwMDRkYiIsIk9mZnNldCI6MTQ0MjM0NiwiU3RhcnRlZEF0IjoiMjAyMy0wNC0yN1QwOTo0NDowN1oifQ%3D%3D&digest=sha256%3A4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa HTTP/1.1" 201 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
time="2023-04-27T09:44:11.07277916Z" level=info msg="authorized request" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=545152c0-06b5-48e2-b0cc-a0503e6630d7 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" vars.digest="sha256:4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa" vars.name="test/example" 
time="2023-04-27T09:44:11.075772393Z" level=info msg="response completed" go.version=go1.19.8 http.request.host=my.harbor.com http.request.id=545152c0-06b5-48e2-b0cc-a0503e6630d7 http.request.method=HEAD http.request.remoteaddr=10.0.0.48 http.request.uri="/v2/test/example/blobs/sha256:4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa" http.request.useragent="docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \(linux\))" http.response.contenttype="application/octet-stream" http.response.duration=7.195986ms http.response.status=307 http.response.written=0 
192.168.0.8 - - [27/Apr/2023:09:44:11 +0000] "HEAD /v2/test/example/blobs/sha256:4044b9ba67c9376f8a6431064d2d4c5e11178af52db9a0a16e46c0f9dbcf12aa HTTP/1.1" 307 0 "" "docker/23.0.1 go/go1.19.5 git-commit/bc3805a kernel/5.15.90.1-microsoft-standard-WSL2 os/linux arch/amd64 UpstreamClient(Docker-Client/23.0.1 \\(linux\\))"
127.0.0.1 - - [27/Apr/2023:09:44:14 +0000] "GET / HTTP/1.1" 200 0 "" "curl/8.0.1"
192.168.0.8 - - [27/Apr/2023:09:44:14 +0000] "GET / HTTP/1.1" 200 0 "" "Go-http-client/1.1"

@SinguJ
Copy link
Author

SinguJ commented Apr 27, 2023

How did you deploy your harbor instance? Is it via offline-installer or harbor-helm? for the blob_unknown issue is it occurred randomly or specific to this my.harbor.com/test/example:v1 images? Also could you please provide the harbor-core and harbor-registry log for more details?

I have tried other images and encountered similar issues. For example, when pushing my.harbor.com/test/ubuntu, the following error occurs:

root@MyPC:/mnt/c/Users/person# docker push my.harbor.com/test/ubuntu:latest
The push refers to repository [my.harbor.com/test/ubuntu:latest]
b93c1bd012ab: Pushing [==================================================>]  80.33MB
error parsing HTTP 403 response body: invalid character '<' looking for beginning of value: "<html>\r\n<head><title>403 Forbidden</title></head>\r\n<body>\r\n<center><h1>403 Forbidden</h1></center>\r\n<hr><center>openresty/1.21.4.1</center>\r\n</body>\r\n</html>\r\n"

Interestingly, all of these errors occur after the Pushing process has completed, and the error messages remain the same regardless of how many times the same image is repeated.

@MinerYang
Copy link
Contributor

As you mentioned set up two layers of Nginx forwarding in front of Harbor, you need to make sure the header will access through the registry eventually.
I am afraid you need to figure out yourself.

@SinguJ
Copy link
Author

SinguJ commented May 29, 2023

I've solved my issue, which was due to two misconfigurations.

For the unknown blob error after executing docker push

If, like me, you're using multiple layers of Nginx proxies, you should follow these steps:

  1. Open the common/config/registry/config.yml file with the vi editor, where the common directory is relative to the harbor.yml file's location.
sudo vi common/config/registry/config.yml
  1. In the config.yml file, locate the http block and modify it as follows:
http:
  # Add the following line
  relativeurls: true
  1. Restart the Harbor service.
sudo docker compose restart
# Or
sudo docker-compose restart

Note: You should do this every time after you run the install.sh script, as install.sh will overwrite all files under the common directory.

For more information on this, please refer to: harbor.yml option for registry http.relativeurls / back-port fix for "unknown blob" issue from helm-chart to photon #12135

For the unauthorized: authentication required error after executing docker push

Firstly, are you using S3 as your storage backend? If not, this solution might not solve your problem. If you are, you should proceed as follows:

  1. Modify the harbor.yml file, find the storage_service block, and modify it as follows:
storage_service:
  # Add or modify the following line
  redirect:
    disable: true
  1. Run ./install.sh to restart the Harbor service.

This issue occurs because Harbor, by default, redirects clients to the backend S3 storage, which is private and thus inaccessible to clients.

For more information on this, please refer to: Configure a registry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants