Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

InvalidSignatureException during upload of a large file #134

Open
rmallah opened this issue Oct 16, 2017 · 1 comment
Open

InvalidSignatureException during upload of a large file #134

rmallah opened this issue Oct 16, 2017 · 1 comment
Labels
waiting_reporter_feedback

Comments

@rmallah
Copy link

rmallah commented Oct 16, 2017

Hi ,

I am using mtglacier as:
$ mtglacier --config /opt/scripts/glacier.conf --journal /opt/scripts/glacier.journal --dir /mnt/zfsbackups sync

hoping to sync the source folder /mnt/zfsbackups to remote glacier.

The upload continues for quite some time and i can see parts getting uploaded.


PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4731174912]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4747952128]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4764729344]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4781506560]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4798283776]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4815060992]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4831838208]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4848615424]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4865392640]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4882169856]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4898947072]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4915724288]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4932501504]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4966055936]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4949278720]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4982833152]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [4999610368]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5016387584]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5033164800]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5049942016]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5066719232]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5083496448]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5100273664]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5117050880]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5133828096]
PID 32627 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5150605312]
PID 32626 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5167382528]
PID 32625 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5184159744]
PID 32628 Uploaded part for ssdpool_lxd_20171014104756.full.zfsdump.gz at offset [5200936960]

how ever during the upload of one of the parts i am greeted with below error:


===REQUEST:
PUT https://glacier.us-east-1.amazonaws.com/-/vaults/ZFSBACKUPS/multipart-uploads/c5Eqs59faNnn_c1X8JnY0OXG9a5CnPV9Et86NufN2rvhPhrwUG5EWePOZzf88jrtbGWPaaM9BpUDQOsqhw9JUY-
XViwf
Authorization: AWS4-HMAC-SHA256 Credential=***REMOVED***/20171016/us-east-1/glacier/aws4_request, SignedHeaders=content-length;content-range;content-type;host;x-amz-cont
ent-sha256;x-amz-date;x-amz-glacier-version;x-amz-sha256-tree-hash, Signature=***REMOVED***
Host: glacier.us-east-1.amazonaws.com
User-Agent: mt-aws-glacier/1.120 (http://mt-aws.com/) libwww-perl/6.15
Content-Length: 16777216
Content-Range: bytes 5603590144-5620367359/*
Content-Type: application/octet-stream
X-Amz-Content-Sha256: 39aa2e8acbc66268583b3049636997b7c0789020462dc86aba2980d6f4876f17
X-Amz-Date: 20171016T041649Z
X-Amz-Glacier-Version: 2012-06-01
X-Amz-Sha256-Tree-Hash: d05b39f1e1341804ade1d8f00bebf0a95401035d281fbeb1bc6137f75a926234

===RESPONSE:
HTTP/1.1 403 Forbidden
Connection: close
Date: Mon, 16 Oct 2017 04:18:08 GMT
Content-Length: 312
Content-Type: application/json
Client-Date: Mon, 16 Oct 2017 04:18:08 GMT
Client-Peer: 54.239.30.208:443
Client-Response-Num: 1
Client-SSL-Cert-Issuer: /C=US/O=Symantec Corporation/OU=Symantec Trust Network/CN=Symantec Class 3 Secure Server CA - G4
Client-SSL-Cert-Subject: /C=US/ST=Washington/L=Seattle/O=Amazon.com, Inc./CN=glacier.us-east-1.amazonaws.com
Client-SSL-Cipher: ECDHE-RSA-AES128-SHA
Client-SSL-Socket-Class: IO::Socket::SSL
X-Amzn-RequestId: 90B6-REm1cgxLVKwBKpI0U0ymzAmV1_43kO0pVQjRvAxRdM

{"code":"InvalidSignatureException","type":"Client",
"message":"The value passed in as x-amz-content-sha256 does not 
match the computed payload hash. Computed digest: b9d66db561574792ee8f8d45e364e04974344cb74a3baa67b1ccb1d1e7d7d593 
expected hash: 39aa2e8acbc66268583b3049636997b7c0789020462dc86aba2980d6f4876f17"
}

ERROR (child 32628): Unexpected reply from remote server

EXIT on SIGCHLD (exit_code 1)

This is a relatively new installation


MT-AWS-Glacier, Copyright 2012-2014 Victor Efimov http://mt-aws.com/ Version 1.120

mt-aws-glacier version: 1.120 
Perl Version: 5.022001
Carp    1.36    /usr/share/perl/5.22/Carp.pm
Carp::Heavy     1.36    /usr/share/perl/5.22/Carp/Heavy.pm
Class::Struct   0.65    /usr/share/perl/5.22/Class/Struct.pm
Config  5.022001        /usr/lib/x86_64-linux-gnu/perl/5.22/Config.pm
Cwd     3.56    /usr/lib/x86_64-linux-gnu/perl/5.22/Cwd.pm
Digest::SHA     5.98    /usr/local/lib/x86_64-linux-gnu/perl/5.22.1/Digest/SHA.pm
Digest::base    1.16    /usr/share/perl/5.22/Digest/base.pm
DynaLoader      1.32    /usr/lib/x86_64-linux-gnu/perl/5.22/DynaLoader.pm
Encode  2.72    /usr/lib/x86_64-linux-gnu/perl/5.22/Encode.pm
Encode::Alias   2.19    /usr/lib/x86_64-linux-gnu/perl/5.22/Encode/Alias.pm
Encode::Config  2.05    /usr/lib/x86_64-linux-gnu/perl/5.22/Encode/Config.pm
Encode::Encoding        2.07    /usr/lib/x86_64-linux-gnu/perl/5.22/Encode/Encoding.pm
Errno   1.23    /usr/lib/x86_64-linux-gnu/perl/5.22/Errno.pm
Exporter        5.72    /usr/share/perl/5.22/Exporter.pm
Exporter::Heavy 5.72    /usr/share/perl/5.22/Exporter/Heavy.pm
Fcntl   1.13    /usr/lib/x86_64-linux-gnu/perl/5.22/Fcntl.pm
File::Basename  2.85    /usr/share/perl/5.22/File/Basename.pm
File::Find      1.29    /usr/share/perl/5.22/File/Find.pm
File::Path      2.09    /usr/share/perl/5.22/File/Path.pm
File::Spec      3.56    /usr/lib/x86_64-linux-gnu/perl/5.22/File/Spec.pm
File::Spec::Unix        3.56    /usr/lib/x86_64-linux-gnu/perl/5.22/File/Spec/Unix.pm
File::Temp      0.2304  /usr/share/perl/5.22/File/Temp.pm
File::stat      1.07    /usr/share/perl/5.22/File/stat.pm
FindBin 1.51    /usr/share/perl/5.22/FindBin.pm
Getopt::Long    2.45    /usr/share/perl/5.22/Getopt/Long.pm
HTTP::Date      6.02    /usr/share/perl5/HTTP/Date.pm
HTTP::Headers   6.11    /usr/share/perl5/HTTP/Headers.pm
HTTP::Message   6.11    /usr/share/perl5/HTTP/Message.pm
HTTP::Request   6.11    /usr/share/perl5/HTTP/Request.pm
HTTP::Response  6.11    /usr/share/perl5/HTTP/Response.pm
HTTP::Status    6.11    /usr/share/perl5/HTTP/Status.pm
I18N::Langinfo  0.12    /usr/lib/x86_64-linux-gnu/perl/5.22/I18N/Langinfo.pm
IO      1.35    /usr/lib/x86_64-linux-gnu/perl/5.22/IO.pm
IO::Handle      1.35    /usr/lib/x86_64-linux-gnu/perl/5.22/IO/Handle.pm
IO::Pipe        1.15    /usr/lib/x86_64-linux-gnu/perl/5.22/IO/Pipe.pm
IO::Seekable    1.1     /usr/lib/x86_64-linux-gnu/perl/5.22/IO/Seekable.pm
IO::Select      1.22    /usr/lib/x86_64-linux-gnu/perl/5.22/IO/Select.pm
JSON::XS        3.01    /usr/lib/x86_64-linux-gnu/perl5/5.22/JSON/XS.pm
LWP     6.15    /usr/share/perl5/LWP.pm
LWP::MemberMixin        undef   /usr/share/perl5/LWP/MemberMixin.pm
LWP::Protocol   6.15    /usr/share/perl5/LWP/Protocol.pm
LWP::UserAgent  6.15    /usr/share/perl5/LWP/UserAgent.pm
List::Util      1.41    /usr/lib/x86_64-linux-gnu/perl/5.22/List/Util.pm
MIME::Base64    3.15    /usr/lib/x86_64-linux-gnu/perl/5.22/MIME/Base64.pm
POSIX   1.53_01 /usr/lib/x86_64-linux-gnu/perl/5.22/POSIX.pm
PerlIO::encoding        0.21    /usr/lib/x86_64-linux-gnu/perl/5.22/PerlIO/encoding.pm
Scalar::Util    1.41    /usr/lib/x86_64-linux-gnu/perl/5.22/Scalar/Util.pm
SelectSaver     1.02    /usr/share/perl/5.22/SelectSaver.pm
Storable        2.53_01 /usr/lib/x86_64-linux-gnu/perl/5.22/Storable.pm
Symbol  1.07    /usr/share/perl/5.22/Symbol.pm
Tie::Hash       1.05    /usr/share/perl/5.22/Tie/Hash.pm
Time::Local     1.2300  /usr/share/perl/5.22/Time/Local.pm
Types::Serialiser       1.0     /usr/share/perl5/Types/Serialiser.pm
URI     1.71    /usr/share/perl5/URI.pm
URI::Escape     3.31    /usr/share/perl5/URI/Escape.pm
XSLoader        0.20    /usr/share/perl/5.22/XSLoader.pm
attributes      0.27    /usr/lib/x86_64-linux-gnu/perl/5.22/attributes.pm
base    2.22    /usr/share/perl/5.22/base.pm
bytes   1.04    /usr/share/perl/5.22/bytes.pm
common::sense   3.74    /usr/lib/x86_64-linux-gnu/perl5/5.22/common/sense.pm
constant        1.33    /usr/share/perl/5.22/constant.pm
integer 1.01    /usr/share/perl/5.22/integer.pm
lib     0.63    /usr/lib/x86_64-linux-gnu/perl/5.22/lib.pm
overload        1.26    /usr/share/perl/5.22/overload.pm
overloading     0.02    /usr/share/perl/5.22/overloading.pm
parent  0.232   /usr/share/perl/5.22/parent.pm
strict  1.09    /usr/share/perl/5.22/strict.pm
utf8    1.17    /usr/share/perl/5.22/utf8.pm
vars    1.03    /usr/share/perl/5.22/vars.pm
warnings        1.34    /usr/share/perl/5.22/warnings.pm
warnings::register      1.04    /usr/share/perl/5.22/warnings/register.pm
OK DONE

I am eager to see this useful tool working as other tools do not
provide the sync functionality.

regds
mallah.
@vsespb
Copy link
Owner

vsespb commented Oct 16, 2017

hello. pls check your hardware with memtest86 or memtester https://packages.debian.org/jessie/utils/memtester

also note similar ticket #131 where reporter tells it was network issue

@vsespb vsespb mentioned this issue Oct 18, 2017
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
waiting_reporter_feedback
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vsespb @rmallah