Skip to content

Early version of a CLI for uploading files to AWS S3 Glacier

License

Notifications You must be signed in to change notification settings

vevuo/glacier-upload

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

40 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

glacier-upload

A command line interface (CLI) for uploading files to Amazon S3 Glacier. Uses the Boto3 SDK.

Project state

Currently handles a single file upload either in a one large chunk or in mutiple small parts. The uploading works fine but it would be fair to consider the project in it's current state as a starting point for a full-fledged program. See TODO section for a list of possible additions.

Configuration

See the boto3 configuration section here (for the needed authentication credentials). The AWS region can be provided when using glacier-upload (-r or --region) or it can be set in the ~/.aws/config file (see the same config page).

Of course there also needs to be a suitable Glacier vault created beforehand.

Dependencies

  • boto3 (version 1.16.3 used)

Requires Python 3.6+ and uses pytest for the tests (needs to be installed if needed).

Installation

Currently can only be installed from an archive:

python -m pip install glacier-upload-master.zip

Usage

Basic usage (will upload in one chunk):

glacier-upload [file_path] [glacier_vault_name]

Giving description of what is uploaded (handy later on when downloading files)

glacier-upload -d "Description of the upload" [file_path] [glacier_vault_name]

Multipart upload (using -m flag and -s for part size in mb):

glacier-upload -m -s 8 [file_path] [glacier_vault_name]

See more details with:

glacier-upload --help

TODO

  • More tests
  • Possibility to abort a failed upload
  • Retry for failed attempts
  • Uploading multiple files (from a folder) on one go
  • Progress bar
  • Displaying the upload speed
  • ...
  • ...

About

Early version of a CLI for uploading files to AWS S3 Glacier

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages