restic v0.6.0-rc.1

After two months of work we're proud to announce restic v0.6.0. This is the Release Candidate version. If no grave bugs occur, it will be released as the final version in a few days. This release contains many bug fixes and several improvements for the user interface, the most important changes are listed below (and also contained in the CHANGELOG.md.

Important Changes in 0.6.0

Consistent forget policy

The forget command was corrected to be more consistent in which snapshots are to be forgotten. It is possible that the new code removes more snapshots than before, so please review what would be deleted by using the --dry-run option. #957 #953

Unified repository layout

Up to now the s3 backend used a special repository layout. We've decided to unify the repository layout and implemented the default layout also for the s3 backend. For creating a new repository on s3 with the default layout, use restic -o s3.layout=default init. For further commands the option is not necessary any more, restic will automatically detect the correct layout to use. A future version will switch to the default layout for new repositories. #966 #965

Memory and time improvements for the s3 backend

We've updated the library used for accessing s3, switched to using a lower level API and added caching for some requests. This lead to a decrease in memory usage and a great speedup. In addition, we added benchmark functions for all backends, so we can track improvements over time. The Continuous Integration test service we're using (Travis) now runs the s3 backend tests not only against a Minio server, but also against the Amazon s3 live service, so we should be notified of any regressions much sooner. #962 #960 #946 #938 #883

v0.6.0-rc.1 (2017-05-25)

Full Changelog

Implemented enhancements:

• [RFC] Implement consistent backup/forget policy #953
• Temporary files not cleaned up #948
• Check for config file before requesting password #925
• use newer xattr #921
• support plink as SSH/SFTP client on Windows #818
• Handle filesystems mounted several times with --one-file-system #645
• Backend: use AttemptGet instead of Test + Get to reduce latency impact #457

Fixed bugs:

• panic: store new item in finalized index #969
• PKGBUILD broken #963
• SFTP Upload Stops and does not recover #937
• Restoring from different host saying wrong password or no key found #923
• unable to open repo: wrong password or no key found #917
• Empty lines in exclude-file result in empty snapshot #915
• Design.md: Tree section has inconsistent blob IDs #914
• Nested Backups Become Unnested #910
• one-file-system does not correctly handle sub-paths #907
• Backup fails after about 2GB #904
• restic init doesn't work anymore with REST backend #899
• device id is not saved for files #893
• [S3] [EMC-ECS] client.BucketExists: Invalid Argument #765
• Init error on windows when repo path begins with drive letter #735
• backup --one-file-system and 'nested' mount points. #702
• Incremental backups of the same (small) directory very slow #684
• error for restore: lchown operation not permitted #655
• fuse mount broken for snapshots read from stdin #621
• Restic panics on connection reset when backing up to S3 #560
• restore doesn't restore changed files #547
• panic after SIGCONT #504
• Differences b/w processed and expected values given in progress information after completion of backup may be confusing to users #486

Closed issues:

• Backup strategy (2): pull/remote/add-only #959
• backup size should not include excluded dirs #958
• [FEATURE] print state of repo #955
• sftp backends timeouts quietly #954
• Dead link to "usage" in README #950
• bash autocompletion #942
• Please provide a docker container that's empty besides a restic binary with the latest version #931
• b2 backblaze #924
• Restore all available versions of a file #906
• Cannot specify port for sftp backend #895
• Restore fail in windows #891
• Support for custom user ID "--cid" (feature) #888
• Compilation on Android and termux not possible #886
• Question about restore behavior in Linux #561
• Report progress on SIGUSR1 (when scripted) #453
• Allow reading backup items from file #417
• Add CLI #64
• Document differences to other backup systems #57

Merged pull requests:

• build.go: Add --enable-cgo #971 (fd0)
• Fixing CPUProfile #968 (mcastilho)
• Fix a number of warnings from go report #967 (middelink)
• Unify repository layout #966 (fd0)
• Update github.com/minio/minio-go #964 (fd0)
• Improve s3 backend #962 (fd0)
• Add backend benchmarks #961 (fd0)
• Enable CI tests against AWS S3 #960 (fd0)
• Change backup policy to be inclusive #957 (middelink)
• Unlink tempfiles before using them #952 (fd0)
• codecov.io: Add path fixes #947 (fd0)
• Update github.com/minio/minio-go #946 (fd0)
• Add bash autocompletion generation #945 (middelink)
• Small changes to cmd_forget and snapshot_filter #943 (middelink)
• local/sftp: Auto create directories if needed #941 (fd0)
• WIP: rework backend integration tests #938 (fd0)
• Fix links broken during conversion to rst #936 (Thor77)
• CI: Add glyphcheck, rework REST server install #935 (fd0)
• forget: don't sort flags #930 (fd0)
• Test if a config file on open #927 (fd0)
• Update vendored dependencies #922 (fd0)
• Small typo in "Frankfurt" #920 (jpmens)
• Added AWS S3 tutorial. #919 (Phaeilo)
• s3: Correct layout prefix, reduce connections #918 (fd0)
• Ignore empty lines in excludes file, allow multiple files #916 (fd0)
• Switch documentation to Sphinx #913 (Thor77)
• Update Go #912 (fd0)
• Implement MkdirAll() for Windows #911 (fd0)
• Check allowed devices per path #908 (fd0)
• Remove short option conflict #905 (fd0)
• Add new field DeviceID and tests #903 (fd0)
• storage of device id of files #902 (jgfrm)
• Prepare more cloud backends, add backend layouts #898 (fd0)
• doc: Add section about how to change the sftp port #896 (fd0)
• WIP: rest: Make backend honor the REST protocol #887 (fd0)
• Cache size of last ReadAt on S3 for performance #883 (trbs)
• Fix restoring files ownership as non-root user #878 (middelink)