nfreezer

And yet again: A list of alternatives. attic (python) - https://github.com/jborg/attic borg (c) - https://github.com/borgbackup/borg bupstash (rust) - https://github.com/andrewchambers/bupstash duplicacy (go) - https://github.com/gilbertchen/duplicacy duplicati (c#) - https://github.com/duplicati/duplicati duplicity (python) - https://github.com/henrysher/duplicity kopia (go) - https://github.com/kopia/kopia nfreezer (python) - https://github.com/josephernest/nfreezer rdedup (rust) - https://github.com/dpc/rdedup restic (go) - https://github.com/restic/restic rclone (go) - https://github.com/rclone/rclone rsnapshot (perl) - https://github.com/rsnapshot/rsnapshot snebu (c) - https://github.com/derekp7/snebu tarsnap (c) - https://github.com/Tarsnap/tarsnap I think there are many more out there (https://github.com/restic/others) - I personal

And yet again: A list of alternatives. attic (python) - https://github.com/jborg/attic borg (c) - https://github.com/borgbackup/borg bupstash (rust) - https://github.com/andrewchambers/bupstash duplicacy (go) - https://github.com/gilbertchen/duplicacy duplicati (c#) - https://github.com/duplicati/duplicati duplicity (python) - https://github.com/henrysher/duplicity kopia (go) - https://github.com/kopia/kopia nfreezer (python) - https://github.com/josephernest/nfreezer rdedup (rust) - https://github.com/dpc/rdedup restic (go) - https://github.com/restic/restic rclone (go) - https://github.com/rclone/rclone rsnapshot (perl) - https://github.com/rsnapshot/rsnapshot snebu (c) - https://github.com/derekp7/snebu tarsnap (c) - https://github.com/Tarsnap/tarsnap I think there are many more out there (https://github.com/restic/others) - I personal

Lets make a list : attic (python) - https://github.com/jborg/attic borg (c) - https://github.com/borgbackup/borg bupstash (rust) - https://github.com/andrewchambers/bupstash duplicacy (go) - https://github.com/gilbertchen/duplicacy duplicati (c#) - https://github.com/duplicati/duplicati duplicity (python) - https://github.com/henrysher/duplicity kopia (go) - https://github.com/kopia/kopia nfreezer (python) - https://github.com/josephernest/nfreezer rdedup (rust) - https://github.com/dpc/rdedup restic (go) - https://github.com/restic/restic rclone (go) - https://github.com/rclone/rclone rsnapshot (perl) - https://github.com/rsnapshot/rsnapshot snebu (c) - https://github.com/derekp7/snebu tarsnap (c) - https://github.com/Tarsnap/tarsnap I think there are many more out there (https://github.com/restic/others) - I personally use restic whi

I created nFreezer ("encrypted freezer") for this purpose at the end of 2020: https://github.com/josephernest/nfreezer. Main features: * encrypted at rest locally (the data is never decrypted on the remote server) * handles file renames / moves (no data is re-sent, it can save GB of transfer!) * single Python file of ~ 250 lines of code. It is quick to read the code and decide if you like/trust it or not.

If your provider uses SFTP, you can use nFreezer (http://github.com/josephernest/nfreezer) which I built exactly for the same purpose than you. (I first thought about 7z too but having to reupload the whole archive even if only a few files are modified made me look for another solution). In short, you can do nfreezer backup my_documents/ user@11.22.33.44:/backup/ and the backup will be done or updated (if only 1MB have changed since last backup, only 1MB will be uploaded and not 100 GB). Everything is encrypted locally (including the filenames), and never decrypted on remote. You can't use the files on the remote server, it's only cold storage - the only thing you can do with it is: restore to your local computer (if one day you need it), and decrypt it locally. It's 250 lines of code in one single source file, so you can read it qu

From https://github.com/josephernest/nfreezer/blob/master/nfreeze..., this is how you decrypt files: [...] with open(f2, 'wb') as f, src_cm.open(chunkid.hex(), 'rb') as g: decrypt(g, pwd=encryptionpwd, out=f) [...] def decrypt(f=None, s=None, pwd=None, out=None): [...] while True: block = f.read(BLOCKSIZE) if not block: break out.write(cipher.decrypt(block)) try: cipher.verify(tag) except ValueError: print('Incorrect key or file corrupted.') So, basically, you decrypt the whole file and write the result before checking the tag. You're using a block cipher in a streaming fashion, and as has already been said before (see https://www.imperialviolet.org/2015/05/16/aeads.html, "AEADs with large plaintexts") this is dangerous if you don't do it corre

"But still there is one thing (at least) that can be of interest to some people with nFreezer: it is very simple, it does the job in only 249 lines of code. You can then read the FULL source code in a few hours, to see if you trust it or not. See here: https://github.com/josephernest/nfreezer/blob/master/nfreeze..." I really appreciate this and find this very interesting. I would be happy to give you a free dev/test account at rsync.net if that would help you continue this development.

How does backblaze compare on the features chart: https://github.com/josephernest/nfreezer#comparison

As I discover it, borg seems to be pretty good for this use case indeed. But still there is one thing (at least) that can be of interest to some people with nFreezer: it is very simple, it does the job in only 249 lines of code. You can then read the FULL source code in a few hours, to see if you trust it or not. See here: https://github.com/josephernest/nfreezer/blob/master/nfreeze... If I want to do this with the source code of the tool you mentioned, I would have to spend at least one full week. (this is normal: this program has 100 times more features). The key point is: if you're looking for a solution for which you don't want to trust a remote server, then you probably don't want to trust the backup tool of a random internet person either. And you probably want to read the source code of the program. So having only < 300 lines of c

Thanks for asking the question, it's right, there are thousands of backup programs already. The "key thing" that lead me to code my own is that with nearly all the solutions I tried, data was resent over network when a big file is moved to another dir+renamed, WHEN used in encrypted-at-rest mode. It's the case for rsync (the --fuzzy only helps when renamed but stays in same dir), duplicity, and even rclone when in encrypted mode (see https://forum.rclone.org/t/can-not-use-track-renames-when-sy...: "Can not use –track-renames when syncing to and from Crypt remotes"). So I wanted to solve this problem, and it works. See point #3 of https://github.com/josephernest/nfreezer#features.

nFreezer is different to RClone and Duplicity on a very important point (for me because I often move big multimedia projects): if you move `/path/to/10GB_file` to `/anotherpath/subdir/10GB_file_renamed`, no data will be re-transferred over the network, thus saving 10 GB of data transfer. Indeed, Rclone does not handle renames when in encrypted mode, see https://forum.rclone.org/t/can-not-use-track-renames-when-sy... Idem for duplicity (tests done). TL;DR: see 3rd point of https://github.com/josephernest/nfreezer#features ___ Another interesting feature is that you can read/audit the full source code of nFreezer quickly: it's only 249 source lines of code, as of today.