git-annex is a method for git to manage large files. But it's so much more than that: it forms a decentralized network of repositories that can share data, can connect to external "special remotes" such as S3, rsync, webdav, and more. It provides:
- data integrity
- a data replication and management layer
- encryption of remotely stored data
- history and provenance
- metadata
00:35 Initial thoughts, what is git-annex
03:55 Create a repository and annex files
15:45 Create a second repository and link them
23:35 Move data back and forth, what does that mean?
29:40 special remotes
35:50 external special remotes intro
39:20 using a S3 service as special remote (CSC Allas)
44:30 metadata
46:18 more questions: encryption, how does it access S3 and special remotes,
47:10 other types of special remotes
50:20 general thoughts, how to get started
52:45 who is behind git-annex?
54:05 scalability
56:30 importtree/exporttree (remotes with files already there)
1:03:35 wrap-up