Duplicati a Set it and Forget it backup tool for local and remote backups of your system!
Рет қаралды 50,847
Күн бұрын============ LINKS ============
Show Notes
wiki.opensourceisawesome.com/...
Duplicati Homepage
www.duplicati.com/
Duplicati on Dockerhub
hub.docker.com/r/linuxserver/...
Duplicati on Github
github.com/duplicati/duplicati
Support my Channel and ongoing efforts through Patreon:
www.patreon.com/bePatron?u=23...
=== Timestamps ===
00:00 Beginning
00:09 Introduction to Duplicati
02:08 Thank you to my Patrons at Patreon, and to my subscribers on KZfaq!
02:40 Installing Duplicati with Docker
06:55 check our Install Logs
07:50 Go to our running Duplicati web interface
08:20 General Settings
10:50 Speed Limits and Pause
11:30 the About info panel (very useful for knowing what's changing).
12:25 Configuring our First Backup with Duplicati
17:55 Watching our Backup Progress in the Web Interface
=== Contact ===
Twitter: @mickintx
Telegram: @MickInTx
Mastodon: mastodon.partecipa.digital/ @MickInTX
Try out SSDNodes VPS Services! Amazing Specs for incredibly low costs. I'm running a 32 GB RAM / $ CPU Server for only $9 a month! Seriously. FOr long term server usage, this is the way to go!
www.ssdnodes.com/manage/aff.p...
Get a $50.00 credit for Digital Ocean by signing up with this link:
m.do.co/c/a6a61ae55242
Use Hover as your Domain Name Registrar to get some great control over you domains / sub-domains:
hover.com/SHPaiirr
Support my Channel and ongoing efforts through Patreon:
www.patreon.com/bePatron?u=23...
What does the money go to?
To Pay for Digital Ocean droplets, donations to open source projects I feature, any hardware I may need to purchase for future episodes (which I will then give to a subscriber in a drawing or contest).
=== Attributions ===
Intro and Outro music provided by www.bensound.com
@DavidJones-pi8rl 2 жыл бұрын
I love your style in going through everything so methodically! I have come back to your videos after some time away and realise why I love them so much. Great work and many thanks
@AwesomeOpenSource 2 жыл бұрын
You are so welcome! And so glad you like my style. I reference my own videos sometimes when I'm trying to remember exactly what I did at the time.
@sohaibkhan8835 Жыл бұрын
Thank you very much! I had previously watched some other videos and read about Duplicati backup, but I was still searching for a clearer explanation. I'm grateful to have stumbled upon your video. Your explanation was straightforward and easy to understand, without any complicated setup. I truly appreciate your hard work and dedication. Thank you again!
@AwesomeOpenSource Жыл бұрын
Something to keep in mind. Always check that you can successfully restore the data from your backups. Others posted that they had issues, but in my testing I always had success restoring the data. But a warning for any backup software, not just duplicati.
@larrybahr489 2 жыл бұрын
Awesome video. Would have loved to see a file/backup be restored as well since that is a major part of a back up solution. Keep up the great work!
@AwesomeOpenSource 2 жыл бұрын
Let me do a follow up at some point.
@mikegodin23 8 ай бұрын
Great! I was trying to get it right and you helped a lot. Thanks.
@AwesomeOpenSource 8 ай бұрын
You're quite welcome. Glad it helped.
@teomcam 2 жыл бұрын
Amazing video and presentation thank you sir 👍🏻 Subscribed.
@AwesomeOpenSource 2 жыл бұрын
Thank you, glad you enjoyed it.
@bamhm182 2 жыл бұрын
Great video! That said, your audio is very rough and tinny. It is very hard to listen to. You can pick up a Behringer Audio Interface for like $50, a Behringer mic for like $20, a pop filter and mic arm for like $20 and have an INCREDIBLE sound. With as big as your channel is, I highly recommend you give this a thought. Keep up the great work!
@AwesomeOpenSource 2 жыл бұрын
I appreciate the feedback. Yeah, I definitely go in and out of audio issues, but lately I've been getting better with the help of some great viewers and adjustments of my existing hardware.
@carnby24 2 жыл бұрын
Really Awesome!!!!
@AwesomeOpenSource 2 жыл бұрын
Glad you like it.
@kevinhughes9801 2 жыл бұрын
Brill stuff thank you
@AwesomeOpenSource 2 жыл бұрын
My pleasure!
@jeytis72 Жыл бұрын
Very good. But I also think that the most important thing when it comes to using this type of software is making sure that the restoring process of your data would work smoothly and without any data corruption. So, a new video about that would be much appreciate too. Thanks
@AwesomeOpenSource Жыл бұрын
Agreed. I did do some data recovery after the video based on requests from other commenters. My recovery worked with no issues. I've read on forums where others encountered problems with it though.
@jeytis72 Жыл бұрын
@@AwesomeOpenSourceI started to focus on backup strategies just a few weeks ago, and since the very beginning I realized that it is a very complicated matter. It can be easy to learn a few commands or use a GUI for that, but you can run across a lot of problems concerning the space available, privacy, data integrity and consistency, just to name a few.
@gmansi Жыл бұрын
@@jeytis72what are you using now? On my case Duplicati and Restic
@EvolverDX Жыл бұрын
I recommend to use the official docker container duplicati/duplicati from the original DEVs.
@AwesomeOpenSource Жыл бұрын
I'll check it out.
@dniksbr Жыл бұрын
ty great work, just i need
@AwesomeOpenSource Жыл бұрын
Hope it helps.
@norbertkovacs3447 2 жыл бұрын
Very useful tutorial! I wonder if you could show us how to set up Syncthing behind NPM also? :)
@AwesomeOpenSource 2 жыл бұрын
Let me see what I can come up with.
@nwdsc 2 жыл бұрын
Great work as always. Your content is much appreciated. One question: I have a folder (called appdata) that I save all my docker container folders in (e.g. Nextcloud, Bitwarden, etc.), this is separate from the system Docker folder. I will obviously backup this appdata folder but do I need to backup the system Docker folder as well? I believe in one of your previous videos you said you got back and and running with just copies of your container folders (not the docker folder) but I want to ensure I'm understanding correctly. Thank you.
@AwesomeOpenSource 2 жыл бұрын
Yes, most containers will just need the same volume mappings to get back up and running, even if you repull the container itself. I don’t back up the container with my setup, it’s a folder I called Docker, but it holds the volume mapped data, Docker-compose commands, or Docker run commands. This way if something happens it’s pretty easy to bring it all back up.
@debnathmriganka2010 Жыл бұрын
Thank you sir, I got my error point, when i just change PUID an PFID to 1000 to 0 then all files uploaded properly Thank you sir. Very much. for your this video.
@AwesomeOpenSource Жыл бұрын
You are most welcome
@MmMm-oh5ct 2 жыл бұрын
i just googled duplicati and then i get a notification about your new video, can you please stop reading my google searches😅
@AwesomeOpenSource 2 жыл бұрын
Hahahaha, stop using Google and start using Whoogle, private Google. I have a video on it!
@MmMm-oh5ct 2 жыл бұрын
@@AwesomeOpenSource ah i have catched you, you just want that i looke moore of your videos. Thank you for your hint and your videos 😁
@froid_san 2 жыл бұрын
I'm also using this on my raspberry pi 4 with ubuntu x64, but I'm having problems with it using a docker install and I cannot remote upload to cloud. It may have a problem with my wireguard install on the host as when I disable wireguard I can upload my backups to the cloud. I still new to self hosted so I just installed it in my host and works fine even when wireguard is enabled.
@AwesomeOpenSource 2 жыл бұрын
Definitely sounds like it could be a routing or NIC vs virtual NIC issue when wireguard is up on yoru Pi.
@AcielGamingTech 2 жыл бұрын
A quick question, Is it safe to do docker backup when the containers are running? What if it can't backup some files which are being in used by the container.
@AwesomeOpenSource 2 жыл бұрын
If you have a lot of constant churn, it could miss something, but check the logs on Duplicati, or whatever backup tool you're running to look for errors. I haven't had any so far, but not a ton of churn in my home lab.
@fredzibulski3111 2 жыл бұрын
I can confirm that it works on a raspberry pi, i have been using it for some time now. Super expldinstuon on it. Can you make a video on docker agent view. On how to put different docker instances in one ?
@AwesomeOpenSource 2 жыл бұрын
That's awesome! You mean Portainer Agent?
@fredzibulski3111 2 жыл бұрын
@@AwesomeOpenSource yes thats it
@AwesomeOpenSource 2 жыл бұрын
@@fredzibulski3111 already have one. Here’s the show notes link and the video is there as well. Hope it helps. shownotes.opensourceisawesome.com/installing-portainer/
@hd9g 2 жыл бұрын
Can we have a dumb down video for personal users backing up to personal ext HDD?
@AwesomeOpenSource 2 жыл бұрын
Let me see what I can do.
@baileyboy3687 2 жыл бұрын
Bizarre. Portainer could not deploy the stack so ran it from the CLI and it pulled the image down and its showing in portainer. Had this problem when trying to deploy the seafile stack also.
@AwesomeOpenSource 2 жыл бұрын
Depending on ENV variables, you'll see that sometimes. Portainer has a couple of ways of handling thiose, so it's important to understand that part of it for sure.
@Tachkila 2 жыл бұрын
I like the way you explain the thing even small details thank you so much i always like your videos i have a question can i backup my android phone using duplicati if yes how thank you
@AwesomeOpenSource 2 жыл бұрын
No, I believe you would need to be able to run the Duplicati service on the phone. The Duplicati service runs on each machine you want to backup, and pushes the backup to a local drive or remote server.
@Tachkila 2 жыл бұрын
@@AwesomeOpenSource Thank you for your reply
@ChrisDePasqualeNJ 2 жыл бұрын
I want to set this up but I can't find the Synctihng Video. What is the name of it?
@AwesomeOpenSource 2 жыл бұрын
I haven't done a video on Syncthing yet. I will be doing one in the future though. I do have videos on Seafile and NextCloud, but those don't really do anything with Duplicati. Duplicati is really it's own solution.
@default_youtube_profile 2 жыл бұрын
I was hoping to use duplicati to do regular backs up mysql server db , but it looks like it copy backup folder locations to other destination folder.
@AwesomeOpenSource 2 жыл бұрын
If you're using MySQL in Docker, then you can map the mysql db location to a "folder" volume on your host, and back that up with Duplicati. As for just copying a mysql DB, I think you need to dump the db, then copy the backup .sql file.
@christianuwa6398 8 ай бұрын
Your video has been so helpful. However, I am unable to find my /path/to/source so I keep on getting No custom files found, skipping...
@AwesomeOpenSource 8 ай бұрын
In this case, I presume it's talking about the volume you need to map for the data area you want as a backup option. In my example on my tutorial page at wiki.opensourceisawesome.com/books/backup-software-to-save-your-data/page/installing-duplicati-to-backup-your-data, I have /home/brian, but you would make this whatever folder path you want. Does that help?
@christianuwa6398 8 ай бұрын
@@AwesomeOpenSource /:/source. This part confuses me. I am using a docker compose file which has Postgres image and a redis image. I want to backup the volumes of the two images but I don’t know how to point duplicati to the volumes
@ForSquirel 2 жыл бұрын
So download options are "beta" or "not supported". I'm confused as to why one would use this software. Its like a solution looking for a problem.
@AwesomeOpenSource 2 жыл бұрын
Well, yeah, but remember, Gmail was in Beta for like 10 years.... so take a label for what it's worth. The history of it shows the 2.0 version has been out for more than a year and a half... so as another backup option, probably with a shot.
@default_youtube_profile 2 жыл бұрын
I thing S3 erasure coding would be better solution if we want to keep data from loosing instead of creating a duplicate copy!
@AwesomeOpenSource 2 жыл бұрын
The point here is to have multiple backups, and that's what duplicati offers. You should use the 3,2,1 backup plan. 3 copies of the data in at least 2 physically different locations, no less than 1 time per week (or day if needed).
@owNewBlood 2 жыл бұрын
Is there an open source system like this but can do system drive images? (without having to boot PXE)
@AwesomeOpenSource 2 жыл бұрын
I've been looking for a way to make full images, but not found anything yet that can do it while the system is running.
@owNewBlood 2 жыл бұрын
@@AwesomeOpenSource yeah the only thing I can find for Windows is the disk2VHD. Might be able to run it with a script, but haven't tried yet.
@Slackware1995 2 жыл бұрын
I'm looking for an open source backup server with windows 10, Linux, freebase and ANDROID clients. Any recommendation?
@AwesomeOpenSource 2 жыл бұрын
You might lookup my video on URBackup. It's a server with fairly easy to setup clients for Windows. Linux is a CLI client, but still easy to user. Don't know about Freebase or Android for sure though.
@girl-with-many-questions2659 2 жыл бұрын
I had 7 of our developers/admins look at a test copy of the latest (as of June 2022) Windows version of Duplicati. *NONE* of them could find the choices for "full file backup", "incremental file backup", "differential file backup", "full image backup", "incremental image backup", and "differential image backup". (Some pretty simple, basic features that are available in MANY backup tools.) Are they not available in Duplicati? Or just insanely/deeply well hidden?
@AwesomeOpenSource 2 жыл бұрын
It's been a while since I've played with it, but as I recall it's really just intended to be a simple backup solution for the more average user.
@rohanjamadagni 2 жыл бұрын
The default method is it breaks up files into blocks and does a full upload in the beginning, then it does a incremental backup from then. You can set the size and compression settings of each block. Afaik you can't change this fundamentally.
@SmedleyButler1 Жыл бұрын
Um, can someone answer his question more directly please? Or is another libre program better?
@pcmv6832 2 жыл бұрын
So the complaint I have heard about Duplicati is that it will backup no problem but when it comes to restoring data after a long time, it corrupts and you lose the ability to restore. I am not sure if that is still the same to this day or not as I have been using Duplicacy instead.
@AwesomeOpenSource 2 жыл бұрын
I can't say so far, as I've been fortunate enough to not have to restore, but indeed, a solid part of backups is validating the backup, and making sure the data is good.
@julian.morgan 2 жыл бұрын
Yes - in fact when researching this subject I came across so many comments from people who've had bad experience with trying to restore data that I passed on it. I also notice that, for example, the 'getting started' page on the website hasn't been updated since 2016, which doesn't inspire much confidence in something so critical. Would be great to see some restore testing if possible?
@zapisto 2 жыл бұрын
correct.... people most often do backup but never test the restore extensively.....let alone a proper DR drill i went away from duplicati for this reason... try cooked your DB and try a restore ..... i went to Kopia borg or restic instead
@gmansi Жыл бұрын
@@zapisto Kopia is free right?
@zapisto Жыл бұрын
@@gmansi absolutly
@debnathmriganka2010 Жыл бұрын
Sir, Can you make a series of tutorial of HestiaCP for beginer. How to install backup etc. it will be help for beginer. Thank you sir.
@AwesomeOpenSource Жыл бұрын
Let me take a look at it and see what I can do. Interesting looking.
@debnathmriganka2010 Жыл бұрын
Working but when i upload to google drive then shows the error : Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-PathProcessingFailed]: Failed to process path: Please help me sir. Last 7 days I am trying but not success. I am Just new to linux.
@debnathmriganka2010 Жыл бұрын
Sir I install duplicati using portainer on my oracle cloud ubuntu server. but when i am going to setting to backup to google drive then all my sorce file "/" this directory not showong all folder. For the testing purpose i create a folder named "test" when i am going to add it to source not showing me Please can you help me sir.
@AwesomeOpenSource Жыл бұрын
When you set up the docker compose file, you need to map the directories on the host machine to a location on the docker vm. Something like volumes: - /:/data Then you can access the host "/" inside the docker vm at the path "/data" to back it up.
@debnathmriganka2010 Жыл бұрын
@@AwesomeOpenSource Not working also. I just tried but not working sir.
@debnathmriganka2010 Жыл бұрын
@@AwesomeOpenSource Right now it is working sir, many many thanks. but all folder shows under backups folder but why.
@debnathmriganka2010 Жыл бұрын
Sir One more issuse i am facing right now. when i created a folder on google dvire then not connection error show. but when path is blnak then working. how to mention a backup folder on google drive.
@AwesomeOpenSource Жыл бұрын
You need to map a volume from your host machine (so the path to your google drive location on your main machine) to a location inside the container (VM). Map a path for each location as needed.
@theurs2 2 жыл бұрын
did you review zerotier?
@AwesomeOpenSource 2 жыл бұрын
I haven’t yet because I need to figure out how to self host the entire stack. There are three pieces to their stack from what I can tell, the client, the server controller, and the moons or the relay servers. The last one is what I’m having trouble with. Maybe their documentation has improved. I’ll have to look again.
@gamingoutloud293 Жыл бұрын
Is it possible to backup the complete system? with all my custom made services and settings?
@AwesomeOpenSource Жыл бұрын
You probably want to look into using snapshots for that, or an image every week or month. Use something like Clonezilla for images, and for snapshots, you can use a btrfs file system, and then a tool like TimeShift.
@gamingoutloud293 Жыл бұрын
@@AwesomeOpenSource I already use Clonezilla for cloning the whole system to a external drive. But i have to do it manually (connect the drive, restart with clonezilla usb stick and so on). That makes the whole backup process really tiring.
@AwesomeOpenSource Жыл бұрын
Then BTRFS snapshots, might be a good option to try going forward.
@gamingoutloud293 Жыл бұрын
@@AwesomeOpenSource What about urBackup? You posted a video for this tool too. Is it possible to make a complete backup on the fly? Not only home folder?
@lickitysplitted 2 жыл бұрын
Would you like some help with your mic?
@AwesomeOpenSource 2 жыл бұрын
I need help with not messing up my system every week for recording. Hahahaha.
@lickitysplitted 2 жыл бұрын
@@AwesomeOpenSource yeah that’s understandable. Good videos and thought I could lend a hand.
@AwesomeOpenSource 2 жыл бұрын
@@lickitysplitted No, seriously, I could use some help. I've been slowly working on making it better, but definitely still having Gain issues. I've got my next video recorded, so maybe we can sync up on my RocketChat server discuss.opensourceisawesome.com I'm @mickintx
@stan464 Жыл бұрын
Duplicacy is a better choice, Duplicatti uses local cache zips and is not good for Large backup sets.
@AwesomeOpenSource Жыл бұрын
As long as your solution works for you, then it's all good.
@gmansi Жыл бұрын
@@AwesomeOpenSource Duplicacy is not free
@10a3asd 2 жыл бұрын
your mic clips on every video
@AwesomeOpenSource 2 жыл бұрын
Yeah, but I'm working on it. Got some great help yesterday to try and make it better.
Awesome Open Source
Рет қаралды 81 М.
TroubleChute
Рет қаралды 41 М.
Awesome Open Source
Рет қаралды 51 М.
Awesome Open Source
Рет қаралды 72 М.
Rustdesk - an Open Source, Self Hosted alternative to TeamViewer, AnyDesk, GoToAssist, and the like.
Awesome Open Source
Рет қаралды 492 М.
notebook-31
Рет қаралды 132 М.