Backup Your Data Now Before It's Too Late! (Docker, NAS, Kubernetes, Google Cloud Backup)

[@jjb7920]

Great video, Jim! I'm in the process of re-working my backup strategy, as I've been using rsync and cron to automate some of the process. Then I manually send the backups to my truenas storage because it's not running 24/7. I'll be checking into using rclone now that I've seen it here.

[@Jims-Garage]

Seems like a natural replacement. It also has a number of new features over rsync. I'll be doing a deployment video soon and will walk through some of the main features.

[@chrisumali9841]

Thanks for the demo and info, have a great day

[@Jims-Garage]

Thanks, you too!

[@chrisumali9841]

I use the builtin backup in Proxmox to backup to two unRaid servers in my home

[@kongoulan]

Hi Jim, excellent channel you have! Have you considered how Restic handles database backups? Does it ensure everything is flushed from memory to storage before backing it up?

[@Jims-Garage]

@@kongoulan thanks! Databases are best done by shutting down first or performing backups using db native tools.

[@kongoulan]

@@Jims-Garage I'm fairly new to Restic. Does Restic shut down all the containers before backing them up, or what exactly happens when it runs?

[@adamturtle69]

Backup is really strange. For some reason it doesn't work for me because I made some beginner mistakes. Now I just make random dump files from proxmox to my NAS, I simply added it as a drive in proxmox and I take snapshots from there several times a day. I installed PBS as an unprivileged lxc because I couldn't get the SMB marketing to work. I think it's a shame that there is still no decent docker container backup that has a GUI. At the moment I just do a vz dump of the entire machine where docker is installed. First the lxc is stopped and then started again. But I would like to have my containers from docker really well backed up but I really don't have the software for that and no one has made a version with an interface yet. The NAS is Windows because Truenas doesn't give me read write caching and it takes up too much RAM. Unraid is too expensive for me. I have a really good backup program but the compression is still too low for me I have to say. Somehow it's all not quite right.

[@linuspalma5555]

Hi Jim, thanks for this video! Im planning my backup strategie right now. Ive come across restic and this brought me here. I have a question: Since you could put tags on the backups, one could use the same restic repository for different homlab "services" (lets say nextcloud and jellyfin). Would you put the backups of both services in one restic repository or would you init a new one for each service? Also, do you use one central restic container to manage all backups for different services or do you deploy those restic containers alongside each service? I tend to init a new repository for each service and deploy multiple restic containers. But i was hoping to hear your opinion! Thanks a lot! Linus

[@Jims-Garage]

I bundle everything together as I'm storing it all in the same place. You can break it out if you want but for a homelab it doesn't make a ton of sense unless you have shed loads of data

[@linuspalma5555]

​@@Jims-Garage thank you for the quick reply!! so you would use one repository and use the tags for the diffrent backups, while deploying multiple restic containers (for each service) right? but with the approach of multiple repositorys i could bundle it in one truenas volume for easy handling, too. Was just thinking about data corruption and possibly security (diffrent passwords and also isolation). But i was not sure if this would be an overkill, or a dumb idea (waste of resources?). what do you thin?

[@andiM76]

@Jims-Garage Nice video. Can you explain where you pick up the data from pbs with rclone? Which folder do you choose in pbs?

[@Jims-Garage]

@@andiM76 I use PBS with my NAS. On my NAS I copy the entire folder that has the .chunk folder as part of it (essentially the entire share). I suspect it's all in the same folder on PBS but I haven't checked.

[@joelfrojmowicz]

Great video. What do you use to backup docker containers? Is it Restic? Does it stop the container, back it up and start the container again?

[@Jims-Garage]

I use Restic, no it doesn't stop the container (which is another great reason for using it). I will be doing a deep-dive into setup and deployment soon (as well as rClone).

[@joelfrojmowicz]

@@Jims-Garage But if it does not stop it, then how can we make sure the backup is done correctly. Mainly if the container uses a database... I think is more secure if the backup application stops the container, backup it's files and then start it again.

[@Jims-Garage]

@@joelfrojmowicz If it's a db like sqlite it'll just copy the file, if it's a db like mariadb, it should still backup but might be best to stop it first.

[@fplove]

@@Jims-Garage not really, better performing a mariabackup automagically in the container, which snapshots correctly Innodb, and backup those snapshots.

[@Jims-Garage]

@@fplove true, that would probably be the best approach, to use the db itself to perform its own backup

[@jacobburgin826]

Is there a way to backup a proxmox install or at least the settings if you can't run raidz?

[@Jims-Garage]

Unfortunately not officially which is pretty crazy IMO. You can create a copy of the /pve folder which should do the trick.

[@jacobburgin826]

@@Jims-Garage no wonder I had not seen anything about it! I run 3 12th gen nucs and ceph over thunderbolt in a ring network. Unfortunately raid not possible with the lack.of connections but there is redundancy in on other ways. Just discovered your channel and hats off to you, your assumed knowledge ceiling is a lot lower than other channels I watch which helps a lot with these awesome projects.

[@Jims-Garage]

@@jacobburgin826 thanks, ceph is something that I want to try out more of in the future

[@Sahta99]

How about using your friends server for remote backup? And vice versa 😂

[@Jims-Garage]

@@Sahta99 it's a good point and what I'm going to do in a new video. It's why I've done headscale and netbird (to enable this securely)