Proxmox Backup Server Saves You Money And Time!

Поділитися
Вставка
  • Опубліковано 19 чер 2024
  • Move away from manual backups in Proxmox VE, and use Proxmox Backup Server instead. The use of deduplication means that you'll save valuable space and time when performing backups.
    In this video I'll show how to deploy Proxmox Backup Server, how to mount an SMB share from TrueNAS, and how to integrate it into your existing Proxmox VE to backup your VMs.
    Video Commands:
    github.com/JamesTurland/JimsG...
    Recommended Hardware: github.com/JamesTurland/JimsG...
    Discord: / discord
    Twitter: / jimsgarage_
    Reddit: / jims-garage
    GitHub: github.com/JamesTurland/JimsG...
    00:00 - Introduction to Proxmox Backup Server & backup practices
    02:34 - Download Proxmox Backup Server
    06:06 - Create VM & Installation
    11:25 - Proxmox Backup Server Web GUI
    12:44 - Adding CIFS for SMB Mount
    20:24 - Using the SMB Mount in Proxmox VE
    24:18 - Outro
  • Наука та технологія

КОМЕНТАРІ • 184

  • @rickhernandez2114
    @rickhernandez2114 7 місяців тому +33

    Do you live in one of the rooms in my house?
    More than once I'm working on setting up something in my home lab, and either that day or the next day you drop a video on *EXACTLY* what I'm working on.
    This is truly the most complete, thorough, and easy to understand channel on the internet, bar none.
    Nice job Jim.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Haha, spooky! Thanks for the feedback, I really appreciate it.

    • @i.p.knightly149
      @i.p.knightly149 7 місяців тому +7

      Make sure to feed him once in a while.

    • @tollav
      @tollav 3 місяці тому +1

      Check the cupboards. He looks flexible, maybe in there??

  • @maxg4958
    @maxg4958 Місяць тому +3

    This must be one of the best channels when it comes to setting up things. Well explained, any omissions corrected. Easy to follow. Very comprehensive. I love it. Thank you.

  • @chrisumali9841
    @chrisumali9841 7 місяців тому +1

    Thanks for the demo and info, have a great day

  • @yanickg
    @yanickg 7 місяців тому +1

    Nice one! Worked on the first go. Will re-use the smb share/ credentials method for my plex vm server. Thanks!

  • @jeffrisdon2803
    @jeffrisdon2803 7 місяців тому +2

    Thanks for this! Could never figure out how to get this to work with my truenas shares...until I saw this video!! Exellent! Thank you!

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      You're welcome, glad it helped

  • @Muddysmind
    @Muddysmind 18 днів тому +2

    Very well done, thanks. Easy to follow, no fluff, calm, well thought out.

  • @JPEaglesandKatz
    @JPEaglesandKatz Місяць тому +1

    Your videos are absolute amazing... Detailed and accurate and helpful!!!

    • @Jims-Garage
      @Jims-Garage  Місяць тому

      Many thanks, appreciate the feedback 🙂

  • @CraigGivant
    @CraigGivant 7 місяців тому +3

    I have been running PBS for awhile now and was never able to get the storage located on a network drive. Your Mount and FSTAB commands were just what the doctor ordered and I was able to successful create a VM and mount the storage to my NAS. I can now get rid of the outdated Unraid container I had resorted to. Thanks for this!

    • @Jims-Garage
      @Jims-Garage  6 місяців тому

      Great, that's good to hear.

  • @JorgeGarciaM
    @JorgeGarciaM 7 місяців тому +1

    HA! Brilliant! At last someone explaining the benefits of the PBS and the step-by-step configuration. Thank you, Jim!

  • @PaulShadwell
    @PaulShadwell 5 місяців тому +1

    Thankyou for this, very helpful. I just set this up for my initial demo setup. Incidentally, I had to switch the SMB mount to v2.0 as it seems neither my Unraid server nor my Synology NAS support SMB v3.0 yet.

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      Interesting, are you able to update the Synology? SMBv2 suffers from Wannacry Zero Day, not sure exposed you are on a non-Windows machine.

  • @-rm-rf
    @-rm-rf 7 місяців тому +2

    Perfect timing as alway 😂 I will definitely look to set this up asap when I have my network figured out 😅

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Psychic Jim strikes again 😂

    • @-rm-rf
      @-rm-rf 7 місяців тому

      @@Jims-Garage with scary accuracy

  • @LampJustin
    @LampJustin 7 місяців тому +9

    07:00 in fact you should always use the q35 machine type. It's much newer and more efficient. The i440fx platform didn't even have PCIe, yes, it's that old...
    07:50 while that is true with physical hardware, when you use a VM you also have to enable discard to be able to free up the reclaimed space.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Thanks for the added details

  • @BromZlab
    @BromZlab 7 місяців тому +2

    Verry good Jim! Yet again an easy to follow guide.. This is verry useful

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Thanks, glad you found it useful.

    • @brianhansen9578
      @brianhansen9578 7 місяців тому +1

      @@Jims-Garage why samba over NFS for backend ?

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      @@brianhansen9578 I prefer the security and role based access controls (NFS isn't as feature rich in this area).

  • @White2115Fangirl
    @White2115Fangirl 7 місяців тому +2

    That’s a helpful video man!

  • @jig1056
    @jig1056 5 місяців тому +2

    This is awesome. I'm an XCP-NG user but thinking of switching to Proxmox because I can't back up XCP-NG VMs when I have a physical USB device connected. I never really liked Proxmox but it's growing on me. I didn't really understand the point of have a backup server when I could have just used network storage to back up directly from my PVE server. This totally changed my mind, I really get it now. Your video was easy to follow, it worked like a charm. I have it running on my test box. We'll see if I convert to Proxmox. You may have gone a long way in helping me make a decision. Thanks

    • @Jims-Garage
      @Jims-Garage  4 місяці тому

      Thanks, really appreciate the feedback

  • @Glatze603
    @Glatze603 7 місяців тому +2

    I use PBS as backup target for some other linux-based machines. For this I installed the PBS-Agent on these machines and can then backup them with cli commands.

  • @dzmelinux7769
    @dzmelinux7769 4 місяці тому +1

    Great video 👍 especially without background noise 🤔🤨😳😲😉

  • @jaymax97
    @jaymax97 6 місяців тому +1

    Took me a while to get it working, but I had to just create a new user on my synology for it to work! Thanks for the video

    • @Jims-Garage
      @Jims-Garage  6 місяців тому

      Great, good job 👍

    • @jenniferw8963
      @jenniferw8963 8 днів тому

      I so want to do this. add antoher 8gb RAM module to my Synology nas and run PBS in a VM. All the fast storage and snapshots are already there. Why get more hardware?

  • @ozmosyd
    @ozmosyd 7 місяців тому +2

    Was pondering on the PBS for a while. Your breakdown here has cleaed/answered, any questions and doubts about giving it a spin.
    Thanks for sharing.

  • @mankala8
    @mankala8 14 днів тому +1

    I think you may have described differential backup instead of deduplicationn. I think dedupe goes further - if you have 5 debian vms, dedupe will only store one copy of anything that's the same between the vms (eg app binaries, conf files, copy of your pub key, etc). Dedupe also causes differential backup as a byproduct.

  • @hmeland1
    @hmeland1 Місяць тому

    If you go into Datacenter -> Storage -> Local. You can edit the "content" of that storage and remove the option to store backups on "local" storage. Hence no longer needed to choose between storages in any drop-down menus.

  • @CoolWolf69
    @CoolWolf69 7 місяців тому +3

    PBS is really a great tool. I am using my main PBS on bare metal and started last weekend playing around with a virtualized 2nd PBS on PVE which I am planning to run remotely and which then syncs (pulls) the datastore from my main PBS to the remote site for another layer of data(store) protection 🙂
    As datastore I am using a 1TB iSCSI disk which is hosted on my TrueNAS system (and of course snapshotted and replicated to a backup TrueNAS server). I have currently a Deduplication Factor of 15.13 so my datastore looks like it will "never" get full (only 24% used) even if I am backing up 24 CTs and 3 VMs with overall more than 400 Snapshots.
    You gotta love Proxmox and what they are doing with PVE and PBS 👍

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      That's awesome, cool setup!

  • @happy9955
    @happy9955 7 місяців тому +3

    Great video, thank you. I'm from Hong Kong, and English is not my native language, but I can hear quite clearly.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Thanks, I appreciate your feedback 😃

  • @ronm6585
    @ronm6585 4 місяці тому +1

    Nice! Thank you.

  • @yasaralzakout7691
    @yasaralzakout7691 26 днів тому +1

    Thanks, Jim. Your tutorials are always clear and very helpful. Have you tried doing the same thing with NFS? I’ve tried it several times, but I keep encountering permission errors!

    • @Jims-Garage
      @Jims-Garage  26 днів тому

      Wow, thank you that's extremely generous. I don't use NFS as most of my end user devices are windows. I do have a TrueNAS video that sets up a NFS share, that might be useful?

  • @buzzy_cnayl
    @buzzy_cnayl 3 місяці тому +1

    Great video, thanks. Slightly confused me though as initially your mount was at /mnt/truenas but then when you made it permanent via fstab it got changed to /mnt/test-pbs

  • @cheebadigga4092
    @cheebadigga4092 7 місяців тому +8

    Note about the "Disks" section when creating a VM: Always use SSD Emulation together with Discard to enable trim support awareness of the VM on the hypervisor level.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +2

      Thanks, useful tip 💯

    • @cheebadigga4092
      @cheebadigga4092 7 місяців тому +1

      @@Jims-Garage I'm not sure how exactly this interoperability between the VM and the hypervisor works, but there are some blog posts spread across the internet about it. AFAIK the Promox wiki doesn't necessarily say anything about it. But what I personally found was that the GUI, especially the storage graphs "know" the correct size of the VM disk after trimming when Discard is enabled. It wouldn't work otherwise which confused me, so I always enable both lol

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      @@cheebadigga4092 thanks, I'll check mine out this evening with it enabled.

  • @simonfaulkner5596
    @simonfaulkner5596 6 місяців тому +2

    Cheers Jim, great video, particularly interesting to use a virtual instance, I hadn't thought of that. Just out of interest why did you choose CIFS for the share rather than NFS?

    • @Jims-Garage
      @Jims-Garage  6 місяців тому +2

      Thanks! Cifs is more advanced when it comes to role based access control and permissions (and a few other benefits).

  • @jimmy651
    @jimmy651 6 місяців тому +1

    Thank you

  • @user-ey1mw5cg4m
    @user-ey1mw5cg4m 2 місяці тому +1

    I am not only improving & learning SRE stuff and good practicies but also understanding better London accent.
    I think your best strenght is not the way you speak. It is the speed you speak!

    • @Jims-Garage
      @Jims-Garage  2 місяці тому

      Thanks, I appreciate the feedback. I'm not from London though 😉 Midlands

  • @davechristoffersen6633
    @davechristoffersen6633 5 місяців тому +1

    Great video sir well explained +1 sub

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      Thanks for the kind feedback and support

  • @pavlovsky0
    @pavlovsky0 7 місяців тому +1

    Here’s a catch-22, how do you backup the TrueNAS? If you lose trueNAS pool your data is gone and your backups! Think about getting an LTO4 or LTO5 tape drive and adding that to your setup and cutting your own offline backup tapes. Also, proxmox backup client is great to backup desktops in your local network. Great video!

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      I backup to Google Drive, checkout my rClone video. Your point is valid though, how many is enough when it comes to backups?

    • @pavlovsky0
      @pavlovsky0 7 місяців тому

      @@Jims-Garage fair enough. Check out a video by a guy with the channel name of apalrds adventures. He does a good breakdown of why backing up to tape makes a lot of sense financially (hint it’s when you pull back data they get you with hidden costs). You have all you need to backup to tapes. You just need an inexpensive sas controller and a cheap used LTO tape drive. I got mine from goodwill (thrift store in United States) for like 45 dollars and I’ve been backing up to tape happily. 3-2-1 self hosted!

    • @mikenorfleet2235
      @mikenorfleet2235 4 місяці тому

      I purchased a tape drive from ebay, looking forward to using it with PBS. Got to get that additional "media" instead of just more hard disks and sdds...i think I may be going overboard? Well nothing feels better than peace of mind.

  • @TrimmerCognition
    @TrimmerCognition Місяць тому +1

    Jim. Thanks for all the great videos! They have helped a lot. Regarding the cifs mount, please can you explain the addition of uid=34,gid=34 that you made to the command. Why was this necessary / what does it achieve? Thanks! EDIT- I should have watched the video fully!

    • @Jims-Garage
      @Jims-Garage  Місяць тому +1

      They're user IDs and Groups, they're necessary for permissions. Basically who owns it and what they can do as part of a group. Without that it doesn't have permission to write/read.

    • @TrimmerCognition
      @TrimmerCognition Місяць тому

      @@Jims-Garage Thanks. I just came to edit my comment as I saw you addressed it later in the video. Serves me right for not watching it all through first!

  • @SSBelmont
    @SSBelmont 3 місяці тому +6

    Jim - You failed to mention any details about the use of UID and GID. Is this the user id ang group id of the account on your PBS system on the UID,GID of the user account that owns the SMB on the TrueNas? I think you guys that create these videos fail to realize that a lot of the community isn't as Linux savvy as you guys so explaining the most basic things is very important, especially since so many folks are moving over to Linux from Windows.

    • @JeramiFrost
      @JeramiFrost 3 дні тому

      As best as I can tell, this is the user “backup” in proxmox. My TrueNas id’s start at 1000 and go up. However, in PBS backup has uid and gid as 34 for user backup. Hopefully this helps someone at some point. I located the uid and gid with the following command in pbs shell “for user in $(cat /etc/passwd | cut -f1 -d”:”); do id $user; done”. Remove the first and last “ mark from the command.
      Edit: after watching the video further, Jim goes over this detail explaining exactly what I found on my own.

  • @Hombre1968
    @Hombre1968 5 місяців тому +1

    Excellent video, do you have a similar video for restoring a backup?

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      No, sorry I don't. It's extremely simple though. Restore backup from PBS storage (select storage in tree, navigate to backups, select a backup and hit restore)

  • @FilipeNeto616
    @FilipeNeto616 23 дні тому

    As usual, very detailed and helpfull content. However, one doubt arises. How does the pbs prune options and proxmox backup retention works together? Let's say in pbs I configure the datastore to keep last 5, and in proxmox I define a backup with a keep last 10 retention policy. How does that work?

  • @michaelrichardson7277
    @michaelrichardson7277 Місяць тому +1

    Appreciate the video and step-by-step instructions. May I ask if you have a process for backing up, at a minimum, the configuration of the Proxmox host?

    • @Jims-Garage
      @Jims-Garage  Місяць тому +1

      Thanks, I don't back up the host per se, but I do export the /pve folder which is pretty much the same thing. I do also run the host on a raid config for redundancy.

  • @user-vm2bu7hn1i
    @user-vm2bu7hn1i 7 місяців тому +1

    Jim, Great video as always. Just a question, is there's a way to use ProxMox Backup Server with a cloud storage provider to get backups off-site? To have local and cloud backups.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Thanks, I will need to check. The way I do it is to backup my Nas to the cloud using rClone (I have a video on that).

  • @dimitristsoutsouras2712
    @dimitristsoutsouras2712 5 місяців тому

    Nice presentation. What needs to be clarified here is this. PBS does the deduplication automatically without any configuration from the user right? The storage though of the PBS isn t owned by him but its a remote one coming from TrueNas. Shouldn t you show or mention that deduplication has to be enabled on the dataset which is then mounted to the PBS? I m pretty sure there is an option at TrueNas when you create a dataset, where you enable or leave it unticked (default option if I can recall) in order for all this you want to accomplish to happen?

  • @arronpitman6323
    @arronpitman6323 24 дні тому

    I appreciated the prune joke

  • @ryanmalone2681
    @ryanmalone2681 Місяць тому +1

    I came for the backup tutorial but stayed for the magenta cardigan!

    • @Jims-Garage
      @Jims-Garage  Місяць тому +1

      There's a whole ensemble to work through, Jim's Cardigans coming soon!

  • @lmmartinez97
    @lmmartinez97 2 місяці тому

    Hi! I just deployed this without thinking too much -I know, should've researched thoroughly first- and created a dataset in my TrueNAS machine without a quota. Does the chunk operation effect the entire zfs pool in which the dataset is stored? Or just the dataset itself? I'd be rather sad that I botched everything in my NAS due to trigger happy noobing. Thanks!

  • @repairman2be250
    @repairman2be250 7 місяців тому +1

    Thanks for the video. How do you go about to backup your Proxmox installation?

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      I don't, but I do run it on a raid mirror, and I have 2 nodes. You can backup by cloning the pve folder is my understanding

  • @sohail579
    @sohail579 Місяць тому +1

    Love the way you explain. One question. Is it still ok if my NAS is also on the same host?

    • @Jims-Garage
      @Jims-Garage  Місяць тому

      Yes, that's fine.

    • @sohail579
      @sohail579 Місяць тому

      @@Jims-Garage Awesome thanks. have you done a video on restoring from backups? also i noticed you dont really run containers more so VMs is there a reason for that?

  • @bigup7777
    @bigup7777 4 місяці тому +1

    great video, thank you! if pbs is a vm in the proxmox cluster, would you recommend backing that up to itself as well?

    • @Jims-Garage
      @Jims-Garage  4 місяці тому +1

      You can, but it's probably not needed as it's quick to rebuild

    • @bigup7777
      @bigup7777 4 місяці тому +1

      @@Jims-Garage thanks. Have used the video to backup to unraid server. Works well. Looking forward to the de-dupe! Subscribed!

    • @Jims-Garage
      @Jims-Garage  4 місяці тому

      @@bigup7777 that's great, thanks 👍

  • @cezaryjuszczyk7269
    @cezaryjuszczyk7269 4 місяці тому

    Can you write how we should create scheduler for backup VM ? Use mode stop or snapshot ?

  • @AceBoy2099
    @AceBoy2099 4 місяці тому +1

    Ok, i just followed this to a "T",everything worked fine while setting it up, as soon as i finished i tried to do a "run now" in the backups tab of proxmox and it errored, now pbs is showing [bad request (400) unable to open chunk store 'Backups' at "/mnt/truenas.chunks" - no such file or directory (os error 2)].
    What happened?
    I figured it out, in the fstab i put "/mnt/Backups" (dataset name) instead of "/mnt/truenas" (directiry name). Fixed that then rebooted to check and its working now.
    How do you have darkmode on pbs window? Is that from your os/browser, or is that a theme in PBS like i have on my PVE?

  • @mjmeans7983
    @mjmeans7983 Місяць тому

    Does the deduplication work across multiple client machines? Scenario: I have a dozen client machines that are all nearly identical, but very large. Some very large files that rarely change, and when they do they change in small ways that may not be common between the clients. Some clients will also have some large static files that never change. When backing up all the clients, will whatever files that happen to be common between them be deduplicated in the overall backup storage? i.e. Not just deduplicated within each machine's history, but deduplicated across all histories of all machines in the datastore?

  • @jenniferw8963
    @jenniferw8963 8 днів тому +1

    What do you think about virtualizing PBS on Synology NAS? The fast storage is already there and the snapshots as well. I have a 42TB of storage on my DS1522+. I can add some more RAM as well, for the VM.

  • @anthonydelagarde3990
    @anthonydelagarde3990 6 місяців тому +1

    Brilliant video, thank you! Question, I am not clear on the following. If my physical Proxmox server dies with the backup server being virtualized as a procedure building a net new host and importing the pbs vm? Any docs on this. Thank you for your video!

    • @Jims-Garage
      @Jims-Garage  6 місяців тому +1

      Rebuild Proxmox, recreate PBS VM, attach the existing NAS with all your backups. Voila!

  • @ttuschak
    @ttuschak 3 місяці тому +1

    would pbs run also in a lxc container? or do we indeed need a vm for that? - thank you for your answer

    • @Jims-Garage
      @Jims-Garage  3 місяці тому +1

      It shoulf work in an LXC, albeit a VM might be a better choice.

  • @facetofaceid
    @facetofaceid 29 днів тому

    I think that to activate trim you should have selected "Discard", not "SSD emulation". The latter just tells the guest system that it's running on a solid state drive even if it's not.

  • @Glatze603
    @Glatze603 7 місяців тому +1

    Hi Jim and thanks for this tutorial! With some (not all) CT I have the problem that the backup sems to be 30-50 GB. When I backup the containers on local storage they are only 500-700 MB. Seems that one file tells PBS that it is so big, although it is not.

    • @Glatze603
      @Glatze603 7 місяців тому +1

      I have to correct my comment: the local backup of my ct is 305 MB, if I backup it up to my PBS, my proxmox shows it is 559 GB big and my PBS shows it is 520 GB big (on my PBS I only used503 GB for all backups)?!? Whe I click "file-recovery" I see, that the directory "root.pxar.didx" seems to be 520 GB. I hace this issue with 4 of my 5 CT and till now now solution, so I only use local storage for backup.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Interesting, I will have to look into that.

    • @Glatze603
      @Glatze603 7 місяців тому

      I hav set up a new PBS as VM and used my truans-share, too, but the result is the same (see above). Seems that backing up lxc to pbs is not the best choice...

    • @Glatze603
      @Glatze603 7 місяців тому

      When I run "zfs get all 'DATASTORE/subvol-MY_LXC_ID-disk-0" on my proxmox, I get "used: 1.37G, available: 6.63G, compressratio: 2.21x" > seems all ok.

  • @mattpowell3287
    @mattpowell3287 2 місяці тому

    G'day Jim, great videos mate.
    Got a question...I have an issue where PBS throws the following error when I try and add the datastore: "parameter verification errors (400) max-depth: schema does not allow additional properties". Not sure what this is all about as I have added a datastore using your method on another implementation of PBS with no issues. I googled this with no luck. Any chance you have seen something like this?

    • @Jims-Garage
      @Jims-Garage  2 місяці тому

      Sorry I haven't seen that error before. I think it's literally what it says though, one of the parameters is incorrect.

  • @mithubopensourcelab482
    @mithubopensourcelab482 5 місяців тому +2

    The other benefit of PBS is that you can restore a individual file if required.

  • @tonypilborg
    @tonypilborg 2 місяці тому +1

    Wow @Jim: You are running a 2-node cluster... In itself a little dangerous.
    But then you add than your PBS is running in that cluster!!! If a node goes down in your cluster, it is more likely than not, than you will not be able to start the other node - because it will not start VMs until the cluster is up!
    Now you have the data on your TrueNAS box - but no access to the PBS that owns these data.. Lets keep our fingers crossed that you stored the encryption key safe - and not on something that relies on our cluster being operational :)
    I would always argue that running PBS virtualised is slightly risky, and should only be done if you are certain that is will always be operational.... In a cluster is even more dangerous, but in a 2-node cluster, that is suicidal.. (and then what happened to the 3-2-1 rule??)

    • @Jims-Garage
      @Jims-Garage  2 місяці тому

      Thanks for you comment, all valid points, but points that I am aware of and have prepared for. None of my VMs auto fail over, largely due to passthrough anyway. All keys are backed up and easily accessible when needed. I have extensively tested recovery for VMs and as mentioned in previous videos, I don't really care about VMs, those are quick to fix. What I care about is data, and all of that data is abstracted from the VM and can simply be imported when needed to fresh VMs.
      Eventually I might go triple node.

    • @tonypilborg
      @tonypilborg 2 місяці тому +1

      @@Jims-Garage I wasn't worried on your behalf.... It was more reflecting on the teaching/role model aspect of it.... That some (probably inexperienced) will see the video(s) and replicate, without being aware of these pitfalls :)
      Otherwise - like the video 😎

    • @blinkitogaming
      @blinkitogaming 2 місяці тому

      I’m quite interested on understanding the recovery process with a virtualized PBS instance.
      Actually I just have a Proxmox node with a couple of VMs. Let's say that I do the PBS vietualized way on my node and for some reason one day my node dies.
      Will I be able to spin up a fresh Proxmox node or a PBS fresh install rather as a VM or a barebone, configure the SMB storage and that way restore those backed up VMs?
      Or will they be somehow linked to the first PBS instance that died and I won't ever have access to those backed up snapshots again to be able to restore them?
      Thanks in advance guys!

    • @tonypilborg
      @tonypilborg 2 місяці тому +1

      @@blinkitogaming The backups are not linked to the PBS server - so you can always attach the storage to another PBS, and have access to the data.
      However - you can setup an encryption key (this is done in the "Storage" tab on the PVE server)... And if that node is lost, so is the encryption key. So either go for a trusted (or walled, where access to your data is limited to the PBS server), or make sure to store the encryption key in a safe place (actually, like with all backup - in more than one - safe place :)

    • @blinkitogaming
      @blinkitogaming 2 місяці тому

      @@tonypilborg thank you for your response, I appreciate it!

  • @basdfgwe
    @basdfgwe 7 місяців тому +1

    I'm going to need to watch this later, because my 2 node proxmox has so many problems with backup (there's errors that I have been ignoring for a while) . I'm doing a daily backup of the VMs etc.. and I keep 7 days, one node seems to be working fine the other always has errors.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Interesting, share some logs and I can help to diagnose

  • @joseajimenez5669
    @joseajimenez5669 2 місяці тому

    smb share storage 3tb but only show 27gb on pbs ??? any idea why??

  • @casavieira3443
    @casavieira3443 6 місяців тому +2

    Hello Jim 😊
    I'm writing you from Lisboa in Portugal.
    Can you please do a small video explaining how can I restore my proxmox from the backup?
    Or even restore a VM from a backup.
    Beacause 90% of the times I do have problems during the restoring process and not on the backup process.
    I'm new to the proxmox I was using Harvester but I realized that thing was consuming memory like crazy. And I can't affort that.
    Thank you.

    • @Jims-Garage
      @Jims-Garage  6 місяців тому

      Yes, I'll come back to this in the future. Wow, you're brave running Harvester at home! I do love the idea of Kubernetes inside Kubernetes 😂

  • @jeytis72
    @jeytis72 7 місяців тому +1

    Can I install PBS on my PVE and use PBS to backup to an external usb disk instead of TRUENAS? Thanks for your video. Very neat!

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Yes, that should be possible. Just change the data store location

    • @jeytis72
      @jeytis72 7 місяців тому

      @@Jims-Garage By the way, just to make sure that I got it right, you put your truenas credentials in .smbcreds. IP 192.168.6.2 and "Freenas" are respectively your Truenas IP and its folder where files are going to be saved to. Right? Thanks again.

  • @magnerugnes
    @magnerugnes 7 місяців тому +1

    Great video. Is it possible to add Corosync in pbm? So I can use a pbm on bare-metal as my third cluster node achieving quorum? Thanks!

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Thanks. Yes, it's just Debian 12 under the hood, should be able to install the binary without issue.

    • @magnerugnes
      @magnerugnes 7 місяців тому +1

      Cool, perhaps I'll try that. Is there a reason why you choose VM and not LXC for installing pbs in this video? LXC seem lighter to me. @@Jims-Garage

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      @@magnerugnes you're right, it is lighter. However, I prefer the portability, security, and ease of backup with a VM.

  • @p1ngvin1
    @p1ngvin1 7 місяців тому +1

    Great tutorial, got me up and running! But what happens if a hw fail occurs on PVE (and then also PBS)? Could you simply spin up a new PVE and restore all the backups, including the PBS?

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      Yes, you can restore a new PVE from an existing PBS. However, if PBS failed, you'd need to rebuild PBS first, and specify your existing NAS store.

    • @p1ngvin1
      @p1ngvin1 7 місяців тому +1

      @@Jims-Garage Do you know if there is a tutorial for this?

    • @Jims-Garage
      @Jims-Garage  7 місяців тому +1

      @@p1ngvin1 you've just done everything that's required. You need to mount the folder to PBS from the Nas, then add the data store in pve

  • @BillCClinton
    @BillCClinton 5 місяців тому +1

    I have a few VM's on a single PVE. Can I run PBS on the same PVE that my VM's are on? I will be using a synology to store the backups. What happens if the PVE machine dies with the PBS VM on it? Thanks so much for these great videos. You're a natural.

    • @Jims-Garage
      @Jims-Garage  5 місяців тому +1

      That's exactly what I'm doing in this video, and I give the reasons for this (which seems a similar setup to yours).

    • @BillCClinton
      @BillCClinton 5 місяців тому

      @@Jims-Garage Thanks! I will give a go tonight?

    • @BillCClinton
      @BillCClinton 5 місяців тому +1

      @@Jims-Garage Works perfectly! I was using the regular backup and it was eating away my synology space. I like keeping the last 10 copies, so this is saving me a ton of space. Thanks!

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      @@BillCClinton you're welcome, glad it worked out well

  • @fousay
    @fousay Місяць тому +1

    I have a question, I am planning to implement this in my cluster but I am having an issue with the difference between adding NFS Shared storage and this backup Server? Whats the difference?When you say it will save space does that mean this method saves space but also restores faster?

    • @Jims-Garage
      @Jims-Garage  Місяць тому +1

      This performs incremental backups (only backs up new files each time, this saves space). Using an NFS does an entire backup of the VM each time. This also has deduplication which saves space when files are similar. In short, use it.

    • @fousay
      @fousay Місяць тому +1

      Will do! Also I have about a 4 PC cluster, when setting up this backup should I setup HA?

    • @Jims-Garage
      @Jims-Garage  Місяць тому

      @@fousay you could do yes. I assume you're saving to a separate NAS?

  • @JulianBrennum
    @JulianBrennum 3 місяці тому +1

    Quick question: what happens if the Proxmox Storage Server get's corrupted, or the whole host goes down. Is the backup still easily accessable if you spin up a new one? Or is it the server that holds the "encryption" key?

    • @Jims-Garage
      @Jims-Garage  3 місяці тому +1

      You can create a new PBS and add the same credentials, that's fine.

    • @JulianBrennum
      @JulianBrennum 3 місяці тому +1

      @@Jims-Garage Perfect, thanks!

  • @DudeItsDallyBoy
    @DudeItsDallyBoy 7 місяців тому

    can you make a video on the proxmox mail gate? Kinda curious what that does.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Not something that I have used as I don't want to host my own email server. It does sound useful though.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Not something that I have used as I don't want to host my own email server. It does sound useful though.

  • @AceBoy2099
    @AceBoy2099 11 днів тому +1

    Ok, my PBS seems to have broke. How do I go about reinstalling and importing the current backups to the new install?

    • @Jims-Garage
      @Jims-Garage  11 днів тому

      You should restore PBS from backup, failing that reinstall it and import the same encryption keys as before

    • @AceBoy2099
      @AceBoy2099 10 днів тому

      @Jims-Garage I got it sorted out. Turns out my lvm was full and wouldn't let the VM start. I found a video on how to move the VMs to another "storage pool" and that got me going. Since initial setup I'd upgraded the pve ssd and was able to expand the local, but can't figure out how to get the lvm to expand, maybe I can't since local took all the allocation?!
      All that aside, could you do a video sometime on how to do those options, since pbs couldn't start I didn't have a way to restore a backup and have no idea how to re/install and import the existing backups to the new install.

  • @ierosgr
    @ierosgr 5 місяців тому +1

    Since TrueNas (at least scale) supports deduplication itself, what is the point of doing all these extra steps (of creating a middle step with proxmox backup server) instead of just adding as backup storage TrueNas itself and choosing the storage options accordingly.
    Also at 6:47 you should check discard as well in order for trim to work properly.

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      Good question. From my understanding and experience, deduplication of differential backups is smaller than deduplication of full backups.

    • @ierosgr
      @ierosgr 5 місяців тому +1

      @@Jims-Garage So the key word in Prox Back Server is differential while TrueNas only does it on full backups?

    • @Jims-Garage
      @Jims-Garage  5 місяців тому +2

      @@ierosgr proxmox ve does full backups, proxmox backup server does differential (and deduplication)

  • @MarcMcMillin
    @MarcMcMillin 7 місяців тому +2

    #1 liker :-)

  • @Glatze603
    @Glatze603 7 місяців тому

    PBS is not showing used size, although I mounted the share as backup-user and -group (34)?!?

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Interesting, what's it showing?

    • @Glatze603
      @Glatze603 7 місяців тому

      @@Jims-Garage 655,36 KB! No error messages in syslog, no other idea...

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      @@Glatze603 have you performed a backup or just scheduled one?

    • @Glatze603
      @Glatze603 7 місяців тому +1

      @@Jims-Garage both. I already have over 200 GB of data in the ".chunk" directory and permission is backup:backup

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      @@Glatze603 strange! I guess it's still working though?

  • @demorez5
    @demorez5 5 місяців тому +1

    unfortunately it seems you cannot backup to PBS the VM which actually hosts the datastore. I have set up my datastore based on the video (but used NFS instead of Samba) and everything works fine except backing up my NAS VM which is actually hosting the datastore. I guess its because PVE stops the VM for a second and the share disappears. Interestingly the same backup structure works when using a simple network share (without PBS) as a target

    • @Jims-Garage
      @Jims-Garage  5 місяців тому

      Yes, I suspect that's right. However, are you backing up a NAS to a NAS? My NAS is my backup with a mirror in the cloud.

    • @demorez5
      @demorez5 5 місяців тому +1

      @@Jims-Garage yes, backing up the NAS OS (OpenMediaVault) disk to the drives attached to the NAS.
      this may sound stupid at first glance, but the main reason i am using OMV is that i can individually read each drive from any operating system and i can attach pre-filled drives to it. was thinking several times about switching to TrueNAS and ZFS RAID, but that would always require a machine able to host 4+ HDDs to read the data. I can read all data from my NAS even from a windows laptop.

    • @Jims-Garage
      @Jims-Garage  5 місяців тому +1

      @@demorez5 zfs requires a minimum of 2 drives for raidz1. Do you have any redundancy in your current Nas?

    • @demorez5
      @demorez5 5 місяців тому

      @@Jims-Garage yeah, don't worry. generally i use snapraid, but have regular offsite and B2 cloud backups for important data (which are actually the VM snapshots). actually i think its pretty overkill for a bunch of movies i am never gonna watch

  • @collectorguy3919
    @collectorguy3919 7 місяців тому +2

    I would want to do a test restore, assuming the Proxmox Backup Server VM is unavailable (eg: destroyed in the same hw failure). It seems reasonable to expect a new PBS using the same NAS backend would just work for the restore, but I don't know that. That's assuming a PBS is actually needed for a restore. Proxmox might have a handy recovery utility.
    BTW, incremental backups and deduplication are different concepts, but they compliment each other so well that making a distinction perhaps only belongs in pedantic comments.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Thanks, yes I'm aware that there's a nuance between the two but I didn't want to derail too much. I have covered those concepts in previous videos.

  • @jeremywiginton2502
    @jeremywiginton2502 7 місяців тому +2

    So, your explanation of deduplication is incorrect. Your definition is simply an “Incremental” backup - i.e. backing up just the files that have changed. Deduplication is actually not backing up all files that are the same across multiple sources - i.e. if you’re backing up multiple VMs of the same OS, it would only back up a single copy of the files that are identical across all VMs.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Yes, you're correct, and this approach scales further when you're looking at SANs, Cloud etc (amazing what Google does in this space). I didn't want to go too far down the rabbit hole of definitions but appreciate there is a distinct nuance.

  • @ruwn561
    @ruwn561 7 місяців тому +1

    You are confusing incremental backups with deduplication ; it’s not the same thing.

    • @Jims-Garage
      @Jims-Garage  7 місяців тому

      Thanks. I appreciate it isn't, I've covered the nuance in previous videos and didn't want to go down the same rabbit hole again. However, PBS does use deduplication when performing incremental backups.

  • @antonfelin
    @antonfelin 5 місяців тому

    адский акцент у тебя чуувак. Учи английский