Proxmox Cluster Repair: CEPH OSD Replacement

How to replace bad drive in CEPH pool on Proxmox. At first it might sound scary to do but actually it is easy process aslong as you follow the instructions. Complete steps in specific order.
Chapters:
00:00 - Intro
00:15 - What i am working with
01:26 - Mark drive as "OUT"
02:39 - Mark drive as "OFFLINE"
03:23 - Destroy OSD
04:12 - Replace physical drive
05:46 - New drive is in
06:27 - Adding new drive into CEPH Pool
08:46 - The End Chat
#proxmox
#ceph
#proxmoxcluster
#homelab
#homeserver

[@bast7486]

suuper easy to uunderstand. Great Work. :)

[@esmailbosspro8066]

I get so excited when you post

[@jwspock1690]

TNX for the video

[@techadsr]

My three node Proxmox cluster had a ceph cluster using three USB attached 1TB nvme drives, one per node. I was experimenting with it as a reduction in single point of failure vs NFS on a Synology NAS. Ran fine for about a week. Then one drive "failed". Quotes because testing the drive after removing it showed it was good. Maybe it overheated? Unknown but Proxmox ceph said it was down. Thought about how I would repair it but ultimately didn't find out how to replace the one failed drive. Now that you've shown how before it actually fails hard, I may rebuild the ceph cluster. If the failure happens again, I'll try to replace it using your example here in this video. Thanks

[@zippi777]

Thanks as always for these usefull guides!

[@kristof9497]

Thanks for the video.

[@PerNilsson1]

Great video!

[@yarinik]

Thank you for the video

[@eovermeer]

Great tutorial, is this the way to go to replace my 3-node Ceph disks from NVMe 256GB to 1TB?

[@heselmas]

Should work.

[@hafizrafiyev6935]

Hello,why did you reboot pve1 in order to replace osd disk?is reboot mandatory?

[@MRPtech]

If your proxmox nodes supports "hot-swap" of drives then you don't need to shut it down. In my case i have 3x Beelink Mini PCs. I can't replace a drive while node is running. I need to shut it down -> replace the drive -> start node