How to Install TrueNAS in Proxmox with HDD Passthrough!

[@throwaway3756]

lsblk |awk 'NR==1{print $0" DEVICE-ID(S)"}NR>1{dev=$1;printf $0" ";system("find /dev/disk/by-id -lname \"*"dev"\" -printf \" %p\"");print "";}'|grep -v -E 'part|lvm' Might want to put that in the description. NOTE: This whole Truenas on a VM/Container thing is not the way to do it. Use Samba or NFS with Proxmox or put truenas on bare metal. This is not the right way to do things. You have been warned.

[@nate4537]

massive time saver. thank you

[@Newton492]

Thanks so much bro

[@PrezentEnt]

You are the best bro . For us newbies trying to learn its a must to write this things down separate from the video.

[@YushiSora]

thank you sir

[@ignaciocastillejo]

THANKS

[@cheesecakestudent]

adding sirial numbers saved me from an issue i had been dealing with for weeks lol. Thanks!

[@evelyntech]

@8:40 "Im just gunna Nano in" ProxMox Shell command is: "nano /etc/pve/qemu-server/101.conf" where 101.conf is the name of the actively running config.

[@alnic123]

Thanks, that part was so confusing.. idk why he needed to cut out the 2 seconds where he shows that command...

[@jdb6284]

you just saved me man.. techhut dropped the ball here bigtime

[@buitrung1084]

thanks mate! you rock

[@prutje]

as soon as i save the file with the serials in it (cntl+x / Y for overwrite) i loose my disks in my truenas container! what am i doing wrong? btw im using NVME drives

[@TDephflame]

@@prutje delete the space before "serial" and it will be fine.

[@FrenziedManbeast]

I posted 6 months ago on this video, but I wanted to come back and thank you AGAIN for making this video - I just replaced a failed drive using this same method removed bad disk and added the replacement using the same method, giving the replacement drive the old scsi id. Fired up TN Scale VM -> Degraded VDEV -> Replacement -> Resilver started right up.

[@TechHut]

Hell yeah

[@ErikS-]

One of the most usable videos I have seen in the last year. Thanks for helping out!

[@bogregory8260]

Nicely done sir. I've watched several videos that work to do this and yours was clear and consise. You helped this noob get where he needed to go. Thank you!

[@childishhalbino]

This video helped me gain confidence that the article achieved what I wanted! You're a legend!

[@gnajmacz]

I did it, but it took me a day to realize its shortcomings. TrueNAS doesn't have full access to the disks, resulting in checksum errors, and it also prevents me from monitoring the disk temperatures. According to my research, the ideal solution is to acquire an HBA card and apply PCI passthrough to the virtual machine. I've ordered such a card and intend to experiment with this method.

[@Jasper_S]

This! and i'm a bit surprised he didn't cover it in the video as a disclaimer of sorts

[@nigel3018]

@@Jasper_S here for this, i want s.m.a.r.t info

[@pubdigitalix]

iXsystems always recommends avoiding the use of raw disks passthrough because the guest does not have direct physical access. It's a BIG NO NO !!

[@womacko]

Which HBA did you end up buying? I was using an "LSI Megaraid SAS 9261-8i Controller" for hardware RAID5. However it seems like it's not supporting HBA (according to Broadcom KB ID: 1211161496893) and I need to buy an new card. My mainboard supports a "ASUS PIKE RAID Controller". Can I achieve an equivalent result with it?

[@womacko]

coming back to answer my own question: In general it is possible to use a RAID-Controller as HBA, but it must be flashed in IT-mode. Not all RAID-controllers support that! I went with an "ASUS PIKE 2308 / Broadcom/LSI 2308 / AOC-S2308L-L8".

[@delboyg01]

Great tutorial, I follow this and got the drives passed through to Truenas Scale OK Edit to add. You can overcome the backup issue by excluding the drives from backup in the Proxmox drive details page. So the there is a way around the problem in the following paragraph. Only one word of warning, when using this method and trying to backup the VM with the Proxmox backup tools, the backup will include the Truanas VM AND all the data on the ZFS drives too. No problem if it's a small array, but I doubt many want a 7TB backup mixed in with their standard VM backup process!!! If you pass through a PCIe controller, or the complete Motherboard SATA controller (not available as a boot drive in that case), then the Proxmox will only backup the VM and you can arrange the data backup as required.

[@Jasper_S]

Can't you just exclude the drives from the backup?

[@delboyg01]

@@Jasper_S - No you can't. Once the drives are passed though, using that method, they are treated as a part of the VM. Edit to add: I stand corrected, I just checked and the drives can be excluded from the backup in the 'Hardware' Drive details. I have learned something new today.

[@alkistsakos6794]

@@delboyg01 Thank you for your corection. If you care plz edit the original comment so that others can be informed!

[@Reza1984_]

The only guy that talked about device ids on youtube, thanks I was having trouble with this

[@tompestak6530]

one thing that tripped me up momentarily - I had my TrueNAS VM running while I was passing through the disks. After passing through the disks in proxmox I did a "reboot" of the TrueNAS VM and it recognized the drives but not the serial numbers so when I tried to create a pool it told me the disks had non unique serial numbers (presumably because they were all null). I found a forum post that said you had to do a full power cycle, not a reboot. Sure enough, that solved it.

[@Marcoabmarques]

Great video, just one thing I learned here: Passing the HDs individually and not the entire controller means that the True NAS cannot obtain SMART information from them, preventing the system from warning in advance if one of them is in pre-failure condition. It didn't stop me from assembling and running the system, but it is an important feature to avoid a disaster in the pool and to allow the HD to be replaced in a scheduled manner. In my case, I will buy a SATA controller to make the TrueNAS work properly. Cheers

[@DedesFewscres]

can you educate me on why a SMART information is needed foor the truenas - because there is SMART informatin in datacenter>pve. why is there a need for a different one?

[@kirksteinklauber260]

Thanks for the great video and easy to follow!. I just did it on my side with TrueNAS scale and worked like a charm!

[@archpenguin6646]

Yeah I did this for a while. I just put TrueNas "scale" stright on the machine now. couldn't be happier! cool video though!

[@naveenchandra6526]

0:30 what is that dashboard.

[@rsmith8733]

I am also interested to hear what this dashboard is!

[@KrisHoobergs]

Maybe it's nice to have the commands somewhere in your description. I'm struggling with the long command at 5:55. It doesn't show me my drives but is just displaying a ">" . So I'm stuck at 5:55. Please advise

[@dobrzpe]

guess you didn't look in the description under the "Proxmox Wiki..." link. that page as ALL the commands as well as SEVERAL ways how to get the drive info...

[@lesapotres4340]

Thank you so much for these instructions. The very best in regards to setting up a raid disk on Proxmox TrueNas VM. Exactly what I needed to get going on our new server. It worked for me even while using TrueNas Scale. God bless you for your time in making this video!

[@jew10400]

Love your page between you and Network Chuck , I am well rounded , love how you simplified this.

[@BIRDIE_PSEW]

Did you ever make a video about your Dashboard found at 0:30? Been looking through your videos but i just cant find it

[@charleswheatcroft]

That is incredibly useful. Thank you for taking the time.

[@danielsauriol]

Thanks a lot for your video. Your clear step-by-step explanations allowed me to add a passthroughhard drive to my TrueNAS VM , which is on Proxmox........ Thanks a Bunch !!! -dan

[@0589651]

Extremely useful and concise guide. Hugely appreciated.

[@PatrickHallermann]

Excellent tutorial on installing TrueNAS on Proxmox. Thankyou very much

[@dandumbrill5711]

Awesome video! Thanks for the step-by-step. Very easy to follow and best of all it worked.

[@wildmanjeff42]

You can run Truenas in Passthrough mode with virtualization, but it is recommended you run straight on hardware. ZFS can and has done some weird things with passthrough in my experience. It does work, but I would only recomend for testing and homelab use, but - good luck. Thanks for the video.

[@jaxxarmstrong]

Agreed, considering the unusual issues with ZFS in a virtual environment, even with pass-through, TrueNAS should be installed on bare-metal in anything beyond a limited homelab usage IMHO.

[@AndrewSpec]

@@jaxxarmstrong what unusual issues? I had only one when I tried to backup the VM and proxmox accessed passthrough disks. Just unchecked backup of that disks and it's working fine for now.

[@fishmeat69]

in my experience, you face issues when drives are passed through like in this video. the recommended way (which is supported by iX) is to pass through a HBA - this way truenas has full byte level control over the disks

[@JunglistPrefection]

Can I dual boot with TrueNas scale on baremetal and Proxmox on an separate ssd inside the same system?

[@fishmeat69]

@@JunglistPrefection You can, what would your goal be though?

[@elthongonzalez6345]

This video helped alot! Now my TrueNAS can read my hard drives :).

[@lamefofof]

I have installed proxmox 8 on a home server (old gaming PC) got into proxmox and tried to use lshw but it says it cant find it and wont install it because it cant find the package. Any ideas on how to get that part to work?

[@Nehemoth_G]

You need to first change the repository for updates

[@postnick]

I know it’s hardware dependent, but I install proxmox on nvme drive and I just pass my SATA controller though and works the same but with fewer steps.

[@PizzaGobbler2024]

Doing it this way that gives me the idea that buying a cheap sata PCIe controller for truenas makes sense then.

[@spyro47]

​@@PizzaGobbler2024 Check your iommu settings before going this path. If you are having a consumer grade motherboard this will add more complications.

[@Streetzlegend]

I am planning to do this since my nas drives controller are in the same IOMMU group as the host/proxmox SSD, installing a separate HBA card im hoping would allow me to pass it through. @@PizzaGobbler2024

[@Nico-r2z]

how to set this up in a way that the 3 drives can be used by other vms as well? Maybe setting up the raid in proxmox and passing throu the pool it self?

[@VincentWestberg]

Great Video I have struggled with USB passthrough. I have it working but not like that I am going to go this route and see if it is better.

[@vincentdamico4227]

Thanks for the video my man. I was digging through the wiki, but figured I'd give the youtube search a shot!

[@russellmm]

ckear and straight forward explanation. Nicely done!

[@stacks353]

Do you plan on making a video on your Container setup?

[@yank9467]

Why everytime I add the serial it deleted the disk from proxmox

[@jordanluellen9667]

Someone else posted this solution and worked for me as well @michaelarthur8417 "space after the comma. Removed it and et voila"

[@BackBackForwardLightning]

I got unable to locate package lshw. How fix?

[@jayzn1931]

Thanks! How do you manage drive spindown in this case? Do you do that on proxmox or does it work in truenas? Also I'm a bit annoyed that SMART values can't be read by truenas with scsi passthrough, but as I don't have a pci controller for my drives, for now I will have to check that in proxmox (where it works).

[@jayzn1931]

Actually I got it working by passing through the sata controller of my mainboard now, for anyone interested. TrueNAS now has full access to the drives. Spindown works, but only after you set the system dataset location on the boot drive of truenas, not the pool.

[@Maisonier]

Did you manage to solve the S.M.A.R.T. problem?

[@jayzn1931]

@@Maisonier Hey, maybe you didn't see the comment I made: I fixed it by passing through the SATA controller completely. SMART and spindown work now! System is running without issues for about a year now.

[@hackerman.1337]

What is the Hompage software ?

[@TechHut]

I'll make a video once I get everything set up :)

[@sbsaylors8]

@@TechHut That is a sweet dashboard - in case you don't make a video can you give us the app?

[@Whiskey7BackRoads]

@@TechHut Second on the app you used for dashboard???

[@Lfmpaes]

Such a great and straight forward video. Thanks for the tutorial!

[@Grid21]

This was a really cool video! I was going to do this myself, but since I was working with an 4790, doing VMs on such an old CPU didn't seem logical and I needed storage more, so I did bare metal install instead.

[@hotshotjansson]

Nice video! What are you running at 1:04 (in Containarr: protainer ?)? What web gui is this? do you have a video for it? thanks!!

[@FrenziedManbeast]

I watched this video awhile back and found it interesting. I came back to follow-up and thank you for making this video - I have 16 x 2.5" SATA SSDs connected via a 16i HBA. My plan was to pass through the entire HBA, but I could not get the VM to boot to TrueNAS - the HBA kept throwing Firmware Errors. So I painstakingly used this method and copied each ID + serial, and it worked immediately.

[@Streetzlegend]

I was having this same issue when trying to passthrough the HBA of my server, it turns out its related to the IOMMU groups, it appears that when you pass through a device, the entire group is included and since in my case the drive used for Proxmox was part of the same group as the SATA controller for the NAS drives, then it would crash Proxmox. This solution seems to be the best next option, OR adding an separate controller and hope that it ends up in a different IOMMU group.

[@FrenziedManbeast]

@@Streetzlegendmy 16i HBA ONLY holds the raw storage drives - the OS and assorted other drives I use for VMs or other storage run off the SAS -> SATA breakouts on the board. In either case I got it working so on to the next problem! =)

[@arthurkepler1284]

Thank you! The proxmox wiki docs leave a lot to be desired. (what is "592'? Why use -scsi2, etc.)

[@kolrising]

1:05 What software does this GUI beling to?

[@SergioVelasco85]

Really good guide, thanks!! But is there any specific reason of why you used TrueNas Core and not Scale?

[@TechHut]

For this installation I already have a dedicated VM for docker, but I'm definitely going with scale when I install it on hardware.

[@staciebutka2340]

can't see the lsblk cmd can you added it to description?

[@haszoka]

Instant sub

[@notsrynot]

Dude thank you so much for this, your videos lands so perfect for timing as I plug away at tweaking my homelab. Just swapped my Perc6i with an HB200 in IT mode so I can finally start my server config but I’ve been bottled necked at getting the drives set up properly for TruNAS to see them. Im only about halfway through the video but skimming through I think your method will work. Love Low-Res but his way of doing it didn’t seem to work for me. And it’s weird because we have the same hardware he’s just doing it with SSDs where as I’m using SAS drives

[@jimskyboy2]

Interesting way of doing it, I just finished moving my truenas over to a new proxmox instance, I used a separate 4 Port Asmedia sata pciE setup and just setup iommu... 2 8TB drives and a 1TB cache drive... Mirrored on a Z620. This does help though, I could directly pull the drives instead of running them through a controller.

[@chrisumali9841]

Thanks for the demo and info. So why did you install TrueNAS Core instead of TrueNAS Scale?

[@thinkingcritically]

Thank you. That was helpful as I was unable to locate my drive in Truenas.

[@portblock]

Honest question, why? I work in production environments and this doesn't make sense to me. Is this a home thing? what am I missing? As I understand one wont be able to migrate the vm to another box in the cluster, and if for some reason the prox host goes down so do any applications/servers that depend on the mapped file server.

[@TechHut]

Home thing. Learn the platform in an environment you already have set up.

[@portblock]

@@TechHut Ah ok, makes total sense now, thank you for not ripping on me because I didnt understand.

[@royprice931]

Did you ever get the drive temp to show in truenas doing this

[@Elrevisor2k]

I read somewhere that the entire SATA controller has to be pass not drives or there will be some issues with the pool losing data. Is that true?

[@beckbrook605]

Thank you for this tutorial, it's clear and easy to follow for students

[@hantuan107]

what is better, passthrough the whole sata controller or set each disk to the VM like this?

[@allogic]

Will truenas be able to read the temperature and smart values of the disks passed though?

[@ThisGreenMonkey]

Great video was looking for something like this and boom u made this amazing video.

[@ryanclarke2005]

So this is being passed through via the sata ports on the motherboard?

[@PoundNetTexas]

Just what I needed to know. Thank you

[@GeekendZone]

This tutorial is perfect, thanks Bro.

[@heybravo23]

What's the difference doing that vs. in the VM go to Hardware then add hard disk?

[@panoshountis1516]

Just wondering, what is the recommened approach between (a) creating a RAID-5 set via the BIOS controller and pass that thru to the VM vs (b) pass-thru raw disks and then create a RAIDZ within TrueNAS?

[@JunglistPrefection]

Can I dual boot with TrueNas scale on baremetal and Proxmox on an separate ssd?

[@basdfgwe]

You forgot to remove the disks from proxmox backups. After you add passed the disks through, go back to vm > hardware > double click each disk that was added, select advance, uncheck back up.

[@TheShenSword]

I tried installing the HDD passthrough, for some reason, SCSi 1 and 2 disappears from the Hardware list on TrueNAS when i save the file with serial numbers. Is anyone else facing this issue?

[@michaelarthur8417]

Yes I currently am. Haven't found a solution. Did you?

[@michaelarthur8417]

I had a space after the comma. Removed it and et voila

[@DerSchwertii]

@@michaelarthur8417 This is Solution i searched for ! Thanks man !

[@RichardBuckerCodes]

what is the point of installing truenas on top of proxmox? Even with passthru truenas could be CPU starved at some point and drop packets/sectors.

[@Nehemoth_G]

To learn something. Just have my first PC for homelab, and I'm trying to replicate a multiple HW setup with only one PC

[@navarrohillsranch]

Great straight forward video, Thank you!

[@Tokentools-weldersAu]

Thanks for sharing, I am a total newb and you helped me get a stellar result :)

[@zr0dfx]

Thanks for sharing this. Super helpful for my nas build. Passing through a controller card as well but I want to use the ports on my motherboard which I can’t pass through via iommu 😊

[@910Jedi]

Awesome video! I don't know where I went wrong, but only 3 out of 4 of my drives showed up as unassigned disks in Trunas. I can't figure out where I went wrong. All 4 of them are showing up as attached hardware under my Trunas VM. Any ideas?

[@mariabjrkb.skaftadottir8669]

all my drives says unknown, how do i make it so i can see what drives is what in truenas, as i had both hdds and nvmes with the same amount of data i cant makeout what is what in truenas when making my pool

[@_Talik]

migrated my proxmox to a new sustem. had to reset my vm because i forgot to plug in one of the disks and thought the drive wasnt been seen as the same thing for some reason. mended it though!

[@whoisdavidpeterson]

Thanks. I finally settled on a Truenas Proxmox combo and this walkthrough was just what I needed.

[@panoshountis1516]

Awesome video, thank you! As I am tight on budget, I am thinking of starting up with a couple of HDD units initially then add more as I go along. Can I utilize the same process tor adding more disks in the future or it is different?

[@in03]

ZFS doesn't take kindly to adding disks as you go (yet). Look into Unraid if that's a requirement or wait until that feature is released for ZFS

[@panoshountis1516]

@@in03 thank you for your reply. Maybe I should opt for a Windows Server VM with RAID controller passthru.

[@ponchobob]

thanks for the video. is it possible to make a raid1 of two hdds and pass "them" through?

[@pr0jectSkyneT]

Is there a way to install the qemu-guest-agent in the TrueNAS Core VM?

[@Thewickedjon]

this is a great tutorial, but, what is the benefit of virtualizing truenas as opposed to just installing truenas bare metal?

[@UmarKashmiris]

Question: I am currently using truenas scale with 2 mirror drives and ssd as a boot drive as my main nas system and now i want to move to proxmox to get more virtualization benefits keeping truenas as vm inside proxmox. I want to migrate existing truenas system to proxmox without any data or application changes? The one option i can think of is, install proxmox and then have a fresh truenas installation as vm and then passthrough existing hard drives to import zfs pool and install all the apps again. is there any better way?

[@mplsgrandamse]

What dashboard is that?

[@PineapplePi5634]

thanks for the video. followed your video and managed to get my TrueNAS VM running on Proxmox. The only part I would improve is to add a 'backup=0' flag in the config file, the part where you pasted in the serial number manually. With the no backup indication and if there is a scheduled backup on the VM, proxmox will skip the backup of all your passthrough HDD. It just happened to me earlier when proxmox attempted to backup all the HDD of TrueNAS when it did not have sufficient space. /dev/disk/by-id/ata-BRAND_MODEL_SERIALNO,size=9314G,serial=SERIALNO,backup=0

[@deanfranz759]

I have two questions about a system failure: 1. What if the system running Proxmox was corrupted (due to any reason) and your TrueNas VM was lost. How would you recover the data that was being stored on the TrueNAS virtual machine? 2. What if one of the drives fails. Do you just add a new drive into the proxmox virtual machine and then boot proxmox and recreate pooL?

[@SpecialMrWhiteWolf]

1. anything that can read zfs can read the data off of your pool so its not linked to on specific truenas VM 2. yup

[@trunkscannon]

when i do the apt install for the lshw app, I keep getting an error of unable to locate the package

[@albertpena946]

HI, i'm facing a similar solution for a new customer and I realy on the maximum speed for the users, becase the fileserver will be used for render applications. Would be the TrueNAS inside the proxmox faster than a for example a NAS connected with the server at 10G?

[@Costel8294]

Hello!For photos as google photos,what its best in proxmox?Nextcloud or Truenas?Thanks

[@sidneyking11]

Is mapping by virtio2 slower then mapping with scsi ?

[@SB-qm5wg]

Do you gain any i/o speed doing this?

[@schraderwebsolutions5713]

How can I add the drive serial numbers after the TrueNas VM is running?

[@marcbrown3922]

First I must say exactly video and thank you for all your hard work, but I have a question I have truenas scale installed in proxmox and I would like to share my pool or smb share with all my media files to my Plex container in proxmox is this possible, If so could you point me in the right direction please..?

[@rsmakishi]

If you aren’t using other SATA devices from that SATA controller you could also just passthrough that controller in the GUI.

[@ricardoccpaiva]

awesome video sir, thank you!

[@RufusCubano]

WHy use truenas to create zfs when you can create zfs directly from proxmox? What's the advantage?

[@_Nico_las]

Why the processor type is KVM64 nad not Host or X86-64v2

[@jasonlee3247]

Not sure why you’re doing the edit with the serial numbers? Just ls -l /dev/disk/by-id/ and copy each drive string into your qm set command

[@geemobile6037]

@TechHut do the drives have to be empty and formatted? I have an old zfs pool in mirror mode and was wondering if I can just pass the disks through as is.

[@jamespierce5466]

no, there is a force button you can check if it detects data on the drive

[@youhannamousa7959]

By passing through the HDDs, would the data be wiped on them?"

[@vladislavkaras491]

Thanks for the video!

[@spoonest]

And how to use the same disks inside Proxmox?

[@Thomas88-_-]

oh man what happens if your drives are full i dont want to format

[@hakStak_charlie]

I had to change the cpu type to kvm64, then it fired up. Thank you!

[@anthonyj748]

I dont know if I did it properly but I ended making a ZFS with the hdds and TrueNas saw it as one disk