Building a Low Energy Virtualization Server for Your Office/Homelab with Proxmox

[@smashogre4766]

I'm new to this channel and was wondering... anyone else find this kinda, well, soothing? The steady, calm delivery works! Great video, really enjoyed the content.

[@nyanates]

Y he’d be a great ASMR artist.

[@byt3swap375]

I built a virtualization server using Proxmox a few years back using the same motherboard and a similar 2u case a few years back. Added an old quadro w/ PCIE passthrough for video transcoding and the thing works like a dream. It's been awesome a first "real" home server, running absolutely everything I need (with exception of a separate storage server) and has had pretty much zero downtime since building. The one thing I will say for anyone looking to use this board or similar (if you can find a deal on a several year old board), that passive heatsink really doesn't cut it if you aren't in a 1u case with loud high static pressure fans. I ended up designing a 3d printed fan mount that just pressure fits on the top of the heatsink, with a 20x40mm noctua fan blowing down on the heatsink. I haven't seen the CPU exceed 50c since installing (used to hit high 90s and throttle), and everything is still nice and quiet.

[@bobkoss280]

All the stuff that you did off camera - is exactly where I'm stuck.

[@Tias2505]

does that mean proxmox is not free?

[@myblogginglab]

@@Tias2505 Uts Free to Use but if you need support you need to buy license

[@aliasname2257]

I know this video is old but I was wondering what equipment you might recommend instead now in retrospect.

[@stephanweinberger]

@9:15 the IO-shield is not so much about airflow (notice that in your case you have a large vent right above it) but for EMI shielding. Also, if power consumption is of concern I'd rather use a PSU with Gold or Platinum rating. Especially under partial load those are much more efficient. Alternatively: dont oversize the PSU that much. If the system is only going to draw ~50W you're better off with a PSU in the 150-200W range, as it will run closer to its most efficient operating point (usually around 50-60% load). @30:45 the updates you get without key are those from the base Debian system

[@Illuminali4all]

Ratings on PSU's, I'd honestly argue, make a negligible difference.

[@stephanweinberger]

@@Illuminali4all Well, it does make a difference if - under partial load - the PSU has 50% (which many cheapo PSUs have below 30% load) or 80% efficiency. E.g. the server uses 100W - PSU1 (50%) will draw 200W from the wall, whereas PSU2 (80%) will only draw 120W.

[@lsatenstein]

Hi NewYorker. How are you doing? I do hope the Corona virus has skipped over your household and that of your close family. I must say that I follow your presentations as a matter of course. I am a retired old IT guy, with limited need. And that need is to enjoy watching talented people like yourself. Regards from Montreal, Canada

[@davidg4512]

Hey Jay, the proxmox team added a way to apply network changes without needing a reboot. Click apply configuration button. However, I should note that it will ask you to install a package, which will need a reboot (but only one time after installing it). Now you can make future network changes without ever needing a reboot.

[@LearnLinuxTV]

That's good to know, they're always making improvements.

[@sandmanmok589]

You can install ifupdown2 in proxmox Then success

[@reedux4753]

@@LearnLinuxTV Its worth noting that the apply changes will cause all running vm/ct to loose network status so you will need to restart them or just restart the host machine like you normally would

[@JoePlomo]

Whoever may need this build guide; the part they need is exactly what happened @ 16:03 off-camera. The people that know how to do that part don’t need the rest of this video, so I’m not entirely sure who this video is for

[@ianrobertson912]

Thanks for the video. This is bit expensive. I have used Lenovo Tiny 93P got from ebay for US$125 and changed to SSD256BM and 16GB Ram. This set up cost me less than US200. It is core i5 Gen 2 cores 4 threads and work well for over a year running a) Debian-> Docker-> Home assistant to control 200+ devices running heaps of automations b) VM to run Blue Iris on Win7 with 10 cameras + Unifi controller for my unif network. I do have a HP Gen8 server with SAS drives (4)+ 8 Code (2 process) +24GB system configred proxmox but not running it as it uses over 250w and my Tiny PC uses less than 40w (my network rack use only 75w with Tiny 93P+ Synology 213 NAS+ Unif USG+ 2 PoE AC-Pros+ Modem+ Netgear Switch+ 3 Hubs for energy monitoring and home automatons). I am sure your system use more than 50w. So there is cheaper ways to get thing going and that does not need lot of power.

[@Shadepariah]

I would add a few case fans with that board so the CPU doesn't overheat. Those fanless boards are designed for 1U cases with push pwm airflow

[@_TbT_]

Shadepariah The M11SDV-8C+-LN4F does have a CPU fan.

[@EsotericArctos]

@@_TbT_ There is a model that does, but the one in the build in this video is no fan and he specifically says that in the video. With that said, I am sure the one case fan will work pretty well in this case.

[@stevearkwright]

Agreed - That chassis had room for one more fan at the front and it would be wise to add another couple elsewhere (even fixed together). Once those virtual machines start getting busy in real-world situations, processor temperatures rise exponentially, getting really hot - then you need multiple fans to ramp-up and push/pull all that heat out. It didn’t seem likely that was ever going to happen in that guys’ set up, though.

[@MichaRutkowskiEngineering]

I also did 55W 4 years ago, but i went for cheaper option. I am using ASROCK j1900 motherboard with 16GB of ram, the TDP of the CPU is 10W. To that i added 1tb HDD for proxmox and 3x 2tb for ZFS NAS, currently on openmediavault with sata passthrough. I have added a second NIC to access two networks because i did not wanted to go VLAN, and recently a 5th HDD, it's a 10tb drive for cctv and computer backups. I am waiting for mini pcie SATA card to attach it, currently it is on USB adapter, without the 10TB i measured it to be also 55W with 4 HDD drives. I am planing to replace it as soon as i will purchase a solar power installation with my HP z620 workstation with Intel Xeon 12 thread CPU and 16gb of ram. The cpu is 10 times weaker than yours but it was fine even for plex transcoding from 1080p. And i also run Proxmox ;). For network i went Mikrotik, with HEX S as a main router (because of it's 450mbit/s ipsec performance) and two RB951 series for WiFi and i am waiting for hAP ac2 for my main wifi since those two are meant to serve all the smart things in my house.

[@MrNoBSgiven]

Can we expect a follow up on how this server has been doing since installation?

[@ToadalSimplicity]

Would love to see this as well

[@dariopetrusic4215]

Please note that usually when a server part (CPU, HBA, NIC...) comes with a passive heatsink it doesn't mean that this is enough but requires some amount of airflow to be properly cooled. I strongly suggest you to check the CPU temperature because if in idle it should be fine, I can almost guarantee that under load at 55W and without any airflow it's thermally throttling like crazy!

[@LearnLinuxTV]

Noted. I will keep looking at it and take your advice if I notice any issues with that. Do you think the heatsink is easy to remove and replace, or is it proprietary? If it's necessary, I'll investigate this.

[@etherx8604]

@2:54 minor nit-pick: "order of magnitude", unless explicitly specified otherwise, is factors of 10. 11690 is not even one order of magnitude larger than 4338

[@ridingpresident]

Did nearly the same setup like you with AMD Ryzen 2000 CPUs, not much power consumption and samsung NVMe's. You should always buy the pro versions when there is a lot read/write activities on it. It is so powerful that you are able to run multiple Windows Servers (+ Domaincontrollers) without any issues. Great for smart comercials.

[@psycl0ptic]

AMEN on samsung pro SSD.

[@jankkhvej]

@1:22 55W here is the TDP, which stands for Thermal Design Power (or Point). You can't use this as a power consumption/usage value. It's a completely different characteristic.

[@Mr.Leeroy]

At first I though it was not measured too, but actually it is there 36:35

[@cls9474]

I've just built something similar some months ago: 5 x 512GB M.2 SATA SSD (PCIe-Board), 4 x 4TB WD Red, Supermicro X11SCL-IF with IPMI, Core i3 9100F (4 Cores), 2 x 16GB ECC and be quiet! Pure Power 11 400W PSU within a Fractal Node 304 case. My system idles at *22 Watts* and is pretty quiet. Services running as LXCs on Proxmox: haproxy, mqtt, influxdb, node red, grafana, nextcloud and gitea. The systems will get two additional backup drives attached to a M.2 PCIe 2 x SATA controller soon (waiting for the M.2 controller board to arrive). The backup drives are only powered up when a backup is due to keep the power consumption low. The power consumption is even so low, that it doesn't draw power at all when the CPU throttles down thanks to the caps within the power supply. This seems to confuse my CyberPower UPS :) (I have the suspicion that their PowerPanel software has a division by zero bug). Currently I could bridge power outages of about 4+ hours. I built this system because my previous HP ML330 G6 Xeon with 5 spinning drives drew 105 Watts (not that bad actually for such an old and huge system) and was awfully loud. It's great that it's finally possible to build such real low power systems - even with nice headroom (the above i3 has some punch when needed - not as much as your system though). The long UPS times are a nice side effect to the lower energy consumption. The nice thing about the motherboard is its built in IPMI/BMC as yours seems to have as well.

[@williamp6800]

Nice server. You can do this on a budget if you go with used server parts from ebay. Or to do it cheaper and really low power, do it on a Raspberry Pi 4. The model with 4GB of RAM can host six or more containers. Under $100 and 5 watts. The Self-hosted podcast is a great source of info. And Rapberry Pi are the only way to build a cluster without going broke.

[@CaptRR]

Yeah thats kind of what I am thinking of doing. Though I do find it annoying that most of the servers I see on ebay seem to use 2.5 inch hard dives, which does drive up the cost of storage a bit.

[@williamp6800]

CaptRR rather looking for a complete server, consider looking for suitable MB, RAM, and CPU. Then put it in whatever case works for you. If you don’t need rack mount, and you want space for a lot of 3.5” drives, a Fractal Design 804 (8) or Define R6 (11) or R7 (14) are options. With the Define R6 and the R7 you will have to buy more drive sleds as I think they both only come with six sleds. And with all of them there’s room for three more 2.5” drives.

[@williamp6800]

CaptRR look for SuperMicro X10 series motherboards. One generation back from current. Use DDR3 ECC RAM which can be had off eBay for about $100 for 32GB. Most models have 6 SATA ports but the X10SL7-f (mATX) has a built in 8 port LSI controller for a total of 14 SATA ports.

[@barbarella7028]

Wow. I never knew that you could mount ISO images in the Supermicro IPMI. Thank you!!

[@180doman]

For arround 200-300$ you can buy Fujitsu PRIMERGY TX120 S3P. Small Form Factor, Xeon cpu (like ex. E3-1265L), ECC Ram, 4x2,5'disks bay, 2xGbps nic, remote access. I think its even better deal than HP Microservers.

[@frnzis]

Nice video, thank you. How about remove a node from cluster?

[@jaywillis4063]

Jay, if you were building this VM server today, what components would you use? Any feedback would be great!! I appreciate the videos!

[@Hellenios]

For common home use is enough to use old laptop with i5 or i7 and 16GB or even better with 32GB of ram. It will be much more cheaper and is a good start. You really do not need to spend 1K$ to start. Just make sure that the processor is normal M, H or HQ version. The ultra low power U versions are not very good for this task. Proxmox is definitely what you want to go for. Its easy to use free and stable. PS I am using i5-3230M with 8GB RAM and 500GB HDD and it is working 24/4 for a year with no downtime with 3 VMs and several containers and have still overhead for more...

[@LearnLinuxTV]

VERY good point! Funny you'd mention this, I recommended using a laptop to a friend of mine recently, whom was concerned about power usage as his house has sporadic and unstable power. That's another use-case for a laptop as your VM server as well.

[@bertnijhof5413]

I use and used ZFS on cheaper Silicon Power SSDs; one 128 GB SATA-3 and one 512 GB nvme. I never had any issues and in both cases I booted Ubuntu on ZFS from the SSDs. The SATA SSD was running in a 2008 HP dc5850 (Phenom II X4) through a $8 SATA-3 PCIe card on PCIe 2.0. The nvme SSD (3200/2300 MB/s) was running on a Ryzen 3 2200G on a $60 B450 motherboard. I'm using and boot from ZFS since 2018! I even use ZFS on my backup server with 2 IDE HDDs and 2 SATA-1 laptop HDDs all in raid-0 to maximize space and used for ~1 hour/week :). The backup server boots from the raid-0 (IDE 250 + 320GB; SATA 2 x 320GB); is in use since June 2019 and it is a 2003 Pentium 4 HT with FreeBSD 12.2. ZFS is rock solid and runs even on my potatoes!

[@keithpatrick4173]

It's a Samsung bug, auto scrubbing trashes the fs.

[@MarkCarline]

I wonder - How are you CPU temperatures? I just got the same board and seeing (what i think) is too high temperature of around 80c, I just ordered a "Noctua NF-A6x25 PWM, Premium Quiet Fan, 4-Pin (60mm, Brown)" and going to see if that will help. I tried a 4cm same fan and that reduced the temperature to around 32c

[@sanjeewasamaranayake]

Great video. I am not sure if your power usage info is correct. 50W is very low and only a machine like Lenovo Tiny will come close to it. My Tint M93P with 16GB and 256GB SSD with no CD and one NIC uses about 40W. Core i5 4570T is rated 35W. How much power your Dell was using? Are your measurement power usage monitored from power plug. I have all my devices connected via Sonoff P2 plus with Tasomta -> Home assistant. I am planning to migrated to a Dell Optiplex 7040 Core I5-6500 rated 65w so based on what you are saying that low end SFF will use more power than users (In that I have Nvme drive). I do have HP ProLiant DL380 G7 Server 2x Xeon L5630 2.40GHz 24GB RAM 4x 72GB SA and has two power supply of 360W but I have not tested power usage. Could you kindly measure your actual power usage for the server as I cannot belive with cooling fans etc yours can be 50W

[@MatthewYakel]

Wow this is fantastic I’m in the planning phase of upgrading a clients existing HP DL360 G8 servers. Now I’m thinking I may build them some. Also planning on moving them from ESXi to Proxmox. Thanks for sharing everything.

[@4eversr]

I have a vmWare ESXi 6.7 virtualization server running since 2015 now which only consumpts 17W with 4 vms running simultaneously (2x win10, 2x ubuntu). (CPU i5-4590T, 8GB RAM, 2128 GB SSD Storage, 90W PicoPSU, Asrock Z87E-ITX Mainboard in an Kolink Satellite Mini-ITX case)

[@peterbratu]

you can always sacrifice compute power to save energy. it all depends on your use case. in this case, you can even do with a Rpi4 cluster.

[@parnashish1910]

I keep coming back to this build! Nicely done.

[@GilbertMendoza]

So, now that you're almost 2 years in, how did you end up liking the AMD Epyc 3251? I liked this build and was thinking of using the board for a similar project. It's a nice combination of power efficiency, upper RAM limit, and compute. Anything new catching your eye?

[@foxale08]

I built a cluster of nearly identical servers to this almost six months ago. I need more RAM (64G isn't enough) and the crucial sticks used are dual rank, which kills the speed when four are used. I'm looking at two 2r8 64G sticks.

[@GilbertMendoza]

@@foxale08 Nice. I'll be doing the same very soon for the RAM. I ended up buying this board and built a Proxmox server as well. I hadn't been real familiar with it until your videos, and so far I really dig it. Running like a champ! I've had so many brown outs, surges, and moderate power loss in the area, so it's been great having confidence that my UPS keeps it up with minimal power consumption.

[@foxale08]

@@GilbertMendoza Not my videos, just providing helpful feedback lol. I personally use APC SMT2200's but am leaning towards SRT3000's or even a small APC Symmetra.

[@GilbertMendoza]

Haha, I didn't look close enough.

[@wkm001]

​@@GilbertMendoza What did you end up paying for the board? Everything I see is $500-$900.

[@wesstrater4094]

I am looking to install Proxmox for the first time and rather confused about drives/storage. So far I think I need 3 types of storage. 1) The boot drive which could be a USB but thinking M.2 SSD. Not too sure how big though. 2) ISO and template storage. I have heard that can’t be local. Not sure why I can’t put ISO images on my M.2 boot drive. 3) VM hard drive. I am thinking a pair of NAS hard drives with ZFS/RAID 1. Any thoughts or suggestions? I am looking to run Docker, Kubernetes and other developer tools for learning.

[@ztech-consulting]

I run proxmox also and this video is great. However, i looked up the price of this board and wowza. It's not a cheap one! My proxmox runs a Ryzen 2400G and for my purposes it works exceedingly well! Furthermore, will the cpu run cool being passively cooled? Especially under load?

[@akurenda1985]

Running an average of 50 watts, I doubt it'll break a sweat.

[@Roeland54]

I have build a more budget friendly proxmox host with a ryzen 5 2600 last year. Running my nas, homeassistant, docker-host and some test vm's. I am very happy with it. Nice video!

[@Xzb3917]

If im not wrong, the reason you don't have any output when joining the cluster is because the http certificate is changed on the server who join the cluster (it is replaced by existing certificate of cluster). Anyway good video, i order this motherboard today

[@vertujoe2886]

I got exact same chassis as yours. Sadly it's the most terrific build experience ever.

[@parnashish1910]

Great build. Why not use a Noctua fan and a bigger case? You can increase your power consumption and number of threads as well by a tiny bit without affecting noise or electricity bills significantly.

[@foxale08]

I did an almost identical build but actually went with a smaller case. Size was the major factor for me.

[@Kannulff]

Hello Jay, thank you for this content. Could you please share your approach for backup Proxmox server settings and how restore them in case of storage failure. Thank you.

[@xillibit-v2m]

The EPYC Embedded 3251 has a controller ethernet 4*10 GbE integradted but on the supermicro motherboard they have just put 4*1 GbE by adding an i350 ethernet controllers

[@ramhee98]

Cool video! But I think that the price performance ratio isn't good with the M11SDV-8C-LN4F

[@trekkie1701c]

Heh, I did pretty similar to this build myself. This was pre-Epyc so I'm using a Supermicro A2SDi-8C+-HLN4F instead but it's a pretty low power setup. CPU is 25W TDP, whole thing with four hard drives and two Raspberry Pis attached via USB only eats around 60W of power. I've been very happy with it, and I might've gone with the Epyc board (perhaps with a lower core count at a lower cost if available) had that been available at the time.

[@jankkhvej]

@8:38 Although it's a passive heatsink, the system should have adequate airflow going through the heatsink. Chassis fans are required for that type of heatsink. You just can't run it hoping that passive airflow will be adequate.

[@CharlesCromer]

He installed a fan... watch the video

[@TheKefas95]

TDP is not a power consumption, is amount of heat which CPU produce on max load

[@happygimp0]

It is not really max load. There is no standard way to measure it and you should not compare Intel TDP with AMD TDP, they are measured differently.

[@TheKefas95]

@@happygimp0 You're right. I heard about it. But TDP is definitely not a power consumption

[@happygimp0]

@@TheKefas95 It is more marketing than anything else, like most other numbers of PC-Parts.

[@bwzes03]

TDP = Thermal Design Power, which means the Thermal solution you need to use to cool the CPU, should be able to at least dissipate the number of watts listed. Recommending a better cooler capable of better cooling than that. Intel measures its TDP at base clock, while AMD measures at max boost clock.

since this case doesn't have proper front to back airflow, cardboard air duct between front fan and motherboard should drop temperatures without adding more fans

[@groundbeef662]

How do they work out that yearly running cost of 9.13, I realise it may not be at 50w 24/7/365 but if it was that would be 438kw per year, which in the UK would be closer to 150dollars.. is electricity crazy cheap in the Us ?

[@davidnickel3949]

umm, drives are not listed . i have a am3+ 8320 so with 32 gig you can run 12 vms on a 8 core ty for this. I want to run openmediavault(nas) ,ipfire,pi-hole,htpc will try with v7 of proxmox at some point as right now i only have 12gig ram, 1 ssd120gig,1 1tb media disk,320gig hd vm,iso

[@adrianstephens56]

Curious, I've been using Samsung SSDs (including 850) as my ZFS root & boot device (probably for years) without any errors reported. Both my current Proxmox servers are similarly (e.g. ZFS root on Samsung 860 pro 2 TB SSD) set up.

[@kbhasi]

I forgot low power AMD EPYC SoCs existed! Also, I can't remember when in the video you mentioned that ZFS isn't for everyone or something along those lines, but that reminds me of why I used BTRFS. It's hard for me to believe that I initially decided on hardware RAID when building my first custom NAS, but used BTRFS RAID instead, and when the secondary SATA controller on its mainboard died, I was still able to recover my data on another mainboard thanks to myself choosing to go with software RAID instead of doing it in hardware. That does mean I replaced the mainboard in my NAS, but because the rest of the previous mainboard still works, I was able to repurpose it in a different case with different components as a secondary always-on PC, that just like my NAS, runs regular Debian, but unlike the NAS, has a limited set of components in order to free up more system resources since that second system would just run one specific service, whereas the NAS runs multiple services and even a full Trinity session over a VNC connection.

[@dillanteagle3726]

You mentioned you finalized on a 1TB SanDisk Extreme Pro (NVME) but in yout install setup your using the samsung SSD Drive? So which are you using and installed proxmox with? Reason I ask, proxmox is failing to install at the the first stage of clean up root disks 0% complete. When using the NVME SSD drive as the target hard disk in the proxmox install. Basically, the install fails and the machine reboots.

[@horusofoz]

Could you please provide a recommendation for a similar build with capability for Plex transcoding?

[@testthisfordecficiencies]

You need an actively cooled cpu. These types of heatsinks are for cases that have a high throughput put of air from front to back. I believe this motherboard is designed for small 1U Supermicro cases.

[@LearnLinuxTV]

I'll keep that in mind, and monitor it. So far, no issues. This video was filmed quite some time ago (before the Pandemic) and due to current events it took me a long time to get it uploaded. Since the video was filmed a while ago, I've spent quite a bit of time with it and have had no issues whatsoever. Super stable. My monitoring system hasn't detected any problems and it's just been great.

[@testthisfordecficiencies]

@@LearnLinuxTV Thays good to hear. I assume the low TDP makes it so it doesnt get too hot. I have the same case and after some time found that its air flow was not great. Luckily no issues though. Happy building!

[@GGBeyond]

Thanks for the video! I plan to run servers for virtualization eventually. Videos like this one give me ideas on how pick out the hardware.

[@jannejohansson3383]

Now I know where my internet comes, from LearnlinuxTvs "internet ports". Awesome mainframe.. Todays small componet's are great but of course I like "real" servers, big ones! More noise and SAS is like scsi; making confusing situations when some things error oculus Colosseum kevyttoppapuku kurva happens..

[@majorgear1021]

How would you organize storage? I'm planning on have an ssd OS disk, an ssd disk for VM's, and a set spinning hdd's stolen from my Synology to manage with a virtualized TrueNAS server. From my reading, when you pass a controller through to a VM, it's the entire SATA controller. Meaning. Proxmox will no longer be able to use since the VM has control! I like the idea of a supermicro server, but I want to virtualize my gaming PC. When I looked at their site, I didn't see an offering that either lets me fit a standard atx mobo/GPU, or a complete system that has the z690 chipset for gen 12 i7 CPU. It would be great if they supported atx cards and GPU ( just have a riser card to fit a 2-3U chassis, but they don't yet. I could not find a single Xeon processor that people recommended for gaming, so I went with an Fractal R5 tower Case and MSI motherboard. It doesn't slide into my enclosure, but it sits on a shelf sideways, lol

[@ApostolosPolymenakos]

Thanks for a very useful video. I can't seem to find the link you mentioned at the end of the video about the new hard drive, there's nothing about hard drive in the notes or in the parts list that you shared.

[@netdevnick]

How much does this cost to build normally? Prices are insane right now

[@Sco1t_]

The sticker with the password is a consequence of a relatively recent law in California mandating use of more secure default security settings. Given manufactures have to use unique passwords there they might as well do it for everywhere.

[@davimalagutte]

Hi I have the sticker but what is the user name? I m stuck here I tried to ADMIN and double the pwd and didnt work

[@nikiforossarantoglou5917]

Thanks for this type of content, they are very insightful!

[@CristobalRuiz]

This! This is exactly what I look for in good content!

[@peterg.8245]

I’m just wondering why an efficiency build uses a low efficiency power supply? Why not 80+ Platinum? Couldn’t cost more than that motherboard!

[@peterg.8245]

Some random Best Buy fan? Why not a Low Power Noctua that will last? Even those 2 extra ram sticks will increase power draw unless 4 channel memory will increase power per performance

[@jeytis72]

Very good. Any chance to see a Proxmox video tutorial series? Thanks

[@For4Reel]

OmG where did you get the board, 700$ is not cheap - i build a ESXI VM Server for 500$ on Rycen Platform in the same formfactor with also Low Power Usage.

[@constantinamundsen2487]

i have a passively cooled virtualisation host, at max it was able to run a minecraft server with 4-8 players and 276 Mods, now its just running a webserver and mailserver. Im Saving up for an epyc build, in the next 2-3 Months i hope my little HDD and SSD dont fail XD

[@dillanteagle3726]

does anyone know a good source on what to do after the server is on? I cannot access the ipmi interface or for sure know which IP it is? Did you connect over lan from your laptop to the motherboard? You said you did this in your PSN server, what is your psn server? how did you configure your DNS for the IPMI interface. I have not hooked up any keyboard or screen to the motherboard because im assuming the dhcp should allocate temp on the initial boot...

[@MarloMitchell]

So the CPU cooler doesn't require a fan?

[@kirkgould5075]

whats the advantage of more than 1 ethernet port? can it route multiple lines of 1gig? if so wouldnt it be bottlenecked by a normal 1gig LAN?

[@Jr-hv1ct]

HI Jay, Have a question looking to setup a home lab but will be a single host for virtualization and storage sharing i am not sure how to go about setting things up. My initial so far have installed Proxmox on nvme drive have an ssd for cache and log , another ssd for vm and container disks and 4 x4b in a zfs pool for storage. I have created a few vm but not sure how set and share the storage among vms, should i set up a file server to use the zfs poll storage and share the storage that way or is they a better way , thanks

[@sanjeewasamaranayake]

Need one more clarification. In my Tiny M93P I have two LVMs and I have 3 USB devices (Wyze sense devices, Combee2 Zibgee stick and Bluetooth Dongle connected with USB passedthough to my LVM that is running home assistant (Debian -> Docker-> Home assistant). My Proxmox in Lenovo Tiny is version 5.2.1 or similar. When I have my Optiplex 7040 set up I will have the latest proxmox 6.1 as I will be doing that install new. Do do I need to upgrade my existing proxmox to 6.1 to join the cluster and to migrate LVMs? Also do I manually need to do all USB passthrough to USB sticks I have or will those get configed automatiicaly as part of migration process? Thanks in advance for your help

[@biskero]

I am planning to use Proxmox to run an hackintosh which is currently the main OS on my machine. Also want to add freeNAS. So the machine would run Proxmox and freeNAS to have a HAckintosh running Catalina. What I am trying to figure out is the Raid strategy on freeNAS. From what I understood is good to have a setup with Mirror 2 or more Raid, but the details of the Raid are still confusing. I do not care about performance much but more for data integrity of the backups/storage on the Raid so which configuration would be a good start? thx

[@priit7777]

But do you need proxmox subscription? What you do not get if you don't buy one?

[@JoeyBaby47]

I have a Supermicro SYS-5019A-FTN4, but after I install the ISO and try to boot it, it just continues to do a boot loop saying there is nothing to boot.

[@donjenkins2465]

So I bought this motherboard after seeing this video... But, do you know if I can registered ECC memory in the Supernicro board with Proxmox??

[@eikebloemsma9416]

It would really be intersting to know what the real power consumption of the whole assembly is. Has anybody measured this?

[@NeilWaybright]

He had the whole server plugged into a Kill-a-Watt meter and the total draw from the wall was 55W. Are you asking about something other than that?

[@satstube]

Great video thanks, so into low powered labs at the moment perfect for always on workloads

[@LearnLinuxTV]

Absolutely, and my power usage has gone down quite a bit since I've started lowering my power usage. I've been looking for cost-savings throughout the house when it comes to power.

[@tubefulable]

Did you experience any "unkown PCI Header 127" bug when using GPU Passthrough? My Epyc 3251 from Asrock Rack didn't release a BIOS update to fix that bug. Does the SuperMicro board work with GPU/PCIe Passthrough?

[@robertwells3797]

What would you advise as a massive upgrade?

[@kevinjj406]

The epyc 3201 is good but i don't know where to buy this card. Can you make a video comparaison with this Motherboard and a ryzen configuration to show us the différence (watt and benchmark)?

[@stanmoore9171]

Enjoyed low energy virtualization and low energy storage server videos. Is there a reason not to do both in the same hardware? If not, maybe a video on a combined machine? Case and MB suggestions in particular.

[@LearnLinuxTV]

No reason in particular, it all depends on what you want your homelab to look like. Your storage server can be a VM if you want. But then, you also have your storage on the same physical device as your VMs. In my case, my backups are on a separate storage server which is important to me. But everyone designs theirs differently.

[@AnFv86]

I would like to know the temperature of the CPU in full load with this heat sink!

[@grahambo-42]

Jay, I could use some advice. I just setup a 1u implementation of this server and am stuck. Shortly after selecting the install option on the proxmox splashscreen I am getting watchdog notices for all 16 cores and the install goes no further. I have tried installing other operating systems (ubuntu, debian, older versions of proxmox) all with the same stalling problem. Any ideas?

[@elcajonboy]

You should NOT have a problem with using those sumsung SSD's with ZFS. I have quite a few of them in different vdevs under ZFSonLinux.

[@LearnLinuxTV]

I did have an issue though. I don't remember the error now. But when I looked it up, a lot of people were having the same issue. I agree that it shouldn't be a problem, but it was.

[@kumakell]

@@LearnLinuxTV I've also never had ZFS issues on non-enterprise equipment, either. I'm running pretty much purely consumer drives, with no errors. I *am* very incredibly careful to avoid SMR HDDs, which *will* cause major problems with basically any form of hardware or software RAID, though that's getting harder and harder every day without spending more and more per-drive/GB.

[@iankearns]

So the trade off is the cost of running against the high build price??

[@AndreiNeacsu]

Any new server MB must have at least one SFP+ cage or a 10GB RJ45 NIC. There are many that don't and all those should not be considered. PS: People complaining about the price tend not to understand that an 8-core CPU is included in that exact price. Sure, you can build a much cheaper and more capable Ryzen 2700 (65W TDP, but you can undervolt and undeclock) on a B350/450 MB, but you lose IPMI and ECC RAM support, which are well worth the cost.

[@mariotubelecce]

Hi man, nice! You blurred out the mac address of your nics from IPMI but not from proxmox :) Notice also that now netword does not need reboot if you use linux bridges, just install package ifupdown2 and the GUI of proxmox will apply all the changes without reboot(finally!!!)

[@MrGedijama]

Hi mate could you please share what NVME you this project. Thanks

[@ramikilany9279]

Perfect Video! If you could please have a tutorial about the Proxmox replication between two servers and if one is down how to automatically switch the VMs to the other one.

[@LearnLinuxTV]

Noted! When I get caught up I might consider that.

[@neccros007]

I started to build a small extremely tight budget VM box using a ITX board and a 45W Xeon in a Supermicro mini tower. Its not a server grade board but it does have dual NICs that can be teamed and 4 3.5 drive bays if I want to do a VM NAS. It also has 2 spots for SSDs and space for another with an adapter. I have a 9207-4i4e HBA in IT mode controlling the back plane while the internal SATA ports handle the SSDs. I cannot afford a SOC based Intel or AMD server board so this will do. I am limited to 4 core/8 threads and 16 gigs of ram. What are some examples of VMs and number of VMs you think I can get away with running on this setup with Proxmox?

[@sulaimanaldarmaki4773]

Thanks for the video.. can you recommend another mini itx case with front disk bay for installing ssd disks?

[@Nightykk]

Got an AsRock A300, with a Ryzen 2200G APU, 16GB 3200MHz RAM, 512GB m.2, was just a couple hundred euros. With a couple of VMs running it's currently clocking in at 14-16W on the wall. Me wanting to get something "slightly more powerful" than a Pi3B+, and still keep the power low, definitely succeeded I'd say. Sure, with this Epyc you got 8c/16t, quite a lot more than my 4c/4t, and you got more expandability as well, seeing as the A300 only has 2x m.2 & 2xSATA (for 2.5" devices). :p - However, there's m.2 to 4x SATA adapters out there, so if I ever need to then I'll look into getting such one, and then figure out something about powering them.

[@101pcgamer]

Hi I’m looking to build home server lab nas system , are you still useing the same server or you found sum thing better? I’m looking for sum thing that don’t you too much power so my power bill don’t go though roof lol

[@dustinkrejci6142]

Can the PCIE slot on the motherboard handle a dual 10 Gb at full speed?

[@serviceaccount7559]

Is it ok for you to keep R610 in the room? Its not to loud for you? :)

[@byranotieno]

I am curious, how do you set up valid ssl/tls on local servers? I saw your old proxmox server has a valid ssl cert installed.

[@blessendor]

Proxmox GUI has own Let's Encrypt SSL install control menu: Server / System / Certificates / ACME

[@tctn]

@@blessendor Hi Oleksandr. I couldn't make it work. Can you suggest any guides to achieve SSL on Proxmox GUI?

[@H-RutherfordHill]

Can this CPU transcode videos in Plex? I have a handful of Plex users that access my current server.

[@keithpatrick4173]

These drives work with Zfs but you have to turn off auto scrubbing

[@Pabula]

I really want to undestand where Virutaliztion is worth it, i really want to get into it, but i dont know where it will be useful.

[@salaciouscreations4323]

I was the same then I lost my job and needed to reduce my electric bill. So I built a i7 3770 32gb ram on an intel motherboard. I basically run mirrored mx500 500gb for the VM storage mirrored mx500 1tb drives for my web server. And 5x 8tb zfs2 raid. So I was basically able to get Pfsense firewall Pi hole Open media vault Nas Debian Lemp stack web server Debian based Plex server with 1050ti for tanscoding It's high on the ram but the cpu hasn't ever gone over 30%. I literally had a server for each before so it's massively cut my energy use.

[@thorstenfricke3257]

a wonderful video!! thank you so much! what is your opinion about unraid?

[@rickybayu]

Awesome, can u make a video how to use proxmox to set up 5 server inside? thanks

[@r.e.434]

How many machines can you run of this machine now?

[@simonlove99]

Not trolling, genuinely want to understand the thinking here ... I'm not quite sure why the drive for low power here? - the cost difference shown for running those cpus was only $4 per year and the spend of $300+ on the new CPU doesn't seem to stack up as a cost driver. As comments call out, that board costs a fortune. So, I'm interested to know why the driver for low power usage here. If its eco friendly, suspect you could plant a lot of trees for $300. So if the old one was all good and working, not sure I get the push to swap it all out, but have low power as a major selection factor.

[@LearnLinuxTV]

Low power usage was just one factor, not the entire reason. I also wanted something quiet that can be in the studio with me, benefit from some speed improvements, and overall just test what low-power is like in practice. I realize that it's not practical for everyone.