Meet the Turing Pi 2 - Mix Pis and NVIDIA Jetsons on a Mini ITX Board!

[@TechnoTim]

What would you do with 4 Pis on one board?

[@Demodude123]

For me, definitely a Kubernetes Cluster w/ Rook + Ceph storage. Can't wait for the upcoming software video!

[@sandsriggs]

Better question for me is what can I do!?!?! My favorite parts of your video was: 1. Watching you peel of the protective sheet…. “Of course I forgot one” 😂 2. Your comment: I’m sure if I’m wrong someone will let me know. I was rolling on this one. Can’t wait for the next video.

[@Diamond_Hanz]

cats and dogs with pyspark

[@Sourcer3r]

Even more Docker in Swarm mode 😁

[@merlingrim2843]

How does this configuration compare with the performance of something like an i7?

[@Pro-cheeseburger]

well this looks amazing! compute at the edge is pretty cool... It was interesting to learn that all Chik Fil As run on a cluster of NUC's sent to each location.

[@TechnoTim]

Sounds like the perfect cluster for retail / food service with many locations, just ship commodity hardware!

[@theglowcloud2215]

Making chicken sandwiches is serious business.

[@TechnoTim]

@@theglowcloud2215 based on the line I see when I drive by it certainly is!

[@gswhite]

Brilliant as always. Happy new year. Looking forward to seeing how you use your new project

[@TechnoTim]

Same to you!

[@liquidmobius]

Really cool! Where's the video covering the software setup? Can't seem to find it.

[@TechnoTim]

Soon!

[@jasonryals2560]

@@TechnoTim I appreciate all your videos man. Have you by chance posted the software setup yet?

[@BigKens]

This is super cool Tim! Amazing you were able to get your hands on it. Can’t wait to see what projects you have in store for the Turing Pi 2! I think some kind of hyperconverged setup would be neat where you run a three node Kubernetes cluster on the Pi’s (k3s) and then leverage Jetson for some AI or ML workloads since the NVIDIA Container Toolkit >= 1.7.0 (nvidia-docker2 >= 2.8.0) you used for your GPU passthrough video now supports Jetson with Ubuntu 20.04 + arm64.

[@novellahub]

Happy New Year Tim! I hope you are keeping warm with the below zero weather in Minnesota.

[@TechnoTim]

Haha! -10 today! Thank you!

[@peterchaploutskiy2555]

Home version of "Blade system" nice!

[@ClassicGOD]

According to EVGA website fan on this PSU has "ECO" mode - when enabled it should not even spin until 40% load and I don't think this cluster will ever reach 220W. So you can enable ECO mode (switch next to the main on/off switch on the PSU) and don't really concern yourself with the PSU fan.

[@TechnoTim]

Good call! Discovered that button after the video!

[@VeniVV]

I literally just bought the 4 bay version rosewill case to put my old itx into. Big fan. Do note that I swapped the fans out for some noctua 80mm ones

[@TechnoTim]

so did I in this vodeo!

[@VeniVV]

@@TechnoTim ya I commented like 30 seconds before you did the fan swap >.< shame 🔔

[@TechnoTim]

All good! I love play by play comments!

[@stephenkbolton]

So excited to get a hold of one of these.

[@EthanLington]

Love to see the channel growth brother, keep working hard! 🙌

[@TechnoTim]

Ethan! Thanks man!

[@PrimeRedux]

I have a similar PSU in a 2U case powereing 9 HDDs with the fan up against the top like that. It's been running for months without issue. I have a actual 2U PSU to replace it with but I haven't gotten around to it yet.

[@TechnoTim]

Nice! I later figure out that the lid is vented!

[@DaPanda19]

Any progress being made on the new video?

[@inertia186]

15:15 For the front fans, I heard that early revisions of the Turing Pi 2 had backwards fan headers. Maybe try reversing the polarity.

[@nccyr1]

This is exciting! Really looking forward to the next part.

[@TechnoTim]

Thanks!

[@NormanTheDormantDoormat]

@@TechnoTim Is there a follow up video to this? My search skills appear to be lacking.

[@johnjbateman]

Dude!!! I want one. Been waiting months!

[@TechnoTim]

Soon!

[@MarkMenger]

Were you able to publish the follow-up video? If so, could you point me in its direction?

[@michaelfleming1765]

@TechnoTim which operating system did you use for this cluster? Did you use Linux4Tegra and did that also work with CM4’s? Thanks!

[@huwjones3241]

As always a really Great video! Looking forward to the next video on this! =D

[@TechnoTim]

Thank you!

[@AndrewWilliamsFW]

Dang I'm jealous, this looks like it's gonna be awesome!

[@nonicknamesremain]

Great video - I had a very similar issue with the PSU in a 2U chassis like that. In the end, I put the fan downwards and cut a hole in the bottom to allow the PSU to breath. Maybe frowned upon, but it has worked out very well. Cool air in from the bottom outside the chassis and vented out the back. I guess there is the risk of dust ingress into the PSU, but I stand by my decision...

[@CheapSushi]

Since it's mini-ITX, two of these can fit into that 2U, that would be amazing.

[@TechnoTim]

It certainly would!

[@5amba]

PicoPSU or Corsair SF 450 Platinum (for more breathing room) is maybe the better pick, if you care about efficiency.

[@DaPanda19]

I actually can't wait for the next video! I have x3 Nvidia Jetson Nano 2GB and and 3 Raspberry Pi 4b+ that ice been wanting to combine into an AIO cluster! Will you be deploying anything on your new cluster? Perhaps a series?

[@Botio]

Ansible show time soon?

[@eherlitz]

Hey, great walkthrough, did you ever make a follow-up on this?

[@TechnoTim]

Not yet!

[@BrianThomas]

It's a damn shame Pfsense doesn't run on these. I hope the Pfsense community is listening. These devices are getting better and better every day and every year. We really need to turn this into unified threat management system.

[@shinebayar]

Looks like OPNSense works on ARM.

[@unforgivn81]

PC fan screws are always snug because they're designed to cut their own threads into the plastic as you turn them.

[@TechnoTim]

So satisfying!

[@AdHdEntertainmentLLC]

Looks like a nice project!!

[@TechnoTim]

It is!

[@sergeygr]

Whats the total cost of adapters, board and all pi modules? To build such cluster.

[@TechnoTim]

haha! Crazy performance but only a single node!

[@eXsoR65]

Sweet! Can’t wait to be able to get one and do the same!

[@lp3037]

Is it possible to use it for animation rendering?

[@StasNsky]

Yep

[@accordxtc319]

What a cool little build, would love to get into something like this. Question does the board now have a back plate?

[@TechnoTim]

This prototype did not, I assume the final will

[@TechnoTim]

Update: Still unsure but Jeff Geerling created a model to 3d print one!

[@accordxtc319]

@@TechnoTim Worth a print if he did, now was it Jeff or Red Shirt Jeff who did hehe

[@Milan5605]

I have question - can you combine rockchip + pi + jetson and use this together?Next question arm windows 11 on this?

[@paco5687]

Did part 2 ever come out? I can't seem to find it. Trying to get my software set up

[@TechnoTim]

Not yet! I didn't get a TP2 yet!

[@paco5687]

@@TechnoTim =O Hopefully soon! I finally got my individual nodes up and running, just need to get Kubernetes configured

[@RixtronixLAB]

Vote up, thanks for sharing the video :)

[@TechnoTim]

Thanks for voting!

[@jacquesvinio6314]

hello Tim so great as usual ...but what is the difference between this and a standard PC ? Or a NAS ? May you post a tutorial on how to do to setup Traefik + openLDAP + Keycloak to manage auth on docker containers ? It will be so good. welldone for this channel. bye

[@TechnoTim]

Think of this as a Raspberry Pi cluster on one motherboard.

[@tokehgekko9455]

This needs a custom loop!

[@tommsla123]

Nice video

[@dr.wilsonliao1340]

Excellent Tutorials on Turing Pi v2 board. Just wondering who got the documentations on the different flavors for the Turing Pi v2 board since it supports both the Raspberry Pi and Jetson. Can the board supports the Jetson Nano, Xavier and high end Jetson AGX. If you have 1 x Jetson Nano (2GB), 1 x Jetson Nano (4GB), 1 x Xavier NX plus 1 x AGX Xavier. Does it mean when you turn the system on, you will get 4 separate screens that will allow you to the multi-taskings. I think more cost effective is to have 3 or 4 nodes on Raspberry Pi to run on Kubernetes and Containers.

[@TechnoTim]

Thank you! Each device has shared and dedicated hardware. As far as video output, only 1 can have access to the HDMI, which is node slot 1. You can still use other nvidia devices but not with a video output. Remote control or just pushing your ML / AI workload is going to be the way to go, even if it is connected to HDMI.

[@ErebosGR]

What's the advantage of running a Pi cluster over a cluster of low-power Celerons or Pumas or even a single hexacore? It seems to me that power consumption would be pretty much the same but performance would be greater with the x86 cpus.

[@skethvagabond723]

Dope thanks a lot for the tutorial. 🤓

[@TechnoTim]

Thank you!

[@djadja168]

hi dude, would you know (or try for us) if the jetson is capable of running a plex server with hardware transcoding ?

[@user-xh5pi2nf9q]

I’m seriously considering one of these and I’m not an advanced user. I want to run web apps/kubernetes on pi 4s (UniFi, UNMS, PiHole, home assistant, etc.) and then I was thinking a jetson could be fun and maybe it could do transcoding for Plex? Is that possible? My current server is UnRaid based and I have a Gaming VM on it as well. I’m thinking something like this would give better fault tolerance plus be cheaper than trying to go to some higher end CPU to handle everything. I’m assuming I can give the cluster access to a share folder on my UnRaid server right?

[@Runawaygeekchannel]

QQ to the community I guess, Could I use this board to build a games server. I want to get games like Valheim, Sons of the Forest and Satisfactory on a home server, but a big PC to do that is a lot of power, so was looking to use something like this? Would that work?

[@ellisonchan6204]

Obviously fan down for the PSU. Don't you see the text on it is upside down?

[@hawksights]

Given that the PSU will not have to supply a lot of power, I think it will run just fine

[@shinjiman0]

The subtitles of this video clip was mentioned as Traditional Chinese, however it's apparently shown in Simplified Chinese language.

[@jahanson]

What was the project cost for all of this? Looks fun!

[@chromerims]

Cool video, thank you

[@TechnoTim]

Glad you liked it!

[@drearmind]

Are these CM4 SODIMM adapters come from Turing? I've only heard about Gumstix but they look different. I just ordering all the parts in advance to get ready for Turing Pi V2 launch ;-)

[@TechnoTim]

They are from Turing. From my understanding they will have them available for sale closer to the launch.

[@HenrickSteele]

Where do you get the raspberry pi boards? 😭

[@strandvaskeren]

I'm not sure I get it, apart from being able to power it with a regular atx psu, what's the advantage of the turing pi 2 over running just a regular stack of pi's?

[@DavePevsner]

I haven't gotten one myself yet, but I heard it has an IPMI-like management option, there are a few M.2 slots to use the pis' PCIe lanes, and I heard if one of the pi's has a wireless modem connected to one of those M.2s it could share a connection with the other three. I also figure since it has its own gigabit switch built in, and powers all 4 pi's off a single ATX connector, that makes it easier to supply power and to connect to network for all 4 nodes, rather than giving each one its own ethernet and its own power, or buying four PoE HATs and still having to run four ethernet cables.

[@TechnoTim]

Exactly!

[@youruleyourlife]

How can we Virtualize Macos with Proxmox?

[@MagDag_]

Thank for sharing. What's version of Jetson 2 or 4 GB? Is there big difference?

[@TechnoTim]

This is a 2. Not sure I would notice the differences unless you are running a specific workload

[@jgcordobac]

Does Ruring Pi work with Orange Pi?

[@CalvinHenderson]

Any update on usage of this system?

[@groto27]

Nice! What rails do you use to rack mount that case and do they slide?

[@TechnoTim]

I always choose these rails when the device I use doesn't come with them amzn.to/3Hr6wsS

[@groto27]

@@TechnoTim Thank you. I clicked the link and it went to a page that said I last purchased these in April 2021. Haha. I am already using these for a different server.

[@TechnoTim]

haha! When I go there it says: Purchased 3 times. Last purchased Oct 14, 2020. I need help :)

[@groto27]

@@TechnoTim based on your videos I think you may soon need a full size rack 😁

[@TechnoTim]

@@groto27 I was just thinking the same thing last week...

[@paulmaydaynight9925]

notice the atx has offset mounting holes, so it mounts only one way -if you use all 4 securing screws- i like to use the picopsu's for these low power devices -intel j4205 omv4 with 12v up to 180watt wall wart etc- in small cases to mount extra usb3 hd's where the psu would have been. lol never did 3d print/popsicle stick a cage for em though, ill do it some day

[@TechnoTim]

The downside of pico psu is that the while it is small in the case, the power brick is huge. I’d rather tuck the mess away in a case with a standard psu

[@paulmaydaynight9925]

@@TechnoTim true if you look in the pc sections. if you look in the lighting & car sections you can find 12v 10a + laptop power sized 12v to run these fine oc you could use laptop 19v high amp ww with a small cheap as chips dc to dc 'buck' converter to

[@TechnoTim]

Thank you!

[@haydenc2742]

Anything new with the Touring Pi 2???

[@user-xh5pi2nf9q]

Would this give any advantage over just getting some normal pi’s and using a POE switch?

[@TechnoTim]

Yes, no dongles

[@1ccortez]

Going over on the PSU also means the fan won't turn on as often. Heard this from the most recent build of Linus Torvalds.

[@TechnoTim]

Less revolutions! I like it! Thank you!

[@fhagemann]

Hi! What's the height of the board with the Compute Moduls? I have an empty 1.5U case here...

[@JeffGeerling]

I believe 2.25" or so. On Wednesday I'll be posting a video about racking up the cluster. I had to get a 2U case because it was just too high for 1 or 1.5U.

[@fhagemann]

@@JeffGeerling Thanks, Jeff!

[@TechnoTim]

Thanks Jeff! Can't wait to see yours!

[@DodgeWrecker641]

Would this new Turing Pi 2 be a good candidate to run as the third node for Proxmox High Availability? I'm looking for a low power option for the 3rd node, instead of running three enterprise class servers...I'd like the 3rd node to be low power and just vote for quorum.

[@JasonsLabVideos]

This is just WICKED content !!

[@TechnoTim]

Thank you!

[@theprofessor8517]

Fun fact … Stan isn’t delivering still.

[@festro1000]

A pity it doesn't come a backplate IO shield.

[@TechnoTim]

Jeff Geerling created a model to 3d print one!

[@festro1000]

@@TechnoTim 3D printers are like mods to games, they solve all sorts of problems, and come in all shapes and sizes.

[@TechnoTim]

@@festro1000 for sure!

[@DigitEgal]

The PSU problem is common since they built not much with 80mm FAN on the side anymore. Thats because they give up fast when nobody cleans em. Btw. if your PC shuts off from time to time it could be a dirty PSU! Open and clean them atleast every 5 years!

[@crazyfurnaceguy1229]

Does it support Nvidia Jetson Xavier NX?😮

[@EricOnYouTube]

But the compute modules are sold out everywhere, too.

[@TechnoTim]

Agreed

[@Deezeone]

can it run gamecube emulator?

[@hightechhippie9909]

I cringed so hard when you put the mobo with a battery on the exposed metal of the case lid. Is it just me or is it a miracle it didn't short?

[@TechnoTim]

The case has standoffs 😅

[@ChadE1020]

it come with a IO shield ?

[@TechnoTim]

Not this prototype but the final should!

[@TechnoTim]

Jeff Geerling created a model to 3d print one!

[@ChadE1020]

@@TechnoTim Thanks I saw that this morning good looking out!

[@risingfate11]

Wounder how it would handle mining

[@Johan-rm6ec]

Jack Sparrow🎉

[@LJR_LIMITED]

Static damage is still a real issue.

[@akhilleusuggo]

it doesn't mater in witch direction you putting the PSU, is not gonna spin anyway at this low power.

[@TechnoTim]

Thank you!

[@Salim-wr2wk]

That case is overkill. It's too much. Smaller is better. Otherwise this is a great video share.

[@TechnoTim]

If you want it in a rack, you don't have many options!

[@lowerym1984]

Well that's a reason to move plex to kubernetes

[@TechnoTim]

You never need to and I would most likely not unless you are doing single node and want the k8s api

[@jacquesvinio6314]

Very nice. (But change the adress for your manicure.)

[@TechnoTim]

haha! I think I need to find one first

[@ashflame6888]

Whats the point of this? like what does it do and why do it this way instead of just building a normal system? What benefit does this add? what is the point? Please I just wanna understand the point..... I know computers well but NOT the Pi side of things or the Server/industrial side of things.

[@TechnoTim]

It's a way to run raspberry pis but in standard PC hardware. This gives you low powered ARM capabilities and connectivity in a single platform.

[@smashSpikeMC]

so wtf is the point can I run haiku os or is this just for kubernetes clusters that I can never seem to find software worth using on and why the long and useless video

[@obfuscateidentity2329]

Or you can go with the cheapest M1 Mac mini , am I right 👍

[@TechnoTim]

Haha! Crazy performance but only 1 node!

[@michaelevan9184]

1 G ethernet limits data flow ... there's your bottleneck ...

[@vermiumsifell]

Thanks to you, I just bought an HP DL360p G8 8SFF server. Can't wait for it to deliver probably this week, what should I prioritize in March (when it's my birthday) Should I prioritize filling it with 1.2 TB disks? Or buy one more server or buy a rack? I want all of this, so yeah.

[@TechnoTim]

I say make it functional first! Rack can wait.

[@vermiumsifell]

@@TechnoTim Cool!