Building a 4-node Raspberry Pi Cluster

  Рет қаралды 1,108,820

Davy Wybiral

Davy Wybiral

6 жыл бұрын

How to build a Raspberry Pi cluster and manage it using Python.
=== Hardware ===
PiRacks kit: www.amazon.com/PiRacks-Raspbe...
=== Software ===
Raspbian: www.raspberrypi.org/downloads...
Etcher: etcher.io/
Angry IP Scanner: angryip.org/download/
Fabric: www.fabfile.org/
Music: www.bensound.com
Davy Wybiral
wybiral.github.io/
/ davywtf

Пікірлер: 647
@alexfolsom3910
@alexfolsom3910 3 жыл бұрын
"You don't have to use color coated cables like this but be aware that it won't look nearly as cool." classic
@marcsmithsonian9773
@marcsmithsonian9773 3 жыл бұрын
Dont be shy let your rainbow run,
@WaffleTM420
@WaffleTM420 Жыл бұрын
@@marcsmithsonian9773 My flow of electrons run
@marcsmithsonian9773
@marcsmithsonian9773 Жыл бұрын
@@WaffleTM420 and here you are very wrong my dear... Acirding to KZbin since youtubers set the laws of phisics there are no electrons flowing inside the cables but electricity is a magical radio wave.. propagating instantly.
@WaffleTM420
@WaffleTM420 Жыл бұрын
@@marcsmithsonian9773 Woah, well hey thanks for letting me know, do you have discord by any chance?
@marcsmithsonian9773
@marcsmithsonian9773 Жыл бұрын
@@WaffleTM420 yes there ate things called electron tubes, and it conducts based on the principle.of electron flow and.not a radio vawe.. and I have a Disco- Ball in my living room. The theories about electricity flow was a coordinated research of umiversities to validate degree of stupidity that can be induce by youtube to general population... results are catastrophic.
@fusion9619
@fusion9619 3 жыл бұрын
I'm pausing 9 min in to say, this is a really great video. I just got my first pi, and am a little bit afraid of it, so I really appreciate the time you've put into making this and explaining things clearly.
@Demkeys
@Demkeys 6 жыл бұрын
Great video man! Very informative! And I like how you've given attention to certain small details, like the thing about using a USB hub with an external power source. Lol and the small bits of comedy are definitely a plus point! Keep it up!
@nogosnoqt
@nogosnoqt 5 жыл бұрын
I like how you do videos: it just so much more genuine than what you find in many others.
@miguelbravo3050
@miguelbravo3050 5 жыл бұрын
nogosnoqt i heavily agree; my dude seamlessly described in depth a quite complex rpi project, made it funny and threw in some optional CLI powertools usage like its nada. ill press ‘f’ repeatedly!
@vsweetbread
@vsweetbread 5 жыл бұрын
One Russian schoolboy also made a cluster of only 3 raspberries, and you know what? It was played on TV as the "Supercomputer Inventor." That’s why I haven’t been watching TV for 7 years
@raven4k998
@raven4k998 3 жыл бұрын
lol 3 is not that much for a super computer you need like a few thousand for that level and a few thousand would be much harder to pull off then just three in a cluster
@behysun
@behysun 5 жыл бұрын
You solved something that I was looking how to fix it for many hours, really thank you for giving a rich explanation about it. You are the man.
@bobmixon6021
@bobmixon6021 5 жыл бұрын
Great video, thank you. I see a lot of comments about it not being a cluster, asking what it can be used for, etc. Let me see if I can help. First and foremost, it is a cluster; it is a cluster of Raspberry Pi's. Each will be and act as an independent Pi. What Davy is showing here is how to use fabric is to easily send commands to all at the same time. You don't need the case to do this; its just a nice way to house them. Now take one of those Pi's and make it the master and the others slaves. The master receives commands (keyboard, switch, sensor, another computer, whatever) and sends those commands to slave Pi's to do the actual processing. Each Pi can be configured to do specific things. In a robot, you may have one Pi dedicated to differential steering and object avoidance, another for video input processing, etc.
@casper8210
@casper8210 5 жыл бұрын
Best comment here. It's the bottom bit I came here for, the video doesn't cover it
@williamjones7288
@williamjones7288 6 жыл бұрын
Fantastic video. The attention to detail is appreciated for a Raspberry Pi novice such as myself. Keep up the great work!
@technichron
@technichron 5 жыл бұрын
3:25 it sounds like he just ate the micro SD cards.
@Hammid
@Hammid 4 жыл бұрын
rooooooooooooofl!
@user-rf4vc7mt4d
@user-rf4vc7mt4d 4 жыл бұрын
CRUNCH
@bandanakeks
@bandanakeks 4 жыл бұрын
Oof lmao
@fantomgaming9018
@fantomgaming9018 3 жыл бұрын
Lmao
@earlyaccessgaming7532
@earlyaccessgaming7532 3 жыл бұрын
????
@fredgibbs4664
@fredgibbs4664 5 жыл бұрын
Great video, fruiend. I just received 5 of these little creatures to do exactly what you did. I failed to buy colored cables, so you with the "cool " factor. Keep the vids coming - I'm an IT grad student and learn more here than in class/books. Cheers, mate!
@N3KN1L
@N3KN1L 6 жыл бұрын
Actually didn't know about Fabric! Nice one :)
@bbminetesting6837
@bbminetesting6837 6 жыл бұрын
WOW! I didn't know about fab command! VERY useful! Will definitely be using it now! Just subscribed :D
@RT-eb6vo
@RT-eb6vo 6 жыл бұрын
Thanks for taking the time to put this video together. I learnt some new tricks :).
@TheNZJester
@TheNZJester 6 жыл бұрын
I'm glad I can just log into my current router and check the allocation of IP addresses on its LAN devices list quickly rather than having to scan my network. Most of my most recent routers have had a feature to list their DHCP assigned IP addresses in some form or other. I tend to also add devices like this onto a DHCP reservation list as well to make sure the hardware is bound to that IP address in the future by its MAC address. I have had problems in the past where I have shelved projects for a few weeks only to come back to them later and the IP addresses are different as their lease expired and the old adress has been given away to something else in the weeks they have been offline.
@barbaznexus9347
@barbaznexus9347 5 жыл бұрын
really clean and cool build
@garyreardon11
@garyreardon11 6 жыл бұрын
Great video Davy Wybiral!! I never heard of the fabric program before.
@therealjackfisher
@therealjackfisher 2 жыл бұрын
Nice. Great idea on using color coded cables. I have also seen people use usb cables with LED light, that is also looking very impressive.
@ThexXTURBOXx
@ThexXTURBOXx 5 жыл бұрын
I exptected him to say "Hey Vsauce, Davy here" in the beginning
@hardrocklobsterroll395
@hardrocklobsterroll395 5 жыл бұрын
Thanks for this video. Literally everything I was looking for :)
@vn9528
@vn9528 6 жыл бұрын
Great video....didnt ever thought of this. Thanks for the share mate.
@stephenjones8928
@stephenjones8928 5 жыл бұрын
@8:39 "You don't have to use colour-coded cables like this, but, be aware that it won't look nearly as cool". :D LMAO. That was funny man. Thanks for posting.
@DaveAndrus
@DaveAndrus 3 жыл бұрын
Very useful info. Thanks for taking the time to make this video!
@digichef918
@digichef918 6 жыл бұрын
Making this today!! I'm only using 3 Rpi3 Model B's, but I'm super excited. Thanks for posting this video!!
@digichef918
@digichef918 6 жыл бұрын
Sooo to any future watchers of this video, the Fabric code referenced is now deprecated. It's honestly much easier to use Ansible to accomplish the same concept, but amazing video nonetheless! Definitely inspired me to tackle this
@jairrossettofilho1189
@jairrossettofilho1189 4 жыл бұрын
Thank you for teaching me how to do it. I really liked the video. You teach in a very clear way.
@CRasputin4
@CRasputin4 4 жыл бұрын
I really like the color of those wires, would anyone happen to know the brand?
@johnkasonga6634
@johnkasonga6634 4 жыл бұрын
This was so interesting. Please do more videos like these. Thanks again
@garethbromley1229
@garethbromley1229 6 жыл бұрын
Thanks for the useful assembly video. Was there a reason to choose python fab over something like ansible (or other CM tool) for machine configuration? Look forward to what you do with these next, keep up the good work!!
@JohnnyMcMenamin
@JohnnyMcMenamin 6 жыл бұрын
This helped me get off and running. Thanks.
@mathematicalpower
@mathematicalpower 5 жыл бұрын
As of 3/8/19, running fabfile.py on latest version of Fabric with Python 3.6 yields the error "no module fabric.api". Fix: Replace "from fabric.api import *" with from fabric.decorators import task, parallel from fabric.operations import run, sudo from fabric.context_managers import env
@wlouisharris
@wlouisharris 3 жыл бұрын
Very cool. It's very cool that we have the technology now to build a small Linux cluster at a low cost. I really need to advance my skills for work in a pure lab environment and this will give me some tools to learn Kubernetes and docker.
@BillBrandon
@BillBrandon 4 жыл бұрын
I need to try this, as soon as I understand what kind of purpose it is for,
@wlouisharris
@wlouisharris 3 жыл бұрын
I'm going to use it to setup a training lab for clustering which is where several computers act as a single computer - opensource.com/article/20/6/kubernetes-raspberry-pi. I'm also going to use it to build out Ansible which basically will use one Pi as a master to run and schedule automations on the other 2 or 3 Pi's.
@alexzalesny2414
@alexzalesny2414 4 жыл бұрын
It is 8:17 in the morning and I haven’t slept yet and I’m watching this only because KZbin recommended it to me my life is meaningless Also this video is pretty cool you got a new sub
@sadf1416
@sadf1416 3 жыл бұрын
Hey, I feel you man. Sometimes I dont get a wink of sleep, just watching youtube videos-we're all just specks of dust floating in an infinite void. If you wanna talk just leave a comment.
@drjmansplace5174
@drjmansplace5174 6 жыл бұрын
That Wack-A-Mole entrance was funny. Loved it.
@tylercbrodsky
@tylercbrodsky 5 жыл бұрын
If you have the 3+, do you still need auxiliary power? I plan on connecting these to a powered switch (PoE). Will PoE work?
@Utkarsh_A
@Utkarsh_A 5 жыл бұрын
PoE is available only on the 3B+ but you have to get a PoE Hat
@victorwong5000
@victorwong5000 5 жыл бұрын
Dude! That was awesome!
@adambombcreations3542
@adambombcreations3542 5 жыл бұрын
Great instruction, Thanks for the info, I was wondering what applications or projects this 4 node setup can be used for?
@alissonfl
@alissonfl 5 жыл бұрын
im wondering that too
@user-hv5jv9gb6c
@user-hv5jv9gb6c 9 ай бұрын
What a fantastically well done video. Looking to build a video editing cluster from workstations I've got sitting around and know nothing about it. first video out of about 15 I could follow.
@ph1l911
@ph1l911 6 жыл бұрын
To me it looks like you made a typo when you specified the ip range (192.168.60 instead of 192.168.1.60) but it still worked - why?
@DavyBot
@DavyBot 6 жыл бұрын
It was a typo during the video and I'm surprised that it worked that way too. The scan probably would have been faster if I had entered the range correctly.
@JW-jl8iq
@JW-jl8iq Жыл бұрын
What is the model of that Anker Power hub and wattage output? I am seeing ones with 20w output would that be to much?
@stevencoto834
@stevencoto834 4 жыл бұрын
if you where to make these a cluster for a website, would the recommendation be to use static IP on each pi in case? assuming why you didnt statically set the IPs on this demo.
@frogie4life84
@frogie4life84 6 жыл бұрын
interesting video. do you have more tutorials video's/website with clusters projects. Just for starters. Also with guides etc.
@joshuastover
@joshuastover 5 жыл бұрын
I keep getting “can’t find and collection named ‘fabfile’!” When I try to enter any commands for my pi’s. Any ideas?
@AndrewErwin73
@AndrewErwin73 5 жыл бұрын
"...be aware that it won't look nearly as cool!" - excellent!
@MathsAndStats
@MathsAndStats 3 жыл бұрын
Hi Davy. Great video. Just wondering how reliable was the Anker power supply? Have you tried it with more than four RPi? Thanks. Jonathan.
@arukak9558
@arukak9558 5 жыл бұрын
where to buy this color's micro usb cable and LAN cable?
@CaffeineAddicti0n
@CaffeineAddicti0n 5 жыл бұрын
Imo ansible with `adhoc commands` is a better multi ssh tool than fabric. What did you end up doing with the cluster after building it?
@nunyabizniz8161
@nunyabizniz8161 5 жыл бұрын
Would this make a decent Plex server?
@ITexpert55
@ITexpert55 4 жыл бұрын
That was the main point when I was watching this video. He had color coded cables but don't know which Raspberry belongs to which IP address. Meanwhile, I was expecting that he will run different services on different Raspberry :) :) and show something ;P.
@markhahn0
@markhahn0 4 жыл бұрын
@@nunyabizniz8161: no. that's why people are pointing out that there's nothing clusterish about this.
@jacob.peters
@jacob.peters 4 жыл бұрын
I have a netgear GS308P i'm trying to use and it's not picking up an IP from my router. not able to figure out if the issue is with the switch or the router itself. the router doesn't actually see the switch as connected even with all the LEDs giving me green lights so it's been frustrating trying to figure it out. attempting to build myself a small home lab to study for some red hat certifications
@utdallaz
@utdallaz 6 жыл бұрын
Very cool! Great explanation!
@matthewstott3493
@matthewstott3493 5 жыл бұрын
It's a Bushel of RaspberryPi's not a cluster. Well not yet. Not until you set them up to be a cluster. Right now they are just a lonely bushel of RaspberryPi's in a nice stack.
@abuenoadiosmaster7212
@abuenoadiosmaster7212 5 жыл бұрын
"close your eyes" XD
@patrik5123
@patrik5123 5 жыл бұрын
Exactly. This video did not - sadly - explain what I came here for.
@drewblay
@drewblay 4 жыл бұрын
Yeah, cluster was the wrong word to use here.
@PaulJohnsonM
@PaulJohnsonM 4 жыл бұрын
@@patrik5123 It still had a couple of cool tricks that would come in handy when it comes time to actually set up a workflow.
@patrik5123
@patrik5123 4 жыл бұрын
@@PaulJohnsonM 100% irrelevant. And not even true.
@DementedBeast
@DementedBeast 4 жыл бұрын
Can you run the new updated version of Ubuntu (the re release that they just did and fixed stuff) would work with a pi cluster and them all still work together as one computer? Or do I *HAVE* to stay on raspbian?
@DDBAA24
@DDBAA24 6 жыл бұрын
is Fabric actually clustering them though ? Or is it more or less just a way to execute the same SSH command on different devices at the same time. The cluster would distribute data evenly across the pi's, and not the execute the same command but separate parts of the command simultaneously utilizing the full power of the "cluster". I get what you did here with Fabric and it was cool , but how can I use it to combine the hardware resources ?
@taskforce-it-group
@taskforce-it-group 6 жыл бұрын
It's only to execute the same SSH command on all devices.
@DDBAA24
@DDBAA24 6 жыл бұрын
Still a cool concept. I wound up going with a machine file so the pi's could actually see && speak to eachother. What are some practical applications for a cluster ? The first thing I tried was a bruteforce lol
@taskforce-it-group
@taskforce-it-group 6 жыл бұрын
Yes, Fabric is definitely cool. It's a fairly extensive tool and worth checking out. I'm currently using my RPi cluster to prototype a small microservice-based infrastructure with multiple Node.js instances communicating with each other over IPC. Next would be using a message broker like RabbitMQ and making the RPis run on multiple different languages.
@DDBAA24
@DDBAA24 5 жыл бұрын
@Umbrelladroid Actually I am familiar with what a Beowulf cluster or grid computing is. Although I am familiar with the term, I have never built one. I know you can make a cluster that serves the function with mpi/mpich openMPI for arm devices. Have you tried either of these methods beowulf or mpi ? What I was looking to do was find an office that was getting all new computers and getting rid of the old ones in order to attempt making the beowulf cluster. Usually they're recycling or throwing machines away. I have a bunch of machines at home but they're not the same, in order to make this type of cluster, do the machines have to be identical ? I only have two rpi's, a3b+ and pi0w. I was thinking of trying this kzbin.info/www/bejne/iKLGeZ1necx0g68 , I know either way I am not going to be breaking any benchmarks with the Pi but the concept is cool. Let me know what you think, and what you think about the video I linked. Thanks.
@DDBAA24
@DDBAA24 5 жыл бұрын
@Umbrelladroid Okay I will see what its about, is it exclusive to Debian or can I make this type of cluster with other distros ? Personally I like Debian , but I have a few systems running Arch, and centOS, thanks for your suggestion.
@randynyify
@randynyify 6 жыл бұрын
This is t really a “cluster”. It a collection of 4 individual Pis. A cluster is a system that allows for parallel computing.
@esra_erimez
@esra_erimez 5 жыл бұрын
+1
@Thezuule1
@Thezuule1 5 жыл бұрын
Could have made a legit beowulf cluster with linux easily enough.
@Nobbie248
@Nobbie248 5 жыл бұрын
The word "cluster" is not defined like that, so you just mad that it is not what you wanted it to be
@VolgClawtooth
@VolgClawtooth 5 жыл бұрын
@Samuel Self yes, but he did not do that either.. This is merely a small rack of Pi's. Disappointing....
@rikdenbreejen5230
@rikdenbreejen5230 5 жыл бұрын
but what does it actually do?
@imacexpress
@imacexpress 6 жыл бұрын
Dave, thanks for the video. The tools you used to configure things were very useful to learn about as well. What operating system were you running on your laptop?
@pippaknuckle
@pippaknuckle 4 жыл бұрын
Ubuntu
@RightToSelfDefense
@RightToSelfDefense 6 жыл бұрын
Thanks a bunch. Excellent explanations.
@wrzq
@wrzq 9 ай бұрын
Thank you for this awesome tutorial, it helped me a lot. You're the Man! Quick question: what should I do in order to use this type of cluster as a home cloud for hosting my website(s) and mysql databases?
@brucej2490
@brucej2490 5 жыл бұрын
It's very very useful and good quality video, thx
@ledgeattack
@ledgeattack 3 жыл бұрын
Hi Davy, can you info what type of USB Hub for power supply to all Raspi ?
@yannkitson116
@yannkitson116 8 ай бұрын
Great stuff, thanks for sharing!
@spooky5297
@spooky5297 3 жыл бұрын
Great video. Exactly what I have been looking for. Wish you record the screen so I can understand you commands. Thank you so much!
@dejohnny2
@dejohnny2 4 жыл бұрын
Dude, this is awesome!
@CProton69
@CProton69 5 жыл бұрын
I would have liked to know after building this how much of each Pi is combined if it is at all and what you can accomplish with it if at all. I don’t expect everything is literally combined but if it’s a ‘super’ computer I suspect it has more computing power and more memory maybe?
@marcus_w0
@marcus_w0 6 жыл бұрын
8:46 - "You don't have to use color coded cables like this, but be aware that it won't look nearly as cool!" :) Thumbs up. This was maybe 10 seconds after I thought - "wow, these colored cables look cool!"
@kg4giy
@kg4giy 6 жыл бұрын
Not only does it look cool, but it helps you figure out which end goes to which CPU when you are troubleshooting your stack!
@tlcoucke
@tlcoucke 6 жыл бұрын
Hehe, he would have gotten it anyway, but that comment of his triggered my up vote.
@jfan4reva
@jfan4reva 6 жыл бұрын
Having worked as a network technician for a few years,,,yeah, anything you can do to simplify cabling pays off. Even if it's just 4 devices. You'll never actually see the savings in things like time, frustration and hardware damage, but it's there. It's like not falling off a cliff that you don't know is there.
@ryanwilson5079
@ryanwilson5079 5 жыл бұрын
They are not for decoration they are to organize. Them
@ALT-HEX
@ALT-HEX 5 жыл бұрын
kick-ass vid man
@bleepsblops
@bleepsblops 6 жыл бұрын
As I start wondering if i should build a pi cluster for plex and octoprint your video came at the right moment. Also, totally unrelated but I have the same shirt! LOL
@zhachoryvolker4531
@zhachoryvolker4531 5 жыл бұрын
It's true this isn't a cluster, but this is still amazingly helpful!!!
@abhishekbanerji1451
@abhishekbanerji1451 5 жыл бұрын
can i run a server (like a teamspeak 3 server) using the power of multiple pi's?
@Techforcurious
@Techforcurious 5 жыл бұрын
These four PIs still appears to be working independently. It will be useful if they can be combined and used as a single system. Then, we can have multiples cores to do parallel processing. Anyway even in the current state one can assign the job to different pi and share the workload. Thank you for the basic introduction of combining PIs.
@je-fq7ve
@je-fq7ve 2 жыл бұрын
it would require a new kernel extension or something like it. I dont think Pi will do real parallel processing out of the box.
@MicahTheManiac
@MicahTheManiac 6 жыл бұрын
I've always wondered what use a Raspberry Pi cluster has. Does it actually increase performance or is it just easier to run a server or something, or do something like calculate a large number easier? (let's say a number like Pi.) Anyways these little things always seem to amaze me and are very cool and unique...
@ultraviolet.catastrophe
@ultraviolet.catastrophe 2 жыл бұрын
Yes, such a cluster would be very useful in scientific computing. A classic problem is generating all the prime numbers up to N (a sufficiently large number, like a million). Each node will work on a portion of the problem, and then the results can be merged later. This is extremely faster compared to running the same program on a single Pi.
@backyardwindow
@backyardwindow 3 жыл бұрын
This is very cool, and you made it seem super easy! However, I don't have any idea what one does with a cluster of Raspberry Pi, nor do i know what Python is for. Just grabbed my first Pi for audio streaming.
@epatch
@epatch 6 жыл бұрын
Thanks for the vid; I'd never heard of fabric before and find it interesting and useful. Are you using anything to get them to function together as a cluster? Parallel processing etc...?
@DavyBot
@DavyBot 6 жыл бұрын
+Eric Patch I run some of my own distributed software on them. Mostly just for testing. The downside of using them to communicate with each other is that the onboard Ethernet is slow. You'd be better off buying a more integrated system. But they work great for hosting small instances of web apps and stuff (where people normally use a bunch of small VMs instead)
@hoanhan3074
@hoanhan3074 6 жыл бұрын
Hi Davy, thank you for the response. It would be really helpful if you can provide a small tutorial on how to build a simple distributed system and deploy it on this cluster. I've been looking for some other similar videos but your guide is the most clear and understandable. Another tutorial for the software part is amazing.
@asdfasdf12312jhg
@asdfasdf12312jhg 5 жыл бұрын
Great Explanaition Video ... small Software recommendation use ansible to configure and manage such a sweet Cluster :D
@smoocher
@smoocher 2 жыл бұрын
This video is incredibly helpful. Thank you.
@buzz200066
@buzz200066 2 жыл бұрын
Awesome build! Does this cluster have failover redundancy; not stopping processing if one node fails?
@ishanchourey2252
@ishanchourey2252 4 жыл бұрын
I am trying to make a 2 Raspberry Pi 4 4gb cluster and want to use the combined power for normal computing. For things like youtube, netflix etc. will this be possible, will I get better performance than a single 4gb pi board desktop.
@user-hx7dc9uz6s
@user-hx7dc9uz6s 3 жыл бұрын
no
@Wildersport
@Wildersport 3 ай бұрын
Something like that little stacker sized up to fit Pi 8s with NVME bases / NVME drives would be pretty awesome...
@chriscontact5857
@chriscontact5857 5 жыл бұрын
What is I want to cluster a rock64, pine64, some raspberry pi 2s and use a 2 for the desktop. Is that doable?
@user-hx7dc9uz6s
@user-hx7dc9uz6s 3 жыл бұрын
should be doable with some tinkering, take a look at proxmox
@baykus790
@baykus790 4 жыл бұрын
So i can share my website by this pi cluster as a server. I mean can we make a none-stop website database server ? When i get a domain can i use it ?
@danielmiller8004
@danielmiller8004 5 жыл бұрын
Not sure if any one will answer this but how would this be with Kali instead of rasbpian? and would it help to improve pen testing from a raspberry pi?
@jeffm03421
@jeffm03421 5 жыл бұрын
Why am I getting the error fab: command not found? Is there something I'm missing? Fabric doesn't appear to be successfully installed. I followed this tutorial to the tee.
@oseekergaming1517
@oseekergaming1517 4 жыл бұрын
did u solve the error? pls help. tells me no collection named fabfile.
@Xerion567
@Xerion567 6 жыл бұрын
Great video! I learned some stuff; got some ideas. I see you're using VS Code. Nice.
@stevewhite5816
@stevewhite5816 5 жыл бұрын
You should do a tutorial on how you program multi pi at once step by step and what programs to get and how to set them up. I tried and it's not working.
@allendevans
@allendevans 5 жыл бұрын
Nicely done. Thank you.
@eddierice3254
@eddierice3254 6 жыл бұрын
this guy is epic, love the Raspberry Pi
@undergroundstudio9810
@undergroundstudio9810 3 жыл бұрын
...and how do you get past "no module named decorator", pip commands don't work on my pi's, and sudo apt-get install decorator comes up empty
@JJSloan
@JJSloan 5 жыл бұрын
Nice, I learned about some new tools. Good show
@b_mb4948
@b_mb4948 6 жыл бұрын
Just a quick question from a "non-developer"; Is it possible to build a Pi cluster such that it behaves like an ordinary Pi (Raspbian GUI interface etc.), but makes use of the other units in the cluster to increase raw processing power & available RAM, giving you what is in effect some sort of "super Pi"?
6 жыл бұрын
As far as I know, there is no easy way to "add" like this. This is a non trivial question and goes down with how easy or hard is to split your problem. You could use some work schedulers like kubernetes or nomad, to deploy jobs to the PIs. Some works can not be done without some algorithms changed. The trivial situation is calculate Pi itself. To calculate a new decimal you need the previous, so it is not easy to split this job on many nodes, although statistical approaches can help you there. In real world, most f the guys out there are using some combination of job schedulers or network load balancing to use the full power of the cluster.
@Beany2007FTW
@Beany2007FTW 6 жыл бұрын
Aye, something like Docker managed by Kubernetes or RancherOS would be a good way to get that sort of functionality. You get the same practical results, although only in parallel fasion (IE you can scale out horizontally - running multiple apache services - but not vertically - you can't make apache *faster*). Actually making the services combine into one homogenous cluster is something that is more of the thing that serious high-performance computing types would do, but the lack of grunt on the Pi makes it a bit redundant for that. If the idea of horizontal scaling sounds good, have a look at Rancher. I'm an idiot when it comes to Docker, but even I managed to get a loadbalanced, scalable Wordpress install out of it in the space of about two hours, having previously been (technically) niave on it (I'm familiar with the concepts, but never tried it before). I'd say if I can get it working - and I'm an idiot - then others probably can to. rancher.com/docs/os/v1.2/en/running-rancheros/server/raspberry-pi/
@JohannSwart_JWS
@JohannSwart_JWS 6 жыл бұрын
The proper answer to your simple question is simply - no.
@gorillaau
@gorillaau 6 жыл бұрын
Short answer: not really. You could run a graphical program on a secondary node but tell it that the display is vis this ip address which is the node that has your monitor plugged into it.
@charlotteantiquepowerengin6277
@charlotteantiquepowerengin6277 6 жыл бұрын
Thanks. Very informative.
@gelfling6
@gelfling6 3 ай бұрын
great video on setup. slowly bringing a 5-node cluster online, which I got from a college student whom besides not wanting to pack it to go home (from Ct. to Ca.), I'm guessing lost interest. I'm starting with the latest 15-Mar-2024 lite 64-bit image. my question, is once everything is up and running, how do I go about running an actual app, that will take advantage of all the nodes, i.e. something like rarcrack, which is a pre-compiled app. thanks
@christopherhahn6166
@christopherhahn6166 4 жыл бұрын
Dude! :0) One of the coolest vids I have seen in a while. I would love to run some demos on such a thing but will need to check on that OS variant.
@orangeudav
@orangeudav 6 жыл бұрын
Hmm, did you reinvent Ansible? And what the cluster without docker swarm?
@STohme
@STohme 6 жыл бұрын
Interesting talk. Many thanks.
@Dr.Pinnacle
@Dr.Pinnacle 6 жыл бұрын
what is the use case annd where can we apply this. it is so coo!!
@marcsmithsonian9773
@marcsmithsonian9773 5 жыл бұрын
So can you make load balancing http server ? Or load agregation ? Or redundancy?
@user-hx7dc9uz6s
@user-hx7dc9uz6s 3 жыл бұрын
yes
@bondarworld
@bondarworld 5 жыл бұрын
Sooo... This is a cool build indeed. But I missed the part on what exactly you built it for. And what kind of uses there are for it. What are the benefits compared to just a single board? Thanks!!
@ghostexblades2137
@ghostexblades2137 5 жыл бұрын
you can have more computing power with the 4 raspberry pi's if you connect it to your pc. another thing you can also use raspberry pi's for is using it is a sort of motherboard for other things you might build
@user-hx7dc9uz6s
@user-hx7dc9uz6s 3 жыл бұрын
@@ghostexblades2137 "you can have more computing power with the 4 raspberry pi's if you connect it to your pc" that is not true at all xD
@michaelurig3887
@michaelurig3887 2 жыл бұрын
Nice video, you should have posted where you bought the cables, switch and usb power hub. And it would be nice for us newbies if you posted the fabric file but I'll keep pausing the video to see if I can figure it out. Thanks again Dave
@socrates_the_great6209
@socrates_the_great6209 5 жыл бұрын
Thanks for linking your power swich...is it even 2.5A ? I daubt it strongly.
@douglasgoodall3612
@douglasgoodall3612 4 жыл бұрын
I couldn't find the link for the anker device. Do you have it? I also wanted to know about the watts available per port.
@jlaroche0
@jlaroche0 5 жыл бұрын
None of that code works anymore: Could you update the code for Fabric v2.x?
@markhahn0
@markhahn0 4 жыл бұрын
or just use a grownup tool like Ansible.
@scottk7613
@scottk7613 6 жыл бұрын
I am new to this, but i was wondering if this was possible. Can i build this, so i can play ps4 games and xbox one games? Could i download the game disks somehow and install them into this? And have it play very well? I want a pi that plays all the new games/4kHD movies/ and whatever else. I am going to wait for the pi 4 to come out, before i try to build it. But is it possible?
@jeffspaulding9834
@jeffspaulding9834 6 жыл бұрын
I highly doubt it. If you want to play games for old platforms (NES, SNES, etc.), a single Pi could do that fine. You'd get no advantage by having multiple computers, though. For modern games, you'd need a machine that's significantly faster than the game console (it has to run the game and emulate the console at the same time). The Raspberry Pi isn't a very fast machine even by SOC standards. Again, you'd get no advantage by having multiple machines. To take advantage of a multiple-machine setup like this, software has to be written in a certain way. Since game consoles are all single devices (I'm not counting multiple cores as separate devices here, as they share memory and cache), the games aren't written to take advantage of multiple machines. Look up "parallel computing" for more information.
@compphysgeek
@compphysgeek 4 жыл бұрын
I'm wondering, can't you add the ssh file to the boot folder before you copy the image to the ssd cards?
@user-hx7dc9uz6s
@user-hx7dc9uz6s 3 жыл бұрын
yep
@demonmaestro
@demonmaestro 6 жыл бұрын
Awesome video. Just a friendly helper. Look into OBS (Open Broadcast Software). To record your screen.
@TheKingofparis148
@TheKingofparis148 Ай бұрын
where did you get these cables? I cant find those ones.
The Petabyte Pi Project
22:27
Jeff Geerling
Рет қаралды 2,2 МЛН
Homelab upgrade: New Raspberry Pi Cluster rackmount
14:44
Jeff Geerling
Рет қаралды 547 М.
路飞太过分了,自己游泳。#海贼王#路飞
00:28
路飞与唐舞桐
Рет қаралды 39 МЛН
Пранк пошел не по плану…🥲
00:59
Саша Квашеная
Рет қаралды 7 МЛН
I'm Excited To see If Kelly Can Meet This Challenge!
00:16
Mini Katana
Рет қаралды 31 МЛН
Stop, Intel’s Already Dead! - AMD Ryzen 9600X & 9700X Review
13:47
Linus Tech Tips
Рет қаралды 1 МЛН
Building a cluster of 4 Nano Pi NEO2 SBCs in custom case
17:15
Электроника в объективе
Рет қаралды 449 М.
How To Make A Cluster Computer (Part 1)
6:38
Tinkernut
Рет қаралды 1 МЛН
JPEG is Dying - And that's a bad thing
8:09
2kliksphilip
Рет қаралды 188 М.
Raspberry Pi versus AWS // How to host your website on the RPi4
8:39
Raspberry Pi Supercomputer Cluster
12:33
Gary Explains
Рет қаралды 793 М.
13 Stunning Raspberry Pi Projects for 2024!!!
10:23
ToP Projects Compilation
Рет қаралды 228 М.
WAY faster than a Raspberry Pi-but is it enough?
17:26
Jeff Geerling
Рет қаралды 662 М.
How to Make a LapTab for Students
7:00
TecH BoyS ToyS
Рет қаралды 2,2 МЛН
路飞太过分了,自己游泳。#海贼王#路飞
00:28
路飞与唐舞桐
Рет қаралды 39 МЛН