For those asking about the rack, I don't remember exactly where I bought it. But here are a few from Amazon that you might like: geni.us/3AAUtfx and geni.us/DbWsT and for the UK this one: geni.us/rGjT6
Does this method your demonstrating using the MPI library allow these RPi's to combine system resources ? I know you said that it sees 4 Pi's = 16 Cores , does it also pool the RAM ? Assuming the answer to both those questions are yes , can you still enable ZRAM within the cluster ? When compiling programs on the Pi it tends to hit swap after a point , ZRAM allows the Pi to swap to the RAM instead of the MicroSD (im sure you familiar). I would want to use a setup like this for compiling , does this cluster configuration help me in that regard ? Thanks Gary .
Hello Gary, I would like to thank you for making this video and maintaining such an informative channel. you are very easy to listen to and your explanations are to the point. Keep up the good work. Today was the first day i saw your channel link and decided to give it a go. the raspberry pi is a great pltform. However the raspberry PI Zero is a very compact development board as well. The Pi Zero does not have the compute power of the big pi. however the integration of the wifi on the board makes it one of my favorites. I built a super computer using the PI Zero as the main board. I loaded each PI with aversion of Windows 2008 data Center Server. I used RUFUS to flash 64 GB microSD cards with the OS. Once i had the OS working I cloned it using tis program... clonezilla.org/clonezilla-SE/ I have a multi-slot microSD card reader. It holds 24 microSD cards and connects via usb 3.1. I installed teh Windows 2008 Data Center Server on the microSD cards in about 15 minutes. Windows Server 2008 Data Center can cluster up to 32 machines processors at once. The Windows platform is very stable yet it is a little large. About 3 GB on each microSD. I used the data center server services to aggregate all the Raspberry PI processors and resources. i used the Wifi on each chip to bridge them all together. I only spaced them about 1/2 inch apart. The network and teh data processing is so fast that it returns almost instantly. I mainly use the cluster just to browse the web and play games. It is absolutely over kill on any kind of gaming or graphics program. I set the paging file on all the drives to 512 initial max 4096. I also connected an external 3.0 6 TB hard disk to the USB mini on one of the PI. Number 32 in the cluster. Then all teh data i download goes thru the other 31 and passes down stream directly to the external like a funnel. I can download a 4K movie in about 55 seconds with my AT&T fiber. I thought you might be interested in looking at this flavor of PI super computer. Of course i have Python, PHP 7.2 and AMPPS installed on the cluster. Automatic load balancing and wifi VLAN tagging. The windows 2008 server data center can open up a whole venue of new and powerful applications you may be interested in
A long time ago, a man named Bill Gates had a vision: "A computer on every desktop" Now, thanks to Raspberry Pi, a new vision has emerged: "A supercomputer on every desktop"
I do enjoy your videos, even though I already know pretty much everything you discuss usually. And I have recommended it to people who do need to learn about a topic. Great format, production quality and content. Thanks for making this.
@@infinity5288 Less in detail with more effort put into explaining the detail. I would say that teaches more, because the less effort put in, the less that you get your point understood, therefore you teach LESS because it is not taught, just stated.
Thank you Gary. There are a lot of videos on how to build a cluster with multiple rapberrys, but this is the first time I actually see it running as a cluster. All other videos stopped after the build, or ran them as individual computers.
The example you used with primes is one of concurrency rather than parallelism it seems. This is a very good primer on the basics of high performance computing though. Good video.
Reminds me of concurrent & parallel computing class back in college, specifically the grid computing chapter. The classic example we used back then was matrix multiplication, while for the project we choose to parallelize inefficient sequential sorting algorithm with final goal to beat quicksort up to certain data size (because eventually quicksort still wins, it's just a much more efficient algorithm after all).
What I find interesting is that that program you ran is the equivalent of what was run on the EDSAC computer in the 1950s when it was doing nothing else and you are generating more prime numbers in 30 seconds than it could in just under 10 years.
Yeah, even the chips you find in those musical birthday cards have more computing power than all the Allied Forces put together did in WW2. It's crazy.
@@dashboy007 even your current computer/laptop/phone no matter the model is still many times more powerful than the greatest computers of the ones used for the first few moon landings
I looked a few of these Raspberry Pi clusters and for less than $800 I bought a used quad processor 32 core Xeon Dell R820 with 96 GB of memory..... and it just works. Sure when it's running it consumes more power but it's a unified memory across the 4 processors which makes HPC easier.
What people forget about the old microwulf clusters is they use 2 gigabit connections to per board to share data. The Pi3 has 1 ethernet connection capped at 300mbps, which made clusters actually slower than a single Pi. Now that the Pi4 is here with true gigabit and USB 3 support to add a second one, a Pi cluster might actually be a viable project.
It depends on the problem you're trying to solve. If the problem you're trying to solve requires minimal network bandwidth(small inputs and outputs) but requires a large amount of CPU processing time... Then the older pi's will work just fine.
perfect explanation 2:30 - 3:00 planning to have one built soon aside from having rpi4 , i was also thinking about orange pi to have as another alternative then mix them if possible just need more research on this thx sir Gary
awesome, never knew anything about super computing, and now i know, thanks.
5 років тому+21
Could you use a lower latency/higher throughput interconnect like direct PCIe connection to increase the performance? For a few computers it could be possible (certainly not on large scale supercomputers since PCIe 3 has max. cable length of 8 inches).
Closet we can get now a day in my Datacenter that i take cared is FC (Fiber Channel). Every single server in DC and inside cluster are connect together in network via FC for lowest latency and maximum transfer rate.
Forgetting the cost of power for a moment I am curious how the performance compares to a PowerPC based cluster which was probably the first "out of the box" consumer level hardware solution available that could be configured as a supercomputer cluster.
Yeah, I agree that would be interesting. In fact building different clusters from various bits of historical and new hardware and then benchmarking them would be quite interesting, but alas very time consuming!
@@GaryExplains my master thesis where done in the early 90:es, and it was about creating dynamic computing clusters using heterogeneous computers (various hardware architectures at the time). Given the overall limitations we identified types of problems which could scale using the available technique. Great fun and on the cutting edge for it's time. The main benefit was that the computer clients connected where largely unaware that they committed computing cycles, the jobs was running int the background. The base was done in pvm, in many aspects the successor to mpi.
excellent explanation. Thank you! Back in the early days of the IBM PC, I wrote a game with virtual robots that did combat in a virtual arena, and each "Warbot" ran its own program, which was an interpreted language I wrote just for that game. The language was called R-Code. In this case, The R-code interpreter was running 5 programs at once, and each program had it's own simultaneous i/o. That was pretty cool in the old DOS days before windows and multitasking.
@@hammercanttouchthis By that time, 1991? I was running it mostly at work on IBM XTs running MSDOS 3.3 or later, as i recall because we had 3.5 inch floppies. The entire programming environment and game fit on a single diskette. It was only 10,000 lines of QuickBASIC code. I never released it to the public, but I had one other friend who was interested in programming who liked writing R-code for the warbots.
Cool video! One question, though: can the Raspberry Pis be connected via GPIOs and make them behave like the cluster in the video? Will it be more effective that way?
thanks for the info.need to study more about the clustering pi .For example begin to cluster 2,then 4, then 8, ....until recently Oracle already built the 1060 Pi s
On my old Amiga I did a lot of fractal scenery animation and it took ages, this would be a really good demo of connecting more computers thru a slow bandwidth link. And raytracing also, Lightwave was really great as renderfarms go, one master/server (with GUI) then just send the resources to a bare minimum program that actually calculates the different images and sends it to the master/slave and it is pretty good on resource management as it just hands the nodes the images that is not done (hard to explain) but it really meant that you could connect pretty much anything... a slow computer, a fast computer and so on... it used everything at 100% all the time. Do Povray exist on the Pi? If it does that might be a good start for a great demo of connecting PI's :-)
First of all, Thank you Sir for doing this video, Is any bloggs of people specifically doing this project and maybe expanded the project? Please advice, I want to join.
@@YouArentValid Yeah, this struck me as one of those "I need content for my channel" videos. I'll bet he took it from a howto found on the Interwebs too? Plus, it's been done to death already.
Nice work, Gary! And if you want to remove the overhead and speed up calculations greatly, you can switch from Python to Golang, for example, and have microservices do the work
Hello Gary, great video, ty. I have a cluster of 11 rapsberry's. no problem with that, but i tried to insert a virtual machine as a node, it is not functionning. the virtual machine can work as a master node but not as a node of my cluster Why is that ? Thank you
HI thanks! Beautiful video. I tried your program on 2 RasPi 3's. But it still says running on 2 cores instead of 8 When I use a single RasPi it runs on one core instead of 4. Any idea how to fix this?
That is a neat idea of making a Super Computer from a group of small computers like the ones you mentioned. I wonder if IBM has thought of that since they are into the Super Computer business.
Yup, that was a project that the US Military did because the PS3s had a lot of cores in a relatively compact form. It made being able to source machines from around the world really eaay.
Could you run this kind of cluster with multiple different OSs and machine types? For example, I have a few Pis and also some old office desktops. Could I simply run them together?
I wonder how many Pi 4s it would take to produce the same number of flops you get from the minimum baseline Cray super computer set up. Does that setup you have produce the amount of calculations that can be performed by a current gaming laptop? It might be interesting to know how many Pis it would take to produce the same computational power as a gaming laptop and what the difference in price point would be. Thanks for the interesting demonstration.
This just shows the purpose of Raspberry Pi, a learning tool. I never thought they would bring it to Server/Clusters. It's a great teaching tool from basic programming to now supercomputers. Raspberry Pi may not be a world record PC nor a Supercomputer with Tera flops in processing power. But it has proven to be a super teaching device that's caught a lot of interest world wide for those who want to jump in and learn. And a great gaming emulator! d^_^b
Thank you Gary, this is really great! Is it possible to create a p2p network with Raspberry Pis? That would be really useful in disaster zones or places without internet so that people can communicate with each other over a RPI mesh network
I am running Motioneye OS on a Raspberry Pi4 4Gb, this connects to 4 x Wyze Cam V2. The problem i have is the videos are not smooth and the frame rate is low. If i cluster some Raspberry Pi4 would this be possible and make performance better, also how could i do this, Thanks
You should try this with the rockpro64 and connect each board together through the pcie to get really low overhead. Might even get to write your own kernel and mpi layer!
@@NoorquackerInd Well if you're going to use a comm card, it would be a lot easier to put a ten Gb network card in the pcie slot. I was just thinking to keep costs down, you could try to run the messages over just the pcie lanes.
Processing wise yes because you would end up with around 3.6 ghz of processing power for 130 dollars wich is a good deal Idk whether it would be effective though because of the low power gpu the pi has
That would be pointless, because unless your doing instense audio processing, there would be no point in having a dedicated audio pi, and just one pi is not enough to do much video editing on, and at that point what would your third be used for if not everything else?
🖐🏻 question: In the super computer setup - the other prime numbers are missing when in a cluster setup. Wondering where are those results? I am thinking why the other nodes didn’t return the values?
Hi sir, is it important to use same models of pi to make a cluster, or we can use different models to make one nice powerful computer. i have two pi3 and one pi4.. thanks.
I have a question about the Mastery Course Bundle. Three of the courses state a specific Pi is being used (Zero or 2). Is that the only Pi that the course will work with? Or if I have a Pi 4, can I still complete the course(s)? Just subscribed, looks like a very interesting channel to get started with coding and computing with Pi's!
i've always wondered about this and wanted more information. even after the video i still do. can you name some practical tasks that lend themselves to this kind of computing cluster? i've seen people make them a few times, but it always seems to be 'just out of interest'.
raspi's aren't really powerful enough to make this useful or scalable, but there's probably a researcher or two somewhere out there using an SBC cluster made from more expensive boards, especially ones that support PCIe.
@@AmeshaSpentaArmaiti ok I see, thank you! So with pis it really is just a theoretical exercise. Shame, since I have a few, but they're good for lots of things!
@@twistednickster2653 not sure if ur joking or not but pong can be played on a web browser if your lazy, or if you have some time, you could get a retro console emulator and set up a pong ROM on it. Or you could program one with python.
Could I run SETI on this setup, I assume I would have to write a program. My very newbie question is why couldn’t this setup run like an everyday pc with windows on it.
Gary, I was using two vastly different computers. Computer 1 System 76 Meerkat with an i5 7260u processor. That computer alone could do the prime number program in about 4 seconds. 2nd computer, celeron based ChromeBox but in developer mode and also running Linux. Both systems using PopOS! 19.04 from system 76. When I add the celeron computer into the mix it takes MUCH longer. Like 1 min 30. I thought that even though the second computer was much less powerful, it could at least add some help to the calculations. I was somewhat surprised by the outcome.
I think with MPI Scatter and Gather the controlling node waits for ALL the computers to finishes their calculations, so slower computers in the cluster will slow everything down. You can write the program differently so it doesn't have that problem.
For those asking about the rack, I don't remember exactly where I bought it. But here are a few from Amazon that you might like: geni.us/3AAUtfx and geni.us/DbWsT and for the UK this one: geni.us/rGjT6
Does this method your demonstrating using the MPI library allow these RPi's to combine system resources ? I know you said that it sees 4 Pi's = 16 Cores , does it also pool the RAM ? Assuming the answer to both those questions are yes , can you still enable ZRAM within the cluster ? When compiling programs on the Pi it tends to hit swap after a point , ZRAM allows the Pi to swap to the RAM instead of the MicroSD (im sure you familiar). I would want to use a setup like this for compiling , does this cluster configuration help me in that regard ? Thanks Gary .
I suggest another rack with fan kit:
www.amazon.com/dp/B07MW24S61
and for the UK:
www.amazon.co.uk/dp/B07J9VMNBL
Hello Gary, I would like to thank you for making this video and maintaining such an informative channel. you are very easy to listen to and your explanations are to the point. Keep up the good work. Today was the first day i saw your channel link and decided to give it a go.
the raspberry pi is a great pltform. However the raspberry PI Zero is a very compact development board as well. The Pi Zero does not have the compute power of the big pi. however the integration of the wifi on the board makes it one of my favorites.
I built a super computer using the PI Zero as the main board. I loaded each PI with aversion of Windows 2008 data Center Server. I used RUFUS to flash 64 GB microSD cards with the OS. Once i had the OS working I cloned it using tis program...
clonezilla.org/clonezilla-SE/
I have a multi-slot microSD card reader. It holds 24 microSD cards and connects via usb 3.1. I installed teh Windows 2008 Data Center Server on the microSD cards in about 15 minutes. Windows Server 2008 Data Center can cluster up to 32 machines processors at once. The Windows platform is very stable yet it is a little large. About 3 GB on each microSD.
I used the data center server services to aggregate all the Raspberry PI processors and resources. i used the Wifi on each chip to bridge them all together. I only spaced them about 1/2 inch apart. The network and teh data processing is so fast that it returns almost instantly. I mainly use the cluster just to browse the web and play games. It is absolutely over kill on any kind of gaming or graphics program.
I set the paging file on all the drives to 512 initial max 4096. I also connected an external 3.0 6 TB hard disk to the USB mini on one of the PI. Number 32 in the cluster. Then all teh data i download goes thru the other 31 and passes down stream directly to the external like a funnel. I can download a 4K movie in about 55 seconds with my AT&T fiber.
I thought you might be interested in looking at this flavor of PI super computer. Of course i have Python, PHP 7.2 and AMPPS installed on the cluster. Automatic load balancing and wifi VLAN tagging.
The windows 2008 server data center can open up a whole venue of new and powerful applications you may be interested in
@@kevindeng1889 hi
@@eg3730 hi
A long time ago, a man named Bill Gates had a vision: "A computer on every desktop"
Now, thanks to Raspberry Pi, a new vision has emerged: "A supercomputer on every desktop"
But if every desktop computer is a supercomputer…
@@SS-ARYAN then we can only dream bigger, my guy 😎
considering the physical limitations of transistors, the only way to turn a single device into a supercomputer is through the cloud.
This is by far the best example i have seen on this topic, excellent vid
I do enjoy your videos, even though I already know pretty much everything you discuss usually. And I have recommended it to people who do need to learn about a topic. Great format, production quality and content. Thanks for making this.
Wow! 12 minutes super computing lecture gives you more than a 4 year bachelor degree
Guessing you have that 4 year bachelor's degree and you're referring to it aren't you?
No. Just no.
I know you're trying to compliment the video (maybe inflate the audience's ego?) but I think your university ripped you off...
the university teaches you in more detail and less effort. this video is less in detail (in a nutshell)
@@infinity5288 Less in detail with more effort put into explaining the detail. I would say that teaches more, because the less effort put in, the less that you get your point understood, therefore you teach LESS because it is not taught, just stated.
Thank you Gary. There are a lot of videos on how to build a cluster with multiple rapberrys, but this is the first time I actually see it running as a cluster. All other videos stopped after the build, or ran them as individual computers.
The example you used with primes is one of concurrency rather than parallelism it seems. This is a very good primer on the basics of high performance computing though. Good video.
Man I love this channel, always something interesting to learn
Very informative, i've always considered making a mini supercomputer (raspberry pi 3 +b)
Reminds me of concurrent & parallel computing class back in college, specifically the grid computing chapter. The classic example we used back then was matrix multiplication, while for the project we choose to parallelize inefficient sequential sorting algorithm with final goal to beat quicksort up to certain data size (because eventually quicksort still wins, it's just a much more efficient algorithm after all).
What I find interesting is that that program you ran is the equivalent of what was run on the EDSAC computer in the 1950s when it was doing nothing else and you are generating more prime numbers in 30 seconds than it could in just under 10 years.
WOW!
Yeah, even the chips you find in those musical birthday cards have more computing power than all the Allied Forces put together did in WW2. It's crazy.
@@AbhinavSubramanian but we went to the moon on that power?
@@dashboy007 even your current computer/laptop/phone no matter the model is still many times more powerful than the greatest computers of the ones used for the first few moon landings
@@bnbnism I was trying to be sarcastic. There is no way my phone today could power anything else but itself, let alone a rocket ship.
Wonderful way to explain Gary, thanks a ton.
I looked a few of these Raspberry Pi clusters and for less than $800 I bought a used quad processor 32 core Xeon Dell R820 with 96 GB of memory..... and it just works. Sure when it's running it consumes more power but it's a unified memory across the 4 processors which makes HPC easier.
Yeah, i did it months ago with 4 raspberry pi 3 and MPI4py and it work very well!
I also used psh (parallel secure shell), very useful tool.
Gary, this video was informative :) Thank you
Thanks I learned something new today!
This was such an interesting video. One of the best I've seen in a long while!!
Wow, thank you!
amazing explanations. Great work, thanks
4:14
On serious note. Love the channel. Love the video. Very informative. Thank you!
What people forget about the old microwulf clusters is they use 2 gigabit connections to per board to share data. The Pi3 has 1 ethernet connection capped at 300mbps, which made clusters actually slower than a single Pi. Now that the Pi4 is here with true gigabit and USB 3 support to add a second one, a Pi cluster might actually be a viable project.
So this video is misleading? 🤔
@@hammercanttouchthis it was a nice simple example.
It depends on the problem you're trying to solve. If the problem you're trying to solve requires minimal network bandwidth(small inputs and outputs) but requires a large amount of CPU processing time... Then the older pi's will work just fine.
@@hammercanttouchthis It was obviously a demo of a theory of clustering put to practise, not a video about optimisating data bandwidth and latency.
Thanx a lot Gary. merry christmas.
Thank you Gary!! I learn more watching one video than spending hours on so called Tech Channels.
I agree... He is very good at the explanation and easy to listen to.
Watch tech quickie on yt
@@falcondarkshadow agreed linus and the gang really do good job there
@@philh98 definitely
Great explanation!
Nice video, really well explained!
Thanks for the nice explaination 😁
Really interesting! I’ve always wondered how that worked.
perfect explanation 2:30 - 3:00 planning to have one built soon
aside from having rpi4 , i was also thinking about orange pi to have as another alternative
then mix them if possible just need more research on this
thx sir Gary
Nicely done. Thanks!
awesome, never knew anything about super computing, and now i know, thanks.
Could you use a lower latency/higher throughput interconnect like direct PCIe connection to increase the performance?
For a few computers it could be possible (certainly not on large scale supercomputers since PCIe 3 has max. cable length of 8 inches).
Closet we can get now a day in my Datacenter that i take cared is FC (Fiber Channel).
Every single server in DC and inside cluster are connect together in network via FC for lowest latency and maximum transfer rate.
We use infiniband in an HPC setting. Its connected through the PCIE bus.
*GARY!*
*Good Evening Professor!*
*Good Evening Fellow Classmates!*
MARK!!
Super cool video - would be great to see more examples!
Really loved this video :)
Forgetting the cost of power for a moment I am curious how the performance compares to a PowerPC based cluster which was probably the first "out of the box" consumer level hardware solution available that could be configured as a supercomputer cluster.
Yeah, I agree that would be interesting. In fact building different clusters from various bits of historical and new hardware and then benchmarking them would be quite interesting, but alas very time consuming!
@@GaryExplains my master thesis where done in the early 90:es, and it was about creating dynamic computing clusters using heterogeneous computers (various hardware architectures at the time). Given the overall limitations we identified types of problems which could scale using the available technique. Great fun and on the cutting edge for it's time. The main benefit was that the computer clients connected where largely unaware that they committed computing cycles, the jobs was running int the background. The base was done in pvm, in many aspects the successor to mpi.
Thanks for your knowledge
Fantastic video! Subscribed :)
Could this concept be used with computer vision to speed up the process over a single pi3?
thank you...subbed really intersting video.
excellent explanation. Thank you! Back in the early days of the IBM PC, I wrote a game with virtual robots that did combat in a virtual arena, and each "Warbot" ran its own program, which was an interpreted language I wrote just for that game. The language was called R-Code. In this case, The R-code interpreter was running 5 programs at once, and each program had it's own simultaneous i/o. That was pretty cool in the old DOS days before windows and multitasking.
What version of DOS did it run on? And did you mean it ran on the IBM PC or XT? :)
@@hammercanttouchthis By that time, 1991? I was running it mostly at work on IBM XTs running MSDOS 3.3 or later, as i recall because we had 3.5 inch floppies. The entire programming environment and game fit on a single diskette. It was only 10,000 lines of QuickBASIC code. I never released it to the public, but I had one other friend who was interested in programming who liked writing R-code for the warbots.
Reminds me of Robot Wars. My friend and I had a blast programming our robots to pummel each other in the ring.
Tht why i like to watch ur show... So many things to learn
Cool video! One question, though: can the Raspberry Pis be connected via GPIOs and make them behave like the cluster in the video? Will it be more effective that way?
thanks for the info.need to study more about the clustering pi .For example begin to cluster 2,then 4, then 8, ....until recently Oracle already built the 1060 Pi s
Fantastic channel love it
As always... great info... great hob!!!
you're the man,,, ;-)
On my old Amiga I did a lot of fractal scenery animation and it took ages, this would be a really good demo of connecting more computers thru a slow bandwidth link. And raytracing also, Lightwave was really great as renderfarms go, one master/server (with GUI) then just send the resources to a bare minimum program that actually calculates the different images and sends it to the master/slave and it is pretty good on resource management as it just hands the nodes the images that is not done (hard to explain) but it really meant that you could connect pretty much anything... a slow computer, a fast computer and so on... it used everything at 100% all the time.
Do Povray exist on the Pi? If it does that might be a good start for a great demo of connecting PI's :-)
First of all, Thank you Sir for doing this video, Is any bloggs of people specifically doing this project and maybe expanded the project? Please advice, I want to join.
Great job. Thanks for the video.
Nice. Very clearly explained and demo'd
wow great video dude!
enjoyed this video well presented
Gary, wich could be an use for a webdeveloper, videomaker or 3d desigenr with blender? Is it possible to do a renderfarm with it?
Why did you not use the Lite version of Raspbian? You lost no end of MIPS to running the GUI.
And would disabling the Desktop interface from raspi-config increase the performance?
@@0lAlex0 heck yes. You'd have gained about a 20% performance increase. The GUI is a beast.
But the demo video would suck
Because he doesn't actually want to calculate prime numbers as efficiently as possible, he just wants to make a video about cluster nodes lol.
@@YouArentValid Yeah, this struck me as one of those "I need content for my channel" videos. I'll bet he took it from a howto found on the Interwebs too? Plus, it's been done to death already.
Reallly good sir👍👌
What are some use cases for a super computer of this small of a caliber?
(I am a bit new to the tech scene so if this is a dumb question, that is why)
something new! thanks prof Gary
Great video!
Wonderful explanation!! Great channel.
Glad you think so!
Nice work, Gary! And if you want to remove the overhead and speed up calculations greatly, you can switch from Python to Golang, for example, and have microservices do the work
Hey Gary could you please upload a step by step video to achieve node cluster????
Hi, I have created a cluster programm, that runs before I even press
Thanks Gary. I also tried Apache Spark on Jetson Nano and it works. So I expect Apache Spark can work with Raspberry Pi too. The concept is the same.
Question! Can a raspberry pie supercomputer be used for blender software for faster renderings! And can the raspberry pies be configured with gpus.
😎 Real Tech Channel. 👍🏾🙏🏾🇿🇦
Thank you Gary.
Hello Gary, great video, ty.
I have a cluster of 11 rapsberry's. no problem with that,
but i tried to insert a virtual machine as a node, it is not functionning.
the virtual machine can work as a master node but not as a node of my cluster
Why is that ? Thank you
This was fantastic!
Can i use this to combine multiple chromebooks?
HI thanks! Beautiful video.
I tried your program on 2 RasPi 3's.
But it still says running on 2 cores instead of 8
When I use a single RasPi it runs on one core instead of 4. Any idea how to fix this?
Great video Gary:-)
Glad you liked it!
That is a neat idea of making a Super Computer from a group of small computers like the ones you mentioned. I wonder if IBM has thought of that since they are into the Super Computer business.
That was done with the PS3.
Yup, that was a project that the US Military did because the PS3s had a lot of cores in a relatively compact form. It made being able to source machines from around the world really eaay.
If I wanted to replicate this today which rapsberrys would you recommend, raspberry3 or 4?
You should make a video about quantum computers. A lot of youtubers have failed to present that topic in a neat way...
Could you run this kind of cluster with multiple different OSs and machine types? For example, I have a few Pis and also some old office desktops. Could I simply run them together?
Will the cluster be able to run daze 3d or halo2 ?
Nice and clear
I wonder how many Pi 4s it would take to produce the same number of flops you get from the minimum baseline Cray super computer set up. Does that setup you have produce the amount of calculations that can be performed by a current gaming laptop? It might be interesting to know how many Pis it would take to produce the same computational power as a gaming laptop and what the difference in price point would be. Thanks for the interesting demonstration.
Cool video! We have a few raspberry pis laying around, this would be a fun project.
Are you going to the SciPy 2019 convention in Austin?
No, unfortunately I am not going to SciPy.
This just shows the purpose of Raspberry Pi, a learning tool. I never thought they would bring it to Server/Clusters. It's a great teaching tool from basic programming to now supercomputers. Raspberry Pi may not be a world record PC nor a Supercomputer with Tera flops in processing power. But it has proven to be a super teaching device that's caught a lot of interest world wide for those who want to jump in and learn.
And a great gaming emulator! d^_^b
Dragonfly BSD is an OS designed specifically to handle a cluster like this.
Loren Sims does each node have to match the rest, or can any machine get added to the array?
Thank you Gary, this is really great! Is it possible to create a p2p network with Raspberry Pis? That would be really useful in disaster zones or places without internet so that people can communicate with each other over a RPI mesh network
I am running Motioneye OS on a Raspberry Pi4 4Gb, this connects to 4 x Wyze Cam V2. The problem i have is the videos are not smooth and the frame rate is low. If i cluster some Raspberry Pi4 would this be possible and make performance better, also how could i do this, Thanks
You should try this with the rockpro64 and connect each board together through the pcie to get really low overhead. Might even get to write your own kernel and mpi layer!
PCIe doesn't act super friendly all the time. It's probably better using InfiniBand cards
@@NoorquackerInd Well if you're going to use a comm card, it would be a lot easier to put a ten Gb network card in the pcie slot. I was just thinking to keep costs down, you could try to run the messages over just the pcie lanes.
Just curious how would you use this for video editing, is it possible? Would it be worth the time, money and effort?
Processing wise yes because you would end up with around 3.6 ghz of processing power for 130 dollars wich is a good deal
Idk whether it would be effective though because of the low power gpu the pi has
I just desire to have one pi for audio, one for video, and one to run them, to turn three pi's into a great desktop computer.
That would be pointless, because unless your doing instense audio processing, there would be no point in having a dedicated audio pi, and just one pi is not enough to do much video editing on, and at that point what would your third be used for if not everything else?
🖐🏻 question: In the super computer setup - the other prime numbers are missing when in a cluster setup. Wondering where are those results? I am thinking why the other nodes didn’t return the values?
They do return the values.
Hi sir, is it important to use same models of pi to make a cluster, or we can use different models to make one nice powerful computer. i have two pi3 and one pi4.. thanks.
You can use different models but beware that if you sent the same load to each node then the slower nodes will take longer to complete.
I have a question about the Mastery Course Bundle. Three of the courses state a specific Pi is being used (Zero or 2). Is that the only Pi that the course will work with? Or if I have a Pi 4, can I still complete the course(s)?
Just subscribed, looks like a very interesting channel to get started with coding and computing with Pi's!
There are new SBC micro computers which have a RYZEN 8 core processor called the UDOO BOLT V8 get eight and you could have 64 cores.
Cost of setup?
Electricity cost?
Can this mini super computer used for AI ML DL research?
i've always wondered about this and wanted more information. even after the video i still do.
can you name some practical tasks that lend themselves to this kind of computing cluster? i've seen people make them a few times, but it always seems to be 'just out of interest'.
raspi's aren't really powerful enough to make this useful or scalable, but there's probably a researcher or two somewhere out there using an SBC cluster made from more expensive boards, especially ones that support PCIe.
@@AmeshaSpentaArmaiti ok I see, thank you! So with pis it really is just a theoretical exercise. Shame, since I have a few, but they're good for lots of things!
Looks nice but would I be able to play Pong on it?
Nah we won't prob get that for another 5-7 years :(
@@twistednickster2653 not sure if ur joking or not but pong can be played on a web browser if your lazy, or if you have some time, you could get a retro console emulator and set up a pong ROM on it. Or you could program one with python.
@@mjs2016 i am joking lol dont worry i wont woosh you
Can u post the pic of the final setup on which u run this...
Brilliant!
Could I make a supercomputer by connecting old laptops/desktops/wiis/ds/dsi/cell phones/smartphones together?
Could I run SETI on this setup, I assume I would have to write a program. My very newbie question is why couldn’t this setup run like an everyday pc with windows on it.
Noob here, but I hear vine works
Great video thank you python it is
Gary, I was using two vastly different computers. Computer 1 System 76 Meerkat with an i5 7260u processor. That computer alone could do the prime number program in about 4 seconds. 2nd computer, celeron based ChromeBox but in developer mode and also running Linux. Both systems using PopOS! 19.04 from system 76. When I add the celeron computer into the mix it takes MUCH longer. Like 1 min 30. I thought that even though the second computer was much less powerful, it could at least add some help to the calculations.
I was somewhat surprised by the outcome.
I think with MPI Scatter and Gather the controlling node waits for ALL the computers to finishes their calculations, so slower computers in the cluster will slow everything down. You can write the program differently so it doesn't have that problem.
@@GaryExplains Thanks! I'll look into that!
Thanks for complete sherlock holmes on your github..
Is Beowulf no longer used?
Can cluster with nas can be build,?