Racking up a Raspberry Pi cluster!
Вставка
- Опубліковано 1 тра 2024
- Let's rack up the Turing Pi 2 4-node Raspberry Pi cluster! Thanks to MyElectronics.nl for the beautiful 2U mini ITX case.
Used in this video (some links are affiliate links):
- Turing Pi 2: turingpi.com
- IO Shield design on Thingiverse: www.thingiverse.com/thing:516...
- MyElectronics.nl mini ITX case: (not yet available for sale)
- Noctua NF-A8 PWM 80mm fan: amzn.to/3sFwkgE
- FSP180-50FGNBI 180W Flex ATX PSU: amzn.to/3EDt47Q
- Crucial MX500 2TB SSD: amzn.to/32NDft5
- StarTech TX3 to 2x LP4 Power Y Splitter: amzn.to/3z8u5Uh
Support me on Patreon: / geerlingguy
Sponsor me on GitHub: github.com/sponsors/geerlingguy
Merch: redshirtjeff.com
#RaspberryPi #TuringPi #Homelab
Contents:
00:00 - Rackmount for a Pi cluster
01:13 - Case overview
01:39 - IO Shield
02:14 - Installing the Turing Pi 2
06:41 - Tidying up
08:16 - Plug in and first boot
08:51 - Testing interfaces
10:14 - Release date and next steps - Наука та технологія
If you missed it, check out the first video on the Turing Pi 2: ua-cam.com/video/IUPYpZBfsMU/v-deo.html - I give an overview of the board and check how it would compare on the Top500 Supercomputer list!
The Turing Pi 2 *should* be going live on Kickstarter (I think) sometime towards the end of this month or early next month; make sure to sign up to be notified on the Turing Pi website if you're interested.
Special thanks to MyElectronics.nl for sending me this 2U mini ITX enclosure. Maybe we can convince them to tweak the design and sell it on their site :)
When can I buy it?
Cool Video Jeff! And Congrats on 250k Subscribers!
I have something that you might not have heard of, so you know those pcie splitters? Well, there are cheap mining ones on amazon that just hook up to risers. They only cost $20-30.
@@alexsteiner6103 For now, sign up to get notified when it's available on www.turingpi.com - it should be on Kickstarter soon!
@@vip_bimmervip_bimmer8033 yeah but by him they cost 10$
Thanks for another _very_ complete video, Jeff. And by that I mean, you really worked through the bugs and kinks and probably had to wait on replies and parts and 3d prints before even shooting parts of the video. It's a "complete" walk-through with all questions answered or at least addressed. This is, for lack of a better phrase, very good "tech journalistic content". Well done!
If people only knew... some of these videos do take many weeks of prep. I have one coming (hopefully) end of January that I've spent three months working on (so far-running into some more problems, ha!).
@@JeffGeerling Exactly. I've designed and built enough scratch systems and devices to know that it's nigh on impossible to anticipate every single firmware or adapter change. Keep up the great work!
Love the design of the enclosure! However, looking at the insides, it looks like with a little bit of rearranging from the manufacturer this could easily fit two Turing Pi boards. That'd be an instant buy from me!
not only that but wouldn't 2 1U PSU's fit where the flex ATX one is? Cus I think the turning PI 2 uses a 24pin
0:21 Keep ALL/ANY Raspberry Pies away from Red Shirt Jeff! They're in short supply at the moment and hard to get hold of, especially Pi Zeroes.
I heard the Pi shortage was because of Red Shirt Jeff. Truly a monster.
Turing Pi 3 should create angled slots like SO-DIMM memory. Space 'em out a bit to allow for heat sinks as shown. Then we'd get this into a 1U.
FINALLY THE TURING PI 2! Amazing way to do clusters.
I love the single faint chuckle at your Batman joke
Great video as always, Jeff! Looks like they could cut an access hole in the top, placing one twist-screw to hold it down in front, and a double open-hinge in back so the "lid" comes off; This would allow full access to the mini-ITX board. Also, while I don't see rack mounting holes, it looks like there is enough metal to place standard-spaced holes to attach generic rack mount rails. It ALMOST looks like you could put rails on there, and have one unit in the front of the 2u and one behind it. But I did not see dimensions. We used to do that for 1/2-depth servers a lot. But at least it comes with wings. I'm just not a fan of wings built onto the box, I'd rather have them screw-on like most routers and switches. I know--small thing. :) I'd like one of these. Have the TP2 on order. I have eight CM4s. Waiting to see what CM5 is.
Would be cool to get a Turing Pi2x
an NVMe port for each slot
An internal KVM so you dont need to disassemble to gain physical access to a stubborn Pi/Jetson
Maybe up to 8 Turing/Jetson boards
Congrats on hitting 250k subs, and the case looks great!
It would be awesome if the turing pi node mounts were angled at 45 or 60 degrees that way they would have clearance to fit 1U cases.
Really enjoy your exploits. Being a mere mortal I only have basic Pi 4 - fun none-the-less. Thank you
On behalf of all people with auditory processing struggles; thank you for having high quality captions -- and thanks for the high quality content!
You're welcome! My sister is actually the one who helps get the good captioning done for these semi-live videos, and she's top notch!
Regarding the 4:00 mark I actually like the way they've set up the 5 2.5" drive mounting as it means the rear fan pulls air across them to keep them cool which is pretty important if you were going to be thrashing them.
Maybe a thin top sheet could be provided/3d Printed to connect all the 2.5" drives together from the top too. Alternatively that could be extended into a shroud to funnel the air from the case through the SSDs then out.
Until you can get "better thermal management", I'd certainly tape up the cooling slots on the end near the fan and at least the first row on the top left (perhaps first 2) so you can induce your own thermal management airflow. I don't know what kind of heat loads those CMs will have but I certainly agree with you on their needing more airflow.
Good idea. Might just put a bit of kapton over the cooling holes on the left side.
I want the case! This is a very nice design I must say.
Sickness. I think I'll get this for my daily ITX. I've been looking for something like this.
I can't wait until they actually release the product. Been excited about it for awhile now. I've got a stack of Jetsons patiently waiting for their new home.
The last sentence about the power button and the following laugh are priceless :D:D:D
I absolutely love this, I've got an itx build in an nzxt H1 for my home server and a cool rack mount system like this would be great for the right price and with a few more holes/mounts for ventilation
I hope you arent useing the factory PCIe riser cable in the nzxt h1 theres a mistake with it than can short it out to the chasis and start a fire
@@sp3lllz I am, the secret is just never to remove the screws and you won't short the board
@@wertacus If you watch gamers nexus video about it from early last year they showed how easy it is to short it out and that just not touching the screws won’t guarantee it won’t short out. Personally I wouldn’t want to risk my house burning down for the sake of a new PCIe riser but hey your call.
I love love love how real world Jeff is. Great 👍🏾 video Jeff. I love your content.
Congrats on having a permanent build. Would love to see what you run on it.
One of my first storage “Servers” I setup for my home needed extra HDD mounting. I took the door/cover and drilled holes just like you have in your case. Mounted 6 2TB WD Green drives to the cover, screwed a hinge to back edge so you didn’t just pull the cover off and rip the SATA cables out of the drives. Suited my needs for a couple years before I got a proper case. Just comical to see the same mounting method
"But we won't say that in the video." Love it! 🤣
Looks very awesome.
I like smartctl "sudo smartctl -a /dev/sda" I use it to monitor the temperature as well if things get to hot I shut things down. I also watch the processor temps with sensor and shut things down 2 degrees C before critical.
That case looks great.
That’s actually a very good looking rack mount. 👌🏻
I could really use a case like that for a project I’m working on recently. I need a nice small enclosure to make a terminal controller for my IBM terminals and that looks like a perfect enclosure for a mini terminal controller. It uses raspberry Pi’s as well as arduino for V1 and a custom FPGA board for V2. I really could use one considering I have the terminals and there’s no good small controllers available on the used market for a reasonable price. I definitely enjoy your videos keep up the good work!
I love the way you end your videos "Unti next time, Im Jeff Geerling" Aight ill tune in next time to see who you will be 😂
You never know!
As a Star Trek fan, I am deeply disappointed that Red Shirt Jeff is still alive.
Don't know what I'd do with one of these but it's fascinating to see it developing
Really cool hardware!
Jeff, great video!
Just a small tip; if you want to know the name of the SSD manufacturer and the model of the SSD, you can use the lablk like this: lsblk -o name,model
Amazing! I have a large pile of drives in my box and this is super handy to identify them.
This is definitely a prototype rack case. It is looney to have screws from the bottom holding drives in. Make it so the front cover is the access to the drive bays and put the drives on a sled. The screws for the lid are okay if there is a hinged access door in the top that requires no screws at all. There should also be at least provisions in the sides of the case for small fans. Almost all of these changes can be done by modifying the sheet metal. Nothing fancy needed.
Yes and given Jeffs ability with an extruder Id suggest just making a mounting plate so the drives can be simply clipped in.
I don't see any issues. You can even mount hard drives like that. There are no moving parts on SSD so it makes no sense to not mount them in a way that saves space.
@@BrunodeSouzaLino - I respect your frugalness. I’m definitely a do what works guy. But there is some room for improvement on this case. Would I use it as is if given to me? In a New York minute.
Can't wait to see this thing set up as a K8s cluster.
Seems to be a nice case, I have a Supermicro 1u and it would be better as an 2u. It has 4 sata connectors but only place for two HD´s.
In this video, there is a rare case of wife laughing at a joke.
Loving the off-camera giggles! (I'm sure I heard a couple - one at the Batman line, and one at the end) :)
That must be so sweet to install XMRSilent miner on every one of his machines 🤤
I rue the day in the 80s when electronics started coming in black. I need a flashlight to see the markings on my stereo amplifier and ports and earphone jack on the side of my Lenovo laptop. Thankfully, I saw a silver Sharpie for writing on black surfaces on Amazon.
Just wait until you have older eyes.
I'd really like to see a 2U rackmount case like this meant for 2 mITX boards; could run a SeaBerry and a Turing Pi2 in the same case. If it were deeper the drives could be standard swappable carriages. That would make for a wildly diverse and powerful ARM box.
Finally someone has come up with the idea to make a pi board that fits in a regular pc case. !
That is froogin' nuts!
I was about to get some sleep and then...
New video from Mr "Pi" Geerling.
Regarding those SSDs, the mount point is weird but...
I would have totally put ONE screw in FIRST, secured it, THEN put the second one and secure it (imho).
😁🥰
P.S.: Happy New Year BTW! 👍🏼😷
That would work too!
Looks good, but seems a little overkill on wasted space, and could easily fill up a rack with these.
Would love to see a similar case that holds 2 Turing Pi's with one shared power supply. It the case was slightly deeper it would allow for SSD at the front (maybe even hot swap capable), with fans in the middle. would be great for airflow and allow 8 nodes in a rack.
Looking forward to seeing you with a 1U rack option from Ivan Kurlshov containing 20 CM4 blades. That would be some serious clustering. 😀
You could install a small temperature controlled supply for the fan, listed as "12V DC PWM PC 4 Wire Fan Temperature Speed Controller" on ebay. With the SSD Id suggest extruding a clip in mounting plate for them so installation and removal would be a breeze.
New T-shirt.
“Days since I had to JTAG in to update the boot loader. 0”.
That's only if I get deeper into embedded programming... 🤔
I think that case need 80mm slim fan at front and 2,5" and 3,5" track and and add fan in that vga mount and that gonna tunr into pi server
Damn! I would love one of these.
I was thinking it would be awesome to have a dual mini ITX 2U rackmount case for two of those Turing Pi 2 boards. That would give you a tonne of possibilities having eight SBC in it.
I really want to get more into RPi cluster. I only have one running NAS duty and own cloud. But wondering what more could I do with 4.
If I could ever get CM4s or a Turing Pi 2 I would love to have a rack case for them.
Better tell them to get that case available! The board got lots of backing, I'm sure many up us would love a little rackmount action for it :)
Rather than hot-swap trays, just add 2x 5.25" bays in the front for icy docks and farm out the hot-swap part.
You could maybe 3D print fand holder that connects to something else inside of the case to get a bit more airflow over the PIs I guess.
Slick looking case
I wonder if the case was a little deeper if you could fit two clusters
I love boxing videos. So satisfying
2u short rack!!!! I need 3 of it! one for the home server, one for the router and one for the nas
OH lord yes! I was about to let you know about this!
Would this Turing Pi 2 cluster be a good candidate for use as the "Third Node" with Proxmox to use as a low power alternative to an enterprise class equipment for the 3rd node?
It would be even MORE awesome if you could have TWO Turing PI 2's in there. There's plenty of room! That would be a BUY from me!
I must admit that attaching both SATA ports to node #3 and all USB 3.0 conenctors to #4 is a serious design flaw: For redundancy (and maybe load balancing), you would attach on of the SSDs to one node, and the other SSD to another one (just in case one of the CM4s should fail). You could then use Ceph to establish a RAID over both nodes (and both drives).
there are several 2RU case options. but many are WAY too expensive. the Monoprice box (can a link go here?) is a $1oo bucks. you could also sacrifice some old rack server. those you can often find for cheap or even better free. however, most RUbox of that style are really long. and noisy.
I kind of like the mounting method for SSDs, but if I was going to use any spinning discs I don't know if I would trust it with the vibrations.
There are a number of NAS which mount the drives this way. The only big no-no for hard drives is setting them at an angle.
When you´re sitting there, shifting your head to get a better view because Jeff´s hand is in the way... And after some seconds you realize: it´s a video, the angle is fixed.
The fan is on one end of the case blowing across the drives (which I doubt generate much heat) whilst the CM modules are on the other end of the case where it would seem there is not much circulation. Am I missing something or is there some other way the CM modules/Turning PI are getting cooled? Or is that a concern at all?
Do you see any issue (power or data) with setting a zfs mirror on a pair of external SSDs connected to single rpi4 via usb3? I don't have cm4s and I like your approach with nfs shares for pod persiatent storage.
congrats on 2^8 * 10^3 subs
keep up the good work and high quality projects
I'd love a flat case like this, but without the mounting front overhangs - just a box
Gosh. With that size, and a slightly different layout, I bet they could have a case that fits 2x Turing Pi 2 boards. One one the left, one on the right, and SSD storage down the middle.
I'm very much intrigued, just wondering about the price and the practical functional application besides educational purposes? love your vids as always.
Can fit dual mitx systems in this case. Would be neat if they release a version that can convert between single and dual system configuration.
That would be nice. Would require a bit of origami with the power supplies but it's doable with the space inside.
I’m 100% interested in a rack enclosure for Mini ITX. I have plans for multiple home servers, and would much prefer a 2u that looks good tot he generally available ugly 4u units.
Nice case. I would just cut a hole on the front side on the left for a 5.25 bay and put one of these cages that can handle 4 Sata 2.5 drives for easy disk swapping/replacing once it is in a rack.
That would be a simple option. Plus you could pop a CD-ROM in there and relive the old days!
You should show a software defined radio on a pi. Might need a power boost from a usb hub. You can hook up an outdoor antenna.
If you think there are too many screws, just put the superfluous ones in a little bag and stick it somewhere inside the case. You don't necessarily have to screw them all
the case could be a box design, once mounted in the rack, pop a few front panel thumb screws and pull the bottom plate out
Nice new home for the Turing Pi...just to sad that you can fit just one mITX Board into it. I'd guess from the room it would fit two of them next to each other and at the top there would be some space for SSDs as well ;-)
"I'll spare you the details"
We want the details, Jeff!!!
Heh... I may at some point. I have so many video topics in my backlog right now...
Jeff: We dont have enough cm4's on sale
also Jeff: CM4 PI CLUSTER GO BRRRRRRRRRRRRRRRR
xD
Well... Seeed Studios actually has "100+" 8GB CM4 Lite modules (the ones I'm using in this video) in stock right now! Go grab one if you need it, not sure how long that'll last...
Please make a video making a Wi-Fi 6 raspi access point. I haven't found much on this topic and I think it would be a great concept. You could even do it on different types of Pi's but I would imagine it would work best on the Pi 4 or CM4. Love the videos keep it up!!!
I've been working to find an affordable AP-capable WiFi 6 card, the sad thing is most of the easy ones to find are Intel and can't work in AP mode :(
@@JeffGeerling That is big sad. I wonder though, do you think even if it wasn't "affordable", you could still build one that is reasonably priced for its capabilities versus something off the shelf of similar performance? Thanks so much, I appreciate the community engagement!!
hm. if this chassis is tweaked you can easily toss in 2 of those cluster boards and power them both from that single psu
Congratulations on 250k subs .. you always get a like from me
This comment always gets a like from me!
My wife just got me an M.2 Pi NAS setup, but unfortunately, I can't get my hands on any boards! Can't wait for things to normalize so I can get more intimate with stuff like this.
It would be nice if there were fan mounts on the front of the case to cool the pi's
Sure would be cool if these cluster boards were actually available...I want one lol
3:41 Just feedback, not calling you out or something: if you use a magnetic screwdriver and compatible screws, you can do this with a lot less balancing and juggling.
Hope they start selling that case instead of just special order. Very stylish.
Nice Case. Is it possible to mount an extra 80mm fan in front of the Mainboard? That would be a better cooling solution for all Boards.
@Jeff Geerling, it seems like if we wanted to run a Kubernetes cluster on this setup with persistent storage, we'll be limiting ourselves to those MicroSD cards or EMMC on the compute modules themselves. I suppose we could also configure node affinity for those deployments that require persistent storage and use the sata drives on pi3? What are your thoughts on this?
I'm planning on setting up NFS on node 3 and then using K3s' NFS integration to mount persistent volumes. No extra redundancy but the speed should be better in most cases than eMMC or microSD storage local to the Pis or via Ceph.
@@JeffGeerling Thanks for confirming, funny enough, as I was sitting here mulling it over thinking NFS would be a good workaround, not realizing that K3S supports NFS as a storageclass natively. Appreciate all you're doing for the community, and the prompt response.
edit: I really can't wait to see the upcoming K3S video.
been waiting for this vid
Screw it, Jeff. Screw it in. 3:35
:D hahahaha
I want one of those cases!!!
Awesome, pls make a video of your server it would be intersting.
2:55 #Crucial 💯
Putting the top of the case on before testing it is tempting murphys law.
6:35 in - check out the bend in that motherboard - just glance at the sockets behind the IO shield and see how far they go out of alignment. Will the PCB be made thicker or less bendy before release?
To be honest, I think the better solution would be to either place a spacer on the middle of the motherboard or make sure the enclosure has the middle stand-off installed for better stability. the board itself doesn't flex too bad, but some of the plugs near the middle require a bit of force to install.
Just how far in terms of storage can you take it?
with a few adjustments, it looks like you could fit 2 boards in that case
Probably, just a little Pirigami required.