700TB Chia Farm Moved to a 25U StarTech Server Rack, Still Growing!
Вставка
- Опубліковано 11 чер 2024
- Featured Products: (affiliate links)
StarTech 25U Rack... amzn.to/3cRfeH3
48-Port Patch Panel... amzn.to/3RENBzD
2U Equipment Shelf... amzn.to/3Bf7g3T
APC Rack Rails... ebay.us/Qen5FH
Supermicro CSE-836... ebay.us/KvQKZY
Cheap Refurb Drives... amzn.to/3AVgJff
2.5GbE Network Card... amzn.to/3RpoEsg
0.5ft Ethernet Cable... amzn.to/3QqOB9E
Printable Heat Shrink... amzn.to/3TNXzko
Originally published September 6th, 2022. The Chia farm continues to grow! I've been grabbing up drives as I see deals around ebay, reddit, and other trading platforms. I'm up to 700TB currently and still have room for a few more. I've outgrown my previous setup and it was time to finally make the transition to a real rack.
Chapters:
00:00 Introduction
00:52 Assembled Rack
01:55 Patch Pannel
03:02 Ethernet Switch
05:07 Shelf Accessories
05:40 Supermicro Rails
07:56 Home Server 2U Case
12:44 Completed Overview
Contact Info:
Business email is lithiumsolardiy@gmail.com. I am not available for personal project questions or consultation.
Disclaimers and Statements:
► I receive a small commission on purchases made using my affiliated links shared the video description and comments section. The views and opinions expressed here are my own, unbiased, and not influenced by this commission in any way. - Наука та технологія
StarTech 25U Rack... amzn.to/3cRfeH3
Supermicro CSE-836... ebay.us/KvQKZY
Cheap Refurb Drives... amzn.to/3AVgJff
(affiliate links)
good decision to add a channel instead of messing the main channel . I had just unsubscribed jchristina channel which was photo graphy / editing / camera channel and became over time a starlink channel with 50% starlink content I did not like at all and unsubscribed 10 minutes before I watched you announcement video about the server topic.
I subscribd cause I have not much clue about the stuff you are doing cause I am avoiding this whole server mess but I guess I also have to prepare a rack sooner or later.
Solo rack mounting tip: put cage nuts in the next slow below the "bottom" portions where you will mount and thread a screw in decently. you now have a bit more to support weight while you sink the first screw.
That's a great idea!
You can also use a longer screws in the cage nut to address the support!
This guy mounts.
Beautiful setup my brother
you have inspired me to rack up my farm too! great little project!
Awesome! Just a warning that it likely won't stop once you start, it's addicting!!
This was a really fantastic "setup" video.
I've got one of their open frame small racks as well. I was VERY surprised at the weight of the box when it arrived. Much heavier than I thought it would be. I was impressed. One of these days i'll actually assemble it. been in storage for ~2 years now, lol.
I was equally surprised when I had to haul it down the stairs. My only regret is not buying the 42U version of the rack at this point! Loving it so far otherwise.
@@HomeSysAdmin I had to lift mine up onto the loft in the storage building. It required some creative positioning and leverage, lol. I imagine getting it downstairs was more of a controlled bobsled event, lol.
Waiting to receive my 42u version tomorrow..
Love the setup. I'm at 200TB right now and dreaming of a setup like yours!
Thanks! I started right around the same and just started stalking eBay for deals mostly. Equipment is a lot cheaper now than it was a year ago during the Chia rush.
Awesome setup, thanks for sharing it.
Very nice setup.
Thank you! :)
Love the vids bud :) can't wait for more.
Thanks! More coming soon, maybe another week or two yet 🙂
I have the 24p Aruba 2500. Been rock solid after setup. I replaced the fans. SUUUUPER loud.
Interesting. Mine never seemed to run above "very low" which is... very quiet. I guess just depends on the load and ambient temperature.
I'm running a few 10gb solar flare 6122 cards for my setup and they work great. eBay had them for $20
Me 2
Good to see
It's more than doubled in since since this video lol
Damn it man.... Mine is just a drop in the bucket compared to yours. Maybe one day I'll get there. 😀
Good Job
very cool
I need to learn.
Is there any specific topics you'd like to see videos on? I'm always looking for content ideas 🙂
love your flow, give me more
That was a good video 👍
Well at least you took a chance
Yep, and still going strong!
This was cool. You are almost to 1000 subs! I'll add one more.
Thanks! Yeah it sure went up fast.
Nice
put in the cagenuts with the taps left and right. if you put them in top-bottom, its a pain to add or remove them side by side
Wow 700 Watts for 700 TB's Not bad.
Can you do an indepth video describing the JBOD setup and how you handle sas expansion and power?
I have a video showing how I built the CSE-836 JBODs on my other channel
ua-cam.com/video/8C6-Jw7-Sk8/v-deo.html
I love the rack, Jason Statham of IT! ;)
I have two freenas systems. one main and one back up. i really wanted 10 gig for peer to peer transfer (10 gig switch waaaaay too expensive). I looked into buying two 10 gig nic and ended up purchasing an sfp pcie card and an sfp for $40. I bought two since i wanted peer to peer but it cost me less than one 10 gig nic. you could look into those so you can get off of 2.5g. Great looking build though. I'm liking that rack and the castors. every time i pull mine out i cringe because it scratches my floor. I might need to do some upgrades in the future.
I need 10gig to the switch, not peer to peer - that's the dilemma.
The supermicro motherboard that was in the case is very superiori to the one that you replace, more capacity for virtualization, and run several applications.
Yes, I know the Biostar was no good. This was just the first step of the rack buildout. I have since replaced the board/components with a setup better than both, see this video ua-cam.com/video/YvqbTjTvMqY/v-deo.html
Would love to know more about your Chia setup and how Chia works.
Not worth it anymore
@vamwolf it's not really about making money fir me, it's more about learning. Learning different equipment, setups and how people have done things. I fond it interesting.
@vamwolf That's your opinion, not fact. It's completely dependent on your power cost, how cheaply you can get hardware, and your expectation in terms of ROI.
700TB right now would get you about $265 per month before expenses
I think it looks better if you use 24 port patch panel one on top and one on bottom of the switch instead
Maybe. I wanted to leave that space open for future expansion.
The 3 identical things below your Home Server 2u case, with all the hard drives in them, how does that work? Are all 3 of those connected to the server above it? Wish we could have seen inside of one I understand everything that is going on but those 3 parts. Looks like they also have DVD-Rom and floppy drive for some reason lol.
I have an entire video on just that topic lol
ua-cam.com/video/8C6-Jw7-Sk8/v-deo.html
From experience, wheels with servers on top don’t move on rugs(very heavy). I hope you placed it in the optimum part. All in all excellent job.
From my experience with this, wheels with servers on top don't move on flat cement surfaces either lol. If it were doing this again, I would place the rack directly on the floor and not use the wheels. I'll probably make this change at some point in the future if I ever get bored enough to rerack everything.
nice set up. have you considered replotting with gigahorse and gpu farming? you will get a nice boost in effective space
Yes! I have about 1.7PB of raw storage now and just over 1PB of that is C8 Gigahorse plots :)
I just came here from soneone that put Chia Seeds on their toilet. I misunderstood the title assuming a chia rack.
LOL
Is it there where the internet is stored? Love your setup.
Haha, yes! And thanks :)
🔥🔥🔥
Are those floppy disk drives in the front of those units? BTW, I stopped mining Chia about a year ago, when the price tanked. Wasn't worth the effort. I am still farming 81TB and get a hit every few months. Eh.
Yes, they're floppy drives... lol
I just ordered a 10 Gb NIC from amazon for $45
Nice, which model did you get?
👍perfect great
What is the 2.5gbe compatible SFP+ module? I'm having problems finding a reasonably priced one that states compatibility.
I used Wiitek SFP-10G-T transceivers amzn.to/3AiCKVP in the S2500 switch. The transceiver supports 2.5GbE but interestingly shows up as 10GbE in the switch console. It works though and does indeed hit near full 2.5gbps.
@@HomeSysAdmin Thanks! I hope that's an affiliate link ;). We'll see if it works in my ICS-6610.
@@HomeSysAdmin Finally got back to this project. It works on my switch at 2.5G too. Thanks again!
ok thats nice the switch that is I look up on just for 24 port and for 140 bucks that is not bad at all. how is this switch compared to a netgear switch. I can find those for about 400 bucks. I have been wanting to replace my old poe switch that is 10/100 poe with 1g spf ports for uplink or stacking. I want to replace them with a 1gpoe with 10gb spf ports just like this switch you show in this video. Netgear has them but hard to find cheap on the used market. I do have a netgear 24 prot 10g switch. it was 450 just for 1 used. I will have to get one of these switch for the price its not much more than what I paid for the POEs I have now. and I need 2 LOL.
I actually replaced it with an HPE 2920 w/10GbE expansion module. It costs quite a bit more but the difference was around 45W vs 75W idle power consumption. It sure is nice that the S2500 had 4x SPF+ ports though.
I found a TP-Link TX401 10 Gbit network card for about $90 (tax included)
It's a pretty small card for being a 10 Gbit card but it works fine on TrueNAS (FreeBSD) and Windows
I haven't tried it on Linux yet but if it works with FreeBSD it should work with Linux.
DON'T use CAT 5e cables with it tho. I did and it had some issues with keeping a stable connection. It also only got 5 Gbit speed.
It's has a PCIe x4 connector so you need to think about that.
Personally I would add a 1u cable management above the patch panel, and a 2 u between the patch panel and the switch
That would look pretty nice but take up more rack space. I'm kindof regretting not buying a full-size rack at this point.
I want a rack so bad now lol
I'm in need of a larger rack already lol... Only 4U left and I need to put a UPS in there somewhere still.
Is the Aruba switch running the same hardware as a Juniper EX3300 by any chance? The port layout, screen and buttons looks identical
Just commenting as I watch so forgive me I'll be posting multiple!
For mounting devices on your own, I find it easiest to have one hand underneath the device, then screw in the bottom screws most of the way by hand on both sides to hold the unit in place which will free up your second hand to position it how you want it (some devices need a little wiggle to get them sitting flush against other devices) put the top ones in and tighten them all down. For my day job I rack up roadside telecoms cabinets and often work alone and this method works really well :)
Also some feedback on the APC sliding rails. Sometimes I find that the ledge at the bottom protrudes slightly into the slot below preventing equipment from fitting well. I recommend working from the bottom upwards with these, as you install each rail set, put the server on them before mounting the next rail set above it...I see now as I'm still watching that you've noticed that already
For the UPS I think the 1500VA unit may be a bit underpowered if it's running all of the servers shown, the sweet spot for loading with most units is around two thirds of the rated capacity to give a good balance of runtime without stressing the UPS components too much. If in doubt, bigger is better, a 2200VA would probably suit you fine but if you see a good deal on a 3000VA it never hurts :) I typically buy all mine used and if necessary replace the batteries myself
why not using a SFF8087 to Sata Breakout cable?
Because the backplane includes an expander and I'm pretty sure a reverse breakout cable would not have worked in this case without a proper SAS controller? I'm not certain though.
@@HomeSysAdmin it depends, but for sure motherboard have to support that
Are you still making profit? I closed mine down a good while ago.
I haven't sold any coins yet so it's difficult to assess but my electricity is cheap so ROI isn't as long as some may think.
That pach pannel has really bad shielding are you really getting 2.5 gig over that ?
At work we are using cat 6e pannels and cat 7 cables as standart
Yes, I am getting 2.5gig no problem. I'm using Cat6 and made sure to leave the wires twisted up to the punch-downs.
You can get a pair of Mellanox connectx-3's for fairly cheap and do 10gigs
Looks like those require SFP+? The problem I had was the SFP+ module for this switch was about twice the price of the RJ45 module.
@@HomeSysAdmin if budget it's an issue go DAC cable. 50cm 10G DAC cable is within 10bucks or so
I have a 10G DAC cable. As I said earlier, the problem is the switch. It has 4x 1G SFP ports. The module to add dual SFP+ ports to the rear of the switch is like $450.
@@HomeSysAdmin Ah yes, if you want it for the switch as well, that changes the math, on my setup it's from my nas to my pc
I'd be more impressed, but I'm going to end up with more than that (once I fill the monster) in ONE MACHINE - all hot-swap and all EXTERNAL ACCESSABLE.
Supermicro 6048R-E1CR72L is a fairly widely available server, and not all that expensive once you factor in how many drives it gives you (and you can make it it's own super-fast plotter by putting enough RAM in it).
Definitely only an option for larger farms though, it's serious overkill for someone in the 300TB or less range. 9-)
Those are some pretty darn nice Supermicros! Where are you seeing them for "not that expensive" though? The cheapest one I see on ebay is $2800...
@@HomeSysAdmin TheServerStore or MetServers (which seem to be the same company) often has the 6048 version (PCI4 and 2'nd gen E26xx v3/v4) for $1499 plus around $300 motor freight shipping (these things are HEAVY).
They also RARELY list the older gen 6047 version (PCI3 and E26xx v1/2 second gen) at $999 (same case, same weight, expect the same shipping).
That's the "bare" price, a pair of very low end CPUs no RAM no Drives but DOES include all the 36 dual-drive caddies.
I've long since filled it with mostly 10TB drives, some 12 and 14, a few 8 and even 6, then added a 36-drive version and some "use my own hardware in Rosewill cases" machines.
I have to use NFS to mount the drives to some of the other machines, to use it with NoSSD and GPUs (same would apply to GigaHorse), which is WHY I stopped buying the massive drive cases (for now).
👍👍👍
What are your thoughts on the consistently dropping chia prices? I take it you see a future for the coin.
The white paper economics was based on $20. Its early days yet and I don’t think we care too much about the price when we are minting new Chia as it is practically one of the only cryptocurrencies that is profitable for its miners(Farmers) -if not the only one if you pay more than $0.10 per kw/h.
I'm not a financial advisor. This is just a fun hobby to me and I don't spend money on it that I'm not willing to loose if the price of the token goes to $0.
I had 5 of these SM 836 chassis, 4 were gutted out and converted to DAS but the issues of noise, cooling and backplanes, man, I am glad I finally scrapped them. The servers are one of the worst for power consumption and made way too much heat. As for Chia, yeah, no time for WOFTAM crypto that does nothing at all other than waste power.
Wow, I would have paid you for those chassis - much more than whatever scrap cost you got. I don't understand how you had so many issues though. The backplanes are solid - never skip a beat. I replaced the stock fans with regular 80mm computer fans. I picked some that moved a lot of air but didn't sound like jet engines. The drives remain perfectly cool and they're quiet enough that you can't even hear them in the next room over. WOFTAM - had to google that one LOL. I just love playing with the hardware, it's fun!!
Here's a video published on my other channel that shows how I built them out ua-cam.com/video/8C6-Jw7-Sk8/v-deo.html
@@HomeSysAdmin Had to keep the stock SM fans and run PWM controllers in DAS converted chassis to keep heat down. I live in QLD Australia where high humidity and heat are pretty much a PITA most of the year. The backplanes are fine when in dry air and no dust, otherwise, they corode at even the mention of the C word. I went to old EMC 15-Bay chassis and they have rundundant PSU's and backplanes as well as daisy chain. 60+ HDD's now all on HW RAID and has been rock solid with half the power bill and noise.
@@HomeSysAdmin Yeah, I used the OEM PSU's for redundancy and used Intel Expanders and PCI external SAS riser plates.
👍
You need to watch to solve your Backplane problem!
I've returned the backplane and connected it with an SFF-8087 to SFF-8088 cable.
the electric bill will go up by 10-20%? haha. Nice rig tho
Mmmm lots of power!
Is Chia even worth it?
Yes
I run my Chia servers inside an old retro Commodore Business Machines CBM 8032 case as a "sleeper computer"
I call it my Chia PET.
buh dum dumb
lolol
boo hiss you went with pfsense instead of better opnsense fork and you also bought their cheese version instead of making your own from a refurb which would be better in almost all ways - the setup would be great if you were actually using it for something useful - good cable management and maybe you will find other uses going forward
I know about the pfsense... I'm kindof regretting buying that tiny box rather than building my own at this point. It would have been nice to have a 10gig link to the router. Someday I'll build one... have to find a way to do it in a power-efficient way. If you have any recommendations on specific boards or CPUs, please share!
that 17kwh/day. is this even profitable?
Oh yes, very much so. Also, I rarely pay for power during the summer months. It mostly runs off-grid via solar.
@@HomeSysAdmin thats my man :)
i do too. but just with 320tb.
electricty prices in europe are killing it hard thou
For us in the Netherlands this is too expensive, paying the power bill alone....
What are your power prices like? I hear they're pretty bad over there right now ☹
your severs are really quiet
I replaced the stock fans with quieter fans since they're just holding disks and no motherboards/other parts. See this video for build info ua-cam.com/video/8C6-Jw7-Sk8/v-deo.html
No keystone patch panel. Regrets
I thought crypto mining was pretty much dead. I shut down my gpu stuff a while back.
GPU mining is dead. Chia doesn't use GPUs or any proof of work mechanism.
2 Words Rack Studs
how cool is it that you are not interested in a consumption of 800 w/ hour for your electricity bill....
How cool is it that you make such a judgement without sufficient information on the environment this is operating in?
@@HomeSysAdmin honestly, it was with admiration, not with sarcasm...
I see, well then my apologies 🙂 It helps heat my basement, which would otherwise be heated by electric heat anyway.
@@HomeSysAdmin and I'm sure it's not a joke, I heat up my room while playing with a 5900x and an rx6800xt. It works :) Seriously! Once again, sorry if I gave the impression of sarcasm. A wonderful evening, I'm in France, it's late here.
10gb rj45 is not that great for the cable and for you :p
Seems to be working great for me. I know fiber would have been best but the SFPF+ card costs almost double...
@@HomeSysAdmin just use direct attach SFP+ cables for such short distances.
It amazes me that you waste all that nice equipment on that in my eyes Chia crap.
Thank you for sharing your opinion; however, mine differs vastly from yours.
Why do people still buy those crap panels?
Are you referring to the one I bought? What is wrong with it? Did I miss something?
how much this kind setup mines coins a day? atlasta here if doesn't mine over 10 euros/day you would just lose monny
I'm getting about 0.35 XCH per day right now.
@@HomeSysAdmin ¨10.79 d, means that i would profit 79cnt daily meaning 16 612,7373 this much days it would be recouped in with 750drives