Now 1PB of Storage in 118 SAS Enterprise Hard Disks - 1258
Вставка
- Опубліковано 12 гру 2024
- New Cable for the NetApp DS4243 storages DAS and I finally manage to get 1 Petabyte of Storage up and running at the same time. Not only is it 1 PetaByte, but it is also 1PB of SAS enterprise storage. And even though there are a few UA-camrs that has reached 1PB before me, I believe I am the first to use SAS drives.
[Affiliate Links]
Link UK - 10Gtek External Mini SAS HD SFF-8644 to QSFP Cable : amzn.to/3IZ0oMe
Link US - 10Gtek External Mini SAS HD SFF-8644 to QSFP Cable : amzn.to/3ZQkcaT
___________________________________________________________________________________________________
/ myplayhouse
For 3$ a month, you get an extra weekly "What's UP" update video. Just for my Patrons. The Support I resave on patreon is all used on stuff to make interesting videos on UA-cam.
My PlayHouse is a channel where i will show, what i am working on. I have this house, it is 168 Square Meters / 1808.3ft² and it is full, of half-finished projects.
I love working with heating, insulation, Servers, computers, Datacenter, green power, alternative energy, solar, wind and more. It all costs, but I'm trying to get the most out of my money, and my time.
Crank up to 4K-quality videos, the discs will be full by May! ^^)
By the way, don't be surprised if you don't see me here any longer, I am on my way out off UA-cam for good. Lost too much time here. I'll keep peeking in from outside now and then, but won't log in anymore.
I have been recording in 4K since video 267,, where I got the Panasonic HC-WX970,, 7 years. but I only post my videos in HD,, as I am not 4K pretty :-)
Nice! It's finally working as it should! 👍
Great job with cool results!
Hi Arturs Mihelsons
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
I've missed the Sample Text!!!
Love it, thanks Morten!
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/
@@MyPlayHouse 😎🤪🤫
You need to record in uncompressed 8K. That should use up a little storage.
Blackmagic has camera that shoots 12k
I am recording in 4K,, you only ger HD (I am not 4K pretty) but maybe I need to save all the frames in raw TIF.
Thank you for a great video.
Hi Mamdouh Tawadros
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
Why, cause you can. Love it
Hi Speed Smith
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
for whatever it's worth you can swap out those IOM3 controllers in your netapps for IOM6 controllers and upgrade to 6Gb SAS from 3Gb SAS...
also I always had weird stability issues chaining the netapp enclosures so always go from each enclosure back to a physical port on a controller... I have 2x IBM x3550M4s with a pair of dell perc h810 controllers in each, then each server has 4 SAS to QSFP cables going to 4 netapp DS4246 enclosures (same as yours but with IOM6 controllers for 6Gbit SAS)
Well 6Gb SAS would be better, but with spinning disks, the 3Gb, is not nearly as big an bottleneck as with SSD's. The 3Gb should do 300MB/s and as it has 4 channels, that is about 1200MB/s. Of cause there will be limitations with 48 drives sharing that bandwide. 1200/48=25MB/s But on the other hand,, you are not stressing the drives :-)
@@MyPlayHouse it becomes relevant if you use TrueNAS and let it perform its monthly scrub operation (for bitrot protection), in which case you'd want as much bandwidth to the disk shelf as possible.
Sample Text??? :D nice!
Love it too!! 😀
Sample text,, I do not follow.
@@MyPlayHouse look at 0:09 😉
someone forgot to add description of the video
not even in the box haha
Hi Morten, the yellow mark on the drives mean they are self encrypting.
great Video :-)
Ahh Cool, I did not know that!
Amazing achievement. Any estimate on the power consumption when all is powered on?
1000-1200 Watt would be my estimate. Thank You!
745 million floppy disks is 1 petabyte. The abbreviation for petabyte is PB which is also 'peanut butter'. You should put a peanut butter sticker on your setup.
a bloody lot of storage.
I see the issue but it looks like you got it. Sorry I didn't see your part 1 video on this.. Cabling and single pathing vs. dual pathing can be a bear sometimes to map out. I only do single path with my DS-2246 arrays
Well part 1 of the video was just last week,, so you do not have to go to far back :-)
I know that smell on some new electronics, and I also find it weirdly nice ;)
This was not the smell of new electronics,, it was perfume. :-)
👍👍perfekt
It´s pretty good :-)
CHIA Petabyte let’s goooo!!! It’s pumping now
How many chia farmers this man helped with his videos?!
I bet you many!!!😅
1pb of chia rn would earn like 17$ per day lol
@@PplsChampion and currently has hard drives are earning negativedollars for electricity seems like a win-win!
@@CustomComputing it's free heating! linus is doing the same thing this week
@@PplsChampion He's using gpu's to heat a tiny part of his garage, and its not free at all either, it just returns a small amount of the cost compared to using a normal electrical heater...
congrats morten
Hi aft
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
Can you make a list of all the sas drives used and the storage units
I do not really see the point.. :-/
Awesome. Congrats..) I have 1/4 PB only, but more dB of silence)). Do you need help with plotting?)
No I would need help with the power bill if plotting!!
@@MyPlayHouse xD I have only software for optimizations plotting operations, like checking and replotting of bad plots with processor affinity.
FORMAT C: /S
I do not want to format C: - that is a rather mean sugestion.
LOL your power company must love you hahahha
Well I haven´t made to their Christmas card list yet :-)
@@MyPlayHouse im certainly jealous though, I only have 80tb of storage lol
Accidental Chia farm in the works
I did have this running Chia,, but I think it over....
Hi Morten! Hope you're doing well/are fully recovered from that cold you had a few weeks ago!
i'm curious if you've been farming chia this whole time? I'm assuming not due to electricity prices? with 990TiB, you'd be earning about 13 Chia/month, or about $550 US. Could be worthwhile to check the power usage of those systems and see if it's cost-effective to farm Chia in case it takes off (each Chia coin is about $42.50 US right now, up from $27 US in December). Since you'd just be farming, which is entirely "read-only," it wouldn't negatively impact the drives nearly as much as writing. And even if you had to plot, you could do it all in ram to prevent wear and tear on hard drives. You could even do GPU plotting now, just came out, might even draw some more viewers to your channel if you're interested in exploring that and being one of the first UA-camr to make a video about it!
Sorry I live in the country with the highest power prices in the world,, it is bad business here.
@@MyPlayHouse I see, thank you for that. Any idea how much those drives and enclosures pull? Even if they pull 1000 watts/hr, electricity would need to be on average greater than $0.75 US for it to not be cost-effective. I'm aware peak costs reached greater than $1.25 US per Kwh, however, I thought it had quieted down a bit/overall average. Nevertheless, perhaps better to not encourage increase electricity usage in this day and age even if Chia is a relatively green cryptocurrency.
wauw Grats men
Thank You,, :-)
Thats a lot of storage :D
I do agree.. :-)
I remember cables smelling like tea with lemon or something like that...
It is not often you get nice smelling cables :-) so totally unexpected..
didnt you use the server to keep or was it a video or play for a group i seem to recall many years ago ?
The Lenovo x3650 M5 use to be my 24/7 server,, now I have a Lenovo SR650 :-) Newer..
@@MyPlayHouse so could you not rent out server space ?
What do you actually use your storage for ? Do you sell for example offsite backup services ?
Hi Jonathan Schneider
I do get this question from time to time, so I have added it to my F.A.Q. that you can check out under the "about" tab here on my channel. I give a longer answer there.
docs.google.com/document/d/10tNReA70PsMT4dnyyg6-DdCyFEVcAI9WMizq1SNBibY/edit?usp=sharing
Thank you for watching! :-)
Are the yellow ones SED (Self Encrypting Drive) devices?
Maybe,, someone else suggested that as well.
Hey you wouldn't happen to have a spare system board for a x3650 M4 would you? XD
No sorry :-/
What's with the sample-text in the intro?
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/
Question what are you running with that computer system is that spyware for NASA
Would be awesome to be able to offer NASA storage,, but I do not think that 1PB would make a differences for them :-)
@@MyPlayHouse just kidding about the spyware Maybe you can offer Storage to your UA-cam friends and if you have time maybe you can edit there video for a small fee
Is that coil winding or is my just hearing something is off. That's odd???
Maybe one of the 118 drives is a howler.
Now we want one pb of sas intel ssds
Unfortunately, I probably quickly run into some financial problems :-/
@@MyPlayHouse you are gonna sell all these hard drives :D
I would love to see what kind of read/write performance you get through both the HPE DAS and the NetApp DAS, in terms of both sequential and random read/write performance (not only in IOPS, but also in terms of bandwidth (whether that's MB/s or GB/s).
My concern whenever you have cascading storage like that is that the SAS 12 Gbps link (even if it is a x4 link) should ONLY be capable of, in theory, upto 48 Gbps (if it scales like that), which only means a maximum of ~6 GB/s in theory.
But of course, in reality, it's going to be MUCH slower than that, so I would be curious to see how slow it will get when you're hitting the two DAS units up.
the IOM3 expanders in those netapps is 3Gb SAS, that's going to be the bottleneck
@@flecom5309
Oh wow.
I didn't know that.
Thank you.
Well 12Gb/6Gb SAS would be better, but with spinning disks, the 3Gb, is not nearly as big an bottleneck as with SSD's. The 3Gb should do 300MB/s and as it has 4 channels, that is about 1200MB/s. Of cause there will be limitations with 48 drives sharing that bandwide. 1200/48=25MB/s But on the other hand,, you are not stressing the drives :-)
@@MyPlayHouse ya 3Gb is still OK for spinning rust for the most part, you will have a bottleneck for faster drives (your >10TB drives should be pretty quick) but not enough to be a deal breaker for a home lab usually
@@MyPlayHouse Sorry i dont get it. Isn't 3Gb the total throughput of the IOM3? Or do you count all four 3Gb plugs you theoreticaly could connect per 4243?
i wonder how much current it draws with all the disks now up + server i don't imagine you are still dealing with chia ?
5-10Watt per drive,, it all adds up! I am not doing Chia now.
Yuss!
Hi Michael
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
mabie .. can you can rent the 1PB of storage to a company and run it from your house ? ? ?
I am a bit afraid of what would happen, if my storage then turns out to be full of adults entertainment,,, with way to young actors :-(
Wow, how much does this cost to run?
I have not counculated it,, but probably $1 a day.
i have an ibm x3550 m3 here. it doesn't accept USB keyboard input. what can i do? is the first IBM server I have
I have a IBM keyboard that does not work on IBM servers,, but a HP or Dell keykoard did..
@@MyPlayHouse I used a no name usb keyboard. If I remove the raid controller, the keyboard works normally. when installing it asks if I want to load the configuration and I can't get any further
Chia mining is senseless with "just" a petabyte nowdays, other than itll kill the drives at a rapid pace.
can u explain a bit more? im trying to get into it
@@arshiaseyyedshakeri890 You could join a pool, but then your reward will be split over all pool users and the cost of electricity and the servers/drives you need will still greatly outweigh the benefits of getting a tiny amount of a coin if the pool finds a block.
Chia mining will not kill HDDs sitting full of plots. It is hard on consumer NVME drives during the plotting process. HDD utilization is less than 1% during a search for proofs.
@@whoyouwon Its hard on any storage during the plotting process. TBW is through the roof. Other than that, its just not worth the power and cost to plot anymore, you wont hit a coin unless you're really lucky or unless you have a ton of storage, in both cases you will never ROI. Even if you use just one random secondhand harddrive and hit a block the first day, it wont pay for that drive. And that chance is about the same as you have chance getting hit by lightning.
I did just do Chia,, to play with storage,, and it was fun for a bit.
What do you use it for?
Hi Andrius Ordojan
I do get this question from time to time, so I have added it to my F.A.Q. that you can check out under the "about" tab here on my channel. I give a longer answer there.
docs.google.com/document/d/10tNReA70PsMT4dnyyg6-DdCyFEVcAI9WMizq1SNBibY/edit?usp=sharing
Thank you for watching! :-)
How is throughput?
Humm with SAS 6Gb to the HPE D6000 max throughput should be 2400MB/s and with the SAS 3Gb to the two NETAPP DS 4243 max throughput is 1200MB/s.
@@MyPlayHouseI heard something like it's recommended with 1GB ram for each TB disk space, when Using ZFS.
So if you would try that, you would also need a huge amount of RAM... 🤔
Video Hosting, My Teacher, I'm That Much Disc
Hi FIRAT BACIK
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
This is like what Linus Sebastian did for his facility.
Ahh He is way ahead of me. :-) But I am the first to do 1PB in SAS :-)
@@MyPlayHouse You know more than Linus does as you actually work in a server farm
Double up your cables if you have 2 more outs on your server!
I do not,, I am using all.
0:09 SAMPLE TEXT
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/
@@MyPlayHouse press f to pay respect with money
lol the sample text
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/
@@MyPlayHouse it’s a beautiful happy accident!
Yay - something worked!!! 🤣
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/
@@MyPlayHouse Best UA-camr ever!
when did th HP NAS become a jet engine? lol
Sounds pretty cool when you just start it :-)
No you're not a weirdo. I just think you're a cool guy. I dumped Chia it just wasn't worth the hassle or time.
It was fun for a bit :-)
Finally enough space for all the stupid windows updates 😁
Will have to expand in 2023,, it keep up :-) with MS.
hole foods
Hi shep husted
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
Sampletext lmao
Ahh F* that wat suppose to say "Morten Hjorth" as it always does :-/