I work at a Aquantia and we supply Intel, Cisco, Dell, HPE, Lenovo and even Apple with our 5G or 10Gpcs Ethernet controllers. We will be launching soon a PCIe 10G Ethernet adapter for under $100. Loved the video. It's all about market timing. We all want faster network speeds and various pieces of the ecosystem are there but others are coming quickly behind. Join the 10G revolution!
Hey everyone! I've been working on this one longer than I wanted to, but I'm extremely happy with the result. I really hope you enjoy it. I put a tremendous amount of work into all the content, and had a blast doing it. Subscribe to get the additional videos that follow. Enjoy!
I Have Ben Using 10Gb P2P Networking for a couple of three years for my FreeNas Server & I Still Remember the shock from 1Gb to 10Gb Speed WOW..lol. That Was Like Going From a old 3.5Hdd To a Ssd on ya Computer .Such a great Upgrade,& for not a Lot Of Money ! Totaly Worth it imho ! Id Like To See a Updated 10Gb Video,As I Have Ben Thinking of Going /Experiment With 100Gb..LOL.
I'm planning to upgrade to 10G on my LAN. I'm going to build a 12 Core VM machine running ESXi and install Pfsense on it along with some other server VMs. I'll also be using SFP+ NIC cards and optical cables to make the transition. Then I'm going to run a lancache system to cache downloads and hopefully when someone else downloads the same file (like a game or something). it will serve them the cached download at 10Gbps. It'll be a fun project and I can't wait!
Nice video & looking forward to more. New subscriber! I'm an IT guy and a software guy... And I kind of doubt some of the claims about cached backed drives. As a software guy, I have written a lot of sockets based software and typically with large data transfers over a network, the initial short burst and higher transfer rates I think can be attributed to those caches but once a large transfer is underway and the cache size exceeded, I think the cache has little to no impact on performance. After all, a 10Gb network really benefits these scenarios... Also, as an aside, I was the lead engineer for the first Cisco commercial 10Gb network. It was a US government project for one of their combat colleges. This was circa 2002. Things certainly have come a long way since then ;) Great channel!
+Eric Mayo great post! You articulated the bursting nature of cache as I've always understood it. I think where the fundamental shift has occurred is with solid state storage. There has been such a dramatic leap forward with storage performance, and tiering concepts. Actually it feels like a convergence of high speed RAM and spinning rust is occurring at multiple levels. In that vein, I think the prosumer market has been forgotten about to some degree. It's awesome to watch what is occurring in the enterprise market space. Now if we could just leverage bit of that at the consumer level for networking, that would be pretty sweet.
4:16 - 5:00 As you mentioned this is a complicated topic but I'm happy you pointed out all factors. I think you probably know already it boils down to the hashing algorithm. Some Juniper platforms support using L4 hashing algorithms that would utilize multiple links for one "session". Although I haven't seen this on any other platform and wish it was available more commonly. Great video!
Not just with specific point to point connections but also for network backbone between switches and other appliances. Having a 1Gb switch in one area and having it up-link to the router or firewall with a fiber or copper 10Gb back bone helps a ton with aggregation and latency even if the end point device like a workstation or media server doesn't have a 10Gb NIC. If you had a server on the network with a 10Gb NIC on top of that you would still see improvements in transfer rate at the client over just having 1Gb network throughout.
Point-to-point between two computers is easy and cheap--two used 10G NICs and a cable. But if you want a third machine, you need a switch (or messy forwarding/routing among the computers), which has been expensive. Mikrotik has a 4-port SFP+ switch now for under $150, making it somewhat more cost-effective to network a few machines with 10G links.
You can get 10Gbe relatively cheap with 2 Intel X520 DA1 cards for around $100 and a SFP+ direct attach cable which can range from $10-$30 depending on length. I have my desktop connected to my 6TB Raid 10 server and I get around 7Gbps. With perfect optimisation you can achieve around 9.2Gbps. You'll never reach 10Gbps. That same bottleneck can be seen on 1Gbps where you will only get around 920-930Mbps max.
+dalew101 very true. I have the same numbers in my testing and home lab. It's always going to be a factor of latency, offload processing, and protocol handling to name a few things. What does your storage server run as an OS? And what kind of drives are you using?
excuse me but I don't understand how USB can be used in LAN communication!! isn't USB only limited for two devices? Is there a switch to connect more than two devices using USB?
+MR/TROLL this project is not for use with internet. It is only intended to be used with an internal home network. Like connecting a bedroom computer to your office computer.
Lagging multiple connections into one is definitely possible. As I'm actually using that right now. 4 1gbit lans together giving me a 400mb/s link. Oh yeah did I mention how much cheaper it is than 10gb? ... ;)
Yes, It's well done. But, I'm a techno-tard. This is all completely new for me. I do want a 10gigabit home networking system.... But I need a step by step, A-Z video.
Great video! When is the next video? I want to know because i have a full box of 10gbe network cards in my home. All the cards are from a friend but I can play with it he said :)
+victorbart Nice. Well, unfortunately I have to knock out some tax paperwork (boo) and deal with a full time job. So that slows me way down. But I have a head start with some footage already. I don't want to make any promises, but I would like to have something out in 2-3 weeks. I need an associate that is willing to work for free so I can knock some videos out faster. Know anyone :)
+Slammer Jackson well yes, BUT it's not always that simple. Too many UA-camrs blaze through complicated topics leaving some just as confused after watching the video. I go into depth in part 2, so it's more than just connecting two computers. And I don't want to deliver a sloppy video either. Trust me. Watch my second video when it come out. There's a lot of good information in it.
iTechStorm waiting for it - I want to watch it ;) BELIEVE ME! I think we have the same ESXi , FreeNAS type set up. FreeNAS is badass and I am getting what seems like 4Gb/sec over a 1Gb/sec link, but the same link (same cables, switch, etc) to my ESXi is slow as shit. Maybe I am getting 500Mb/s on that link. Could be the RAID on FreeNAS is much faster then the single drive in the ESXi server. Not sure. But willing to make the jump to 10Gb/s peer to peer and test it out.
+Slammer Jackson ya, the scenario you describe is tricky to troubleshoot for sure! The process of elimination is where you start. Rule out the drive through testing, rule out the network, proc, drivers, firmware, remote host, etc...
Hey Luke! A media server could be a Plex server or just plain old file server for home. These days home storage vendors are embedding Plex/File/Container/VM into the NAS appliance. But there is no reason this has to be the same box. You could have a seperate Plex server from your storage server. My Vmware machine is running ESXi 6.
Great video but you definitely need to clarify some stuff. In this video you mix SAN (Storage area network) and LAN (local area network) with all of their purposes and standards together. Where realistically they are separate systems and dont work together. With switches, SFP's, and network cards there are ethernet based and fiber channel based. Fiber channel is exclusively for SAN and ethernet is obviously LAN. The two wont mix and can result in wasted money in parts or confusion with it not working. A SAN network is only for providing storage and cannot be used for regular network traffic. At my office we have 10gbs LAN network with fiber switches for ethernet to connect servers together and run one line to 20pcs we also have a 10gbs fiber SAN fabric network which is used to provide storage for VM's and thin clients. They are separate systems and used for very diffrent purposes. If you want more information about this feel free to contact me or "back yard tech" and "Eli the computer guy" both have great SAN vs LAN videos.
Yeah, the price is insane... A single pcie network card is still like $120 and then you have to by a cable spool, crimper, and all the ends which adds another $500. So you are looking at $1000 just to do a small 1000 sqft area with 2 computers. It is currently (as of 2/2019) more economical to do LACP with regular cabling on manageable switches.
Incorrect, a spool of 1000' is $100 or less for good stuff. Cheaper for smaller spools. A crimper can be $30, a few misc cover plates and jacks are less than $20...That's a long way from $500. Check Monoprice for some decent stuff. You can also start using tools and knowledge and get paid from family and friends.
Nice video. A lot of clicking in the audio. Are you using a nose gate or just really chopping up the audio? Leave your inhales in before speaking in the audio track. It makes for a much more natural sounding dialog.
I hear what you are saying, but I had a timing issue to contend with. Slow natural dialogue was not an option for me in that video. And I had to crank the audio to hear the clicks you mentioned. Almost certain that was part of my speech. I was using a few things to process audio. Deesser, gate, pop filter and a few tweaks to EQ dramatically improved original quality. I don’t have a studio, so I do what I can.
Awesome series, I was thinking of doing something similar, but wow, you did this very nicely! I will certainly recommend for anyone looking for something similar! :D I released my own video about a 10Gbps backbone and router on a budget a few days ago myself.
+Antonio Checa Thanks for the feedback! I'm working on it now as I respond to you. I can't wait to get it published, as I don't want to leaving people hanging :)
+FE59FE59 Thanks for the feedback and shares! Seemed like a series on this topic was long overdue. I have been pouring over lots of info and paring things down so I can produce something really useful for people. I'm working to get it knocked out soon. I know people are eagerly awaiting :)
I really don't understand why they never built a striping mechanism into link aggregation. I get that they are for failover, but if the extra links are there, they might as well be used to speed things up even for a single connection.
I have one fileserver running linux and hosting my files spread on a lot of wd red drives with a raid controller, now I plan to add a second server which should get high speed file access. My idea as long as i dont have a 10g switch is to get 2 sfp+ cards and a cable to get high sped straight access to the fileserver, would it work?
+John Ranson Awesome. Maybe you could help me out? What were the top 3 things you liked about this video? Dislike anything about what I did? Seeking honest feedback about the video so I can build future videos in a way people appreciate. To answer your question, there are a lot of different directions I could take with my next video so I want to make sure I get it right for everyone. This means testing several different configurations so I can save others the frustration. I'm actually waiting on some hardware in the mail and working on other aspects of the video in the meantime. I should be able to knock out a good portion of "Part 2" this weekend though.
Correction 125MB/s over gigabit Ethernet is absolutely unachievable First your billion bits are divided by 8 = 125M Second this 125M is divided by 1514 (ether type = 2 bytes, source MAC 6 bytes, destination MAC 6 bytes, total 14 bytes) and only 1500 bytes are used for any data transmission This gives 123,844,121 bytes a second IP plus TCP takes 40 bytes of that Divide by 1500, multiply by 1460 120,541,611 bytes a second And now for binary megabytes Divide by 1048576 114.95MiB/s This a limit at 1514 frame size (1500 Maximal Transmission Unit) Just dividing by 8 is huge simplification
Short question: an sfp+ copper drect attach cable costs minimum 80€, 2 new 10g sfp+ fibre modules and an lc to lc fibre would cost me under 50€ so is there any advantage with using dac?
Ah ok I see what you mean. I would actually quite like to get a media server. Last month I order a 2u hp dl380 g5 server of eBay but the item was listed wrong and the server only actually had 1 cpu and 8gb of ram rather than 2 cpu and 24gb. There was lots of other things wrong too. Anyway that got sent back and I got my full money back. Point is I now have money to spend and want a media pc to run a plex server on and also active directory as I want to mess about with that. I will probably run esxi and have them setup over separate virtual machines. What are the specs of your pc that runs esxi? So my question to you is should I buy either one of those hp micro servers or a hp ProLiant ml series tower server. Since I don't want a rack server now. I want a low power fairly quite 24/7 operation media pc. But i dont want a Nas as I want to have pci express x8 and multiple of them to make it possible to put a 10gb nic in and upgrade to a 10gb network in the future. So any ideas, should I buy or build (from new and/or old pc parts, probably from eBay) a media pc? Any opinions or help would be amazing. Thanks.
Just a suggestion, you could make a freenas server because once you do you have plugins availiable, including one's for plex media server. That's my current project.
Nice video, with the dual port cards is it still possible to use link aggregation /teaming? I know you need Windows server to do it with Windows but for Windows 7-10 is there any software available from Mellanox do achieve this?
+Andy Bradley off the top of my head I don't think the Mellanox driver has that ability built in. Maybe in the higher end versions like Connect-X3+. Like you said though, it's the OS that's limiting you. Don't forget with SMB 3+ you can use Multichannel, effectively aggregating both 10Gb links for you. Check it out! technet.microsoft.com/en-us/library/dn610980.aspx
The r815 spec sheet lists some suggested cards in the “Communications” section. Any of the cards I linked should work fine in that system too, but it’s 2U, so get low profile cards. I suspect the R510 will have the height for full height adapters. Here is the R815 spec sheet: i.dell.com/sites/doccontent/shared-content/data-sheets/en/Documents/R815-SpecSheet.pdf
Sure you can. It always depends on what works best for you. For example to compete with a single 10Gb link you would have to connect/configure 10x 1Gbe copper cables and use link aggregation/teaming between two points. But the majority of enterprise gear typically only allows 8x links to be aggregated. So now you are down to 8Gb speeds and you've just consumed 16x ports in total. It's going to likely cost your system additional overhead to manage those 8 different multichannel streams. In the end one 10Gb link is just more effective, and anytime you can simplify something in IT and get what you need from it that's always going to be a winning solution. On the other hand, you may only need 2Gb between two systems, and that may be the optimal solution in that case. The answer is always going to be: "It depends."
More than 7 years later, 10GBit has hardly caught on in the home. Too expensive, too much energy consumption and too short cable routes. In contrast, 2.5 GB on the old CAT6 cables is slowly catching on
It’s disappointing to me that more progress has not been made with 10Gb options. As the NBASE-T/MGBASE-T standards improve I think we will get to 10Gb once 2.5/5Gb becomes more standard.
Hi techstorm I want to setup 10gbps setup for my gaming cafe for ccboot eg want to connect my server with 10gbps card to 10 gbps router can u help with that with cheapest nd quality network
But Mb or Megabits are smaller than MB, Megabytes. The conversion that you did wasn't necessary besides the fact that you tried to multiply Megabytes by 8 to convert to a smaller unit. The point at 2:33 is wrong. The single WD Caviar Green drive can saturate maybe around 10% realistically of the 1GB network connection since 123MB / 1024 MB(1GB) = 12% . But you could boost the speed with RAID 0
+SmellyClown 1 Byte is 8 bits. Network speeds are typically stated in bits. For example 100 Mb, 1000 Mb (1 Gb). To go backwards from bits to bytes you have to divide by 8. Example: 1000 Mb (1 Gb) / 8 bits = 125 MB (mega BYTES) The drive spec sheet was showing transfer rates in Bytes. So the point of my conversion was to show a one to one comparison. Drive transfer 123 MB Vs. 125 MB (1 Gb). This concept is confusing to a lot of people. That's one of the reasons I broke it out. Hope this helps...
+Chenming Chen thanks for the info. Although it sounds like they are having serious compatibility issues with SFP+ adapters and DAC cables. So be careful.
iTechStorm I’m building an 8700k/1080 ti pc for ultimate gaming (fastest fps). Will 10 bit gigabyte increase my internet connectivity and give me an advantage for gaming?
Joe Momma no, it won't speed up your Internet, unless you have a faster than Gigabit Internet connection. If you don't then Gigabit Ethernet is enough to saturate your Internet connection. In that case, it only helps if you want high bandwidth intranet (LAN) for something.
Why? You mention numbers of what is good about it but what real world use does it have. Also, your cache speed number is only for what is in cache, on that SSD that's 64MB, so you have 6GB/s for the first 64MB and then it's doing direct reads.. I like the video but your reasons for why don't seem to add up..
You're off by a factor of ten, at least. I just bought a Dell 5524P (24x GbE, 2x SFP+ 10G, PoE) for $85. You can buy an Aruba switch with 48x GbE, 4x SFP+ 10G (but no PoE) for $125. Granted, both of those are used. Needs to be new? OK, earlier this year, I bought a new Dell X1052 (like the Aruba, 48x GbE, 4x SFP+ 10G, no PoE) for under $500.
It’s nice to see prices declining on that gear and I know Dell has offered up great pricing on net gear trying to break into the world of networking. I continue to see good things happening on this front.
He's not considering ROI at all; yes, 10 gb is awesome but it's still relatively expensive to implement in mid-2018 even just adding a 10gbNIC to your NAS and computer and doing a direct connect crossover; so it's not even really networking... my opinion is 1 gbps is perfect for home still, no home user (w/ exceptions such as leasers / etc that essentially operate a MDW out of their house) will ever get a valuable ROI on upgrading to 10 gbps, buttttttt not gonna argue a home office that serves clients on a WAN or geek who doesn't fiscally care totally might...
There is no ROI for home, it's purely a matter of "want to"--but I agree that GbE is perfectly adequate for home (and even most business) applications, which I suspect is why 10G gear is still much more expensive. The demand was never really there (because GbE really is good enough, or at least it has been to this point), so it was never produced in mass quantities, and what was (and still is) produced was/is marketed and priced for the enterprise (i.e., $$$$$). That enterprise gear is now available used for much more reasonable prices, sometimes still under warranty--if you shop carefully, you could do peer-to-peer connection between two machines for around $100 for both NICs and the cable. I'm running 10G over fiber among my two virtualization hosts, my FreeNAS box, and from there (in an out-building) into my home. Do I need it? Not at all. But it's working very well, and I'm happy with the results.
No, they didn't--or if they did, it would be an exceptionally slow hard drive. 120-150 megabytes/sec is a pretty "normal" transfer rate for a hard drive.
+TheMusicSoldier you must be talking about your Internet connection. This series deals with an intranet (internal to your home/business). Not broadband connectivity. But that would be nuts, 10Gb internet!
Correction: no way in hell hell you will get sustained 125 Mbytes/sec from a spinning 7200 rpm drive....; you might get an occasional burst of data at SATA3 speeds, but, good luck otherwise.
Sure you can! :) I just setup a quick test with IOmeter using my WDC WD2002FAEX (7200 RPM WD Black Series) drive, which you can verify for yourself on the Task Manager screen shot I just took. Results linked bellow for your reference. Linked off iTechStorm.com: Write Test (127 MB/s): goo.gl/KoI8H9 Read Test (136 MB/s): goo.gl/77tbgn In addition to that you are getting even better read/write speeds from the newer/larger drivers due to the platter density. Just look at the spec sheets as you go from 1TB -> 2TB -> 4TB -> 8TB, etc...
The Samsung 850 Pro only manages 550-ish MBytes/sec....; recommend review of definitions of burst transfer rate, and, definitons of Megabit vs. Megabyte.
Due to massively increased platter density in disks in recent years (same size physically on the outside but many more TB's on the inside) sequential transfer speeds have increased massively. A 8TB HDD can do over 200MB/sec now a days. What didn't change though was random read/write. So the IOps stayed the same and that's where SSD's shine!
+InterTech absolutely! It's a great time to be alive :). I can remember complaining all the time about what a crazy bottleneck storage always was, and everyone was always so focused on CPU. Oh well. Better late than never!
iTechStorm Thanks for the reply dude! Everyone seems to understand that the internet meeds to be faster.. but the large companies are the only ones who control that. Aside from areas that have google fiber and some other exceptions, you can't find truely fast internet for a cheap price here.
I remember when 56K dialup was smokin! We will get there. The providers just have much larger geographies to span versus Europe where everything is close together.
I work at a Aquantia and we supply Intel, Cisco, Dell, HPE, Lenovo and even Apple with our 5G or 10Gpcs Ethernet controllers. We will be launching soon a PCIe 10G Ethernet adapter for under $100. Loved the video. It's all about market timing. We all want faster network speeds and various pieces of the ecosystem are there but others are coming quickly behind. Join the 10G revolution!
"Do you like massive amounts of performance even though you can't justify it?" lmao this cracked me up
Hey everyone! I've been working on this one longer than I wanted to, but I'm extremely happy with the result. I really hope you enjoy it. I put a tremendous amount of work into all the content, and had a blast doing it. Subscribe to get the additional videos that follow. Enjoy!
iTechStorm very informative video. Thanks for your effort. subscribed.
+Soumendu Sarkar you are very welcome. Thank you for your feedback.
This is still relevant in 2020, where are you man? We need more info!
I Have Ben Using 10Gb P2P Networking for a couple of three years for my FreeNas Server & I Still Remember the shock from 1Gb to 10Gb Speed WOW..lol. That Was Like Going From a old 3.5Hdd To a Ssd on ya Computer .Such a great Upgrade,& for not a Lot Of Money ! Totaly Worth it imho ! Id Like To See a Updated 10Gb Video,As I Have Ben Thinking of Going /Experiment With 100Gb..LOL.
I'm planning to upgrade to 10G on my LAN. I'm going to build a 12 Core VM machine running ESXi and install Pfsense on it along with some other server VMs. I'll also be using SFP+ NIC cards and optical cables to make the transition. Then I'm going to run a lancache system to cache downloads and hopefully when someone else downloads the same file (like a game or something). it will serve them the cached download at 10Gbps. It'll be a fun project and I can't wait!
Nice video & looking forward to more. New subscriber! I'm an IT guy and a software guy... And I kind of doubt some of the claims about cached backed drives. As a software guy, I have written a lot of sockets based software and typically with large data transfers over a network, the initial short burst and higher transfer rates I think can be attributed to those caches but once a large transfer is underway and the cache size exceeded, I think the cache has little to no impact on performance. After all, a 10Gb network really benefits these scenarios... Also, as an aside, I was the lead engineer for the first Cisco commercial 10Gb network. It was a US government project for one of their combat colleges. This was circa 2002. Things certainly have come a long way since then ;) Great channel!
+Eric Mayo great post! You articulated the bursting nature of cache as I've always understood it. I think where the fundamental shift has occurred is with solid state storage. There has been such a dramatic leap forward with storage performance, and tiering concepts. Actually it feels like a convergence of high speed RAM and spinning rust is occurring at multiple levels. In that vein, I think the prosumer market has been forgotten about to some degree. It's awesome to watch what is occurring in the enterprise market space. Now if we could just leverage bit of that at the consumer level for networking, that would be pretty sweet.
4:16 - 5:00 As you mentioned this is a complicated topic but I'm happy you pointed out all factors. I think you probably know already it boils down to the hashing algorithm. Some Juniper platforms support using L4 hashing algorithms that would utilize multiple links for one "session". Although I haven't seen this on any other platform and wish it was available more commonly. Great video!
Yooo i feel like I've watched a lot of videos about this the last few months (2022). Nice call
This chanel is the best and is so clear and understandable
+Ben M Gaming thanks Ben! Glad you found it to be useful.
Not just with specific point to point connections but also for network backbone between switches and other appliances. Having a 1Gb switch in one area and having it up-link to the router or firewall with a fiber or copper 10Gb back bone helps a ton with aggregation and latency even if the end point device like a workstation or media server doesn't have a 10Gb NIC. If you had a server on the network with a 10Gb NIC on top of that you would still see improvements in transfer rate at the client over just having 1Gb network throughout.
Point-to-point between two computers is easy and cheap--two used 10G NICs and a cable. But if you want a third machine, you need a switch (or messy forwarding/routing among the computers), which has been expensive. Mikrotik has a 4-port SFP+ switch now for under $150, making it somewhat more cost-effective to network a few machines with 10G links.
Very nice video... great content, great delivery and easy to digest.. Thank you
You can get 10Gbe relatively cheap with 2 Intel X520 DA1 cards for around $100 and a SFP+ direct attach cable which can range from $10-$30 depending on length. I have my desktop connected to my 6TB Raid 10 server and I get around 7Gbps. With perfect optimisation you can achieve around 9.2Gbps. You'll never reach 10Gbps. That same bottleneck can be seen on 1Gbps where you will only get around 920-930Mbps max.
+dalew101 very true. I have the same numbers in my testing and home lab. It's always going to be a factor of latency, offload processing, and protocol handling to name a few things. What does your storage server run as an OS? And what kind of drives are you using?
This was such a well done video. Excellent job! Subscribed.
The price is still insane when you can have USB3.1 with 10GBit for $20 but network cards still cost $200 for the last 5 years.
+Lothar Scholz good point, albeit two very different technologies.
excuse me but I don't understand how USB can be used in LAN communication!! isn't USB only limited for two devices? Is there a switch to connect more than two devices using USB?
I can't tell if you're just a dumb troll or literally this stupid?
I've actually gone backwards. I had a 1Gbit ethernet in 2005, but now I have a 100Mb ethernet because that's what my ISP's modem/router does.
Well, I guess you are doing better than when 56.6K was all the rage.
Excellent video. It probably took you a lot of time to finish it, but the result is great.
Subscribed.
+theodoro89 Excellent! Glad you enjoyed the video. I'm trying to strike a balance of quality and faster release.
Subscribe and Like my Facebook channel for frequent updates on the release of my latest videos!
Check it out:
facebook.com/itechstorm
+MR/TROLL this project is not for use with internet. It is only intended to be used with an internal home network. Like connecting a bedroom computer to your office computer.
10Gb Home Network (P2) - Peer-to-Peer: Update:
facebook.com/itechstorm/posts/1740581282823775
+1 subscriber here! Great video, easy to understand! Can't wait to see the next one!
Best regards from Sweden :)
+Roman Schalizi Thanks for the support! Working on Part 2 now...
Lagging multiple connections into one is definitely possible. As I'm actually using that right now. 4 1gbit lans together giving me a 400mb/s link. Oh yeah did I mention how much cheaper it is than 10gb? ... ;)
Thank you I learned a lot. on to part 2.
Yes, It's well done. But, I'm a techno-tard. This is all completely new for me. I do want a 10gigabit home networking system.... But I need a step by step, A-Z video.
Great video!
When is the next video? I want to know because i have a full box of 10gbe network cards in my home. All the cards are from a friend but I can play with it he said :)
+victorbart Nice. Well, unfortunately I have to knock out some tax paperwork (boo) and deal with a full time job. So that slows me way down. But I have a head start with some footage already. I don't want to make any promises, but I would like to have something out in 2-3 weeks. I need an associate that is willing to work for free so I can knock some videos out faster. Know anyone :)
+iTechStorm Dude all you did was put a few new 10Gb network cards in your 3 machines and connect them up peer-to-peer, right?
+Slammer Jackson well yes, BUT it's not always that simple. Too many UA-camrs blaze through complicated topics leaving some just as confused after watching the video. I go into depth in part 2, so it's more than just connecting two computers. And I don't want to deliver a sloppy video either. Trust me. Watch my second video when it come out. There's a lot of good information in it.
iTechStorm waiting for it - I want to watch it ;) BELIEVE ME! I think we have the same ESXi , FreeNAS type set up. FreeNAS is badass and I am getting what seems like 4Gb/sec over a 1Gb/sec link, but the same link (same cables, switch, etc) to my ESXi is slow as shit. Maybe I am getting 500Mb/s on that link. Could be the RAID on FreeNAS is much faster then the single drive in the ESXi server. Not sure.
But willing to make the jump to 10Gb/s peer to peer and test it out.
+Slammer Jackson ya, the scenario you describe is tricky to troubleshoot for sure! The process of elimination is where you start. Rule out the drive through testing, rule out the network, proc, drivers, firmware, remote host, etc...
Thank you for posting this video. A lot of useful information. You sir have a new subscriber. Keep up the great work.
Whats the difference between your media server and your Nas? Also what are you running on your vmware machine. Esxi?
Hey Luke! A media server could be a Plex server or just plain old file server for home. These days home storage vendors are embedding Plex/File/Container/VM into the NAS appliance. But there is no reason this has to be the same box. You could have a seperate Plex server from your storage server. My Vmware machine is running ESXi 6.
Great video but you definitely need to clarify some stuff. In this video you mix SAN (Storage area network) and LAN (local area network) with all of their purposes and standards together. Where realistically they are separate systems and dont work together. With switches, SFP's, and network cards there are ethernet based and fiber channel based. Fiber channel is exclusively for SAN and ethernet is obviously LAN. The two wont mix and can result in wasted money in parts or confusion with it not working. A SAN network is only for providing storage and cannot be used for regular network traffic. At my office we have 10gbs LAN network with fiber switches for ethernet to connect servers together and run one line to 20pcs we also have a 10gbs fiber SAN fabric network which is used to provide storage for VM's and thin clients. They are separate systems and used for very diffrent purposes. If you want more information about this feel free to contact me or "back yard tech" and "Eli the computer guy" both have great SAN vs LAN videos.
Yeah, the price is insane... A single pcie network card is still like $120 and then you have to by a cable spool, crimper, and all the ends which adds another $500. So you are looking at $1000 just to do a small 1000 sqft area with 2 computers. It is currently (as of 2/2019) more economical to do LACP with regular cabling on manageable switches.
Incorrect, a spool of 1000' is $100 or less for good stuff. Cheaper for smaller spools. A crimper can be $30, a few misc cover plates and jacks are less than $20...That's a long way from $500. Check Monoprice for some decent stuff. You can also start using tools and knowledge and get paid from family and friends.
Very good explained Thanks!
+Antreas32 you bet!
Nice video. A lot of clicking in the audio. Are you using a nose gate or just really chopping up the audio? Leave your inhales in before speaking in the audio track. It makes for a much more natural sounding dialog.
I hear what you are saying, but I had a timing issue to contend with. Slow natural dialogue was not an option for me in that video. And I had to crank the audio to hear the clicks you mentioned. Almost certain that was part of my speech. I was using a few things to process audio. Deesser, gate, pop filter and a few tweaks to EQ dramatically improved original quality. I don’t have a studio, so I do what I can.
Well done! Thank you. I'll be starting work on my own HAN transition soon.
I was hopeful that there would be more videos to come. Anything in the works?
Awesome series, I was thinking of doing something similar, but wow, you did this very nicely! I will certainly recommend for anyone looking for something similar! :D
I released my own video about a 10Gbps backbone and router on a budget a few days ago myself.
+InterTech nice. Going to check it out now...
+InterTech the Mikrotik gear in you video looks interesting. You'll have to let me know how it works out. I've heard some good things about Mikrotik.
Sure, will do!
(The switches are new, but I've been using the CCR1009 for a year now and it at least is awesome!)
Great work here I'm an IT pro and focus on IT education and wanted to give you props for it and can't wait for the next one in the series
+Antonio Checa Thanks for the feedback! I'm working on it now as I respond to you. I can't wait to get it published, as I don't want to leaving people hanging :)
Great Video, thank you
So you're telling me that you don't have your place rigged up with fiber yet? So Sad.
Nice video! You got one subscriber more! Also shared the video with my IT friends :) Please publish your next video soon.
+FE59FE59 Thanks for the feedback and shares! Seemed like a series on this topic was long overdue. I have been pouring over lots of info and paring things down so I can produce something really useful for people. I'm working to get it knocked out soon. I know people are eagerly awaiting :)
I really don't understand why they never built a striping mechanism into link aggregation. I get that they are for failover, but if the extra links are there, they might as well be used to speed things up even for a single connection.
I have one fileserver running linux and hosting my files spread on a lot of wd red drives with a raid controller, now I plan to add a second server which should get high speed file access. My idea as long as i dont have a 10g switch is to get 2 sfp+ cards and a cable to get high sped straight access to the fileserver, would it work?
What did you use to make your network diagram?
Thanks for the nice work, I learned a lot. I have been wanting to build my first home wired network and this video inspired me to dream big! /cheers!
+Samson Awesome! Inspire someone ...
Just mine set up. I've picked up the fiber and the copper to do 10gb. Not hard to setup.
Dude, this is great. When's the next video?
+John Ranson Awesome. Maybe you could help me out? What were the top 3 things you liked about this video? Dislike anything about what I did? Seeking honest feedback about the video so I can build future videos in a way people appreciate.
To answer your question, there are a lot of different directions I could take with my next video so I want to make sure I get it right for everyone. This means testing several different configurations so I can save others the frustration. I'm actually waiting on some hardware in the mail and working on other aspects of the video in the meantime. I should be able to knock out a good portion of "Part 2" this weekend though.
I need this for my freenas box
Really nice!
+Rage Machine Much appreciation!
Correction
125MB/s over gigabit Ethernet is absolutely unachievable
First your billion bits are divided by 8 = 125M
Second this 125M is divided by 1514 (ether type = 2 bytes, source MAC 6 bytes, destination MAC 6 bytes, total 14 bytes) and only 1500 bytes are used for any data transmission
This gives 123,844,121 bytes a second
IP plus TCP takes 40 bytes of that
Divide by 1500, multiply by 1460
120,541,611 bytes a second
And now for binary megabytes
Divide by 1048576
114.95MiB/s
This a limit at 1514 frame size (1500 Maximal Transmission Unit)
Just dividing by 8 is huge simplification
Short question: an sfp+ copper drect attach cable costs minimum 80€, 2 new 10g sfp+ fibre modules and an lc to lc fibre would cost me under 50€ so is there any advantage with using dac?
Ah ok I see what you mean. I would actually quite like to get a media server. Last month I order a 2u hp dl380 g5 server of eBay but the item was listed wrong and the server only actually had 1 cpu and 8gb of ram rather than 2 cpu and 24gb. There was lots of other things wrong too. Anyway that got sent back and I got my full money back. Point is I now have money to spend and want a media pc to run a plex server on and also active directory as I want to mess about with that. I will probably run esxi and have them setup over separate virtual machines. What are the specs of your pc that runs esxi? So my question to you is should I buy either one of those hp micro servers or a hp ProLiant ml series tower server. Since I don't want a rack server now. I want a low power fairly quite 24/7 operation media pc. But i dont want a Nas as I want to have pci express x8 and multiple of them to make it possible to put a 10gb nic in and upgrade to a 10gb network in the future. So any ideas, should I buy or build (from new and/or old pc parts, probably from eBay) a media pc? Any opinions or help would be amazing. Thanks.
Just a suggestion, you could make a freenas server because once you do you have plugins availiable, including one's for plex media server. That's my current project.
Excelente amigo. Saludos.
+Joseph H H gracias!
Nice video, with the dual port cards is it still possible to use link aggregation /teaming? I know you need Windows server to do it with Windows but for Windows 7-10 is there any software available from Mellanox do achieve this?
+Andy Bradley off the top of my head I don't think the Mellanox driver has that ability built in. Maybe in the higher end versions like Connect-X3+. Like you said though, it's the OS that's limiting you. Don't forget with SMB 3+ you can use Multichannel, effectively aggregating both 10Gb links for you. Check it out! technet.microsoft.com/en-us/library/dn610980.aspx
great video have a few questions 1 what 10gb dual card would work in a dell r815 and a dell R510
The r815 spec sheet lists some suggested cards in the “Communications” section. Any of the cards I linked should work fine in that system too, but it’s 2U, so get low profile cards. I suspect the R510 will have the height for full height adapters. Here is the R815 spec sheet:
i.dell.com/sites/doccontent/shared-content/data-sheets/en/Documents/R815-SpecSheet.pdf
Can't we now do more than 1gbps to a single PC with smb 3.0 multichannel and multiple 1gbit links?? It no longer limits 1gbps to a single host
Sure you can. It always depends on what works best for you. For example to compete with a single 10Gb link you would have to connect/configure 10x 1Gbe copper cables and use link aggregation/teaming between two points. But the majority of enterprise gear typically only allows 8x links to be aggregated. So now you are down to 8Gb speeds and you've just consumed 16x ports in total. It's going to likely cost your system additional overhead to manage those 8 different multichannel streams. In the end one 10Gb link is just more effective, and anytime you can simplify something in IT and get what you need from it that's always going to be a winning solution. On the other hand, you may only need 2Gb between two systems, and that may be the optimal solution in that case. The answer is always going to be: "It depends."
Waste of money lol if the internet connection from your broadcast is around 70ghz these network cards require virgin media network
+jonathan oxlade this setup is not intended for an internet connection. Only intended to be used with an intranet configuration.
awesome video. subscribed.
Yeah, I’m going to build a 10G LAN so my daughters and I can play State of Decay 2 without lag.
Sounds like perfect justification to me, and proper father-daughter time. Well done.
Make sure you use sfp+ for lower latency instead of 10G base T
That is not how lag works...
To certain degree it does 10G base T has higher Latency then Sfp+ higher latency higher ,lag
really nice
Hi,dude,what's the software you draw the topology?
More than 7 years later, 10GBit has hardly caught on in the home.
Too expensive, too much energy consumption and too short cable routes.
In contrast, 2.5 GB on the old CAT6 cables is slowly catching on
It’s disappointing to me that more progress has not been made with 10Gb options. As the NBASE-T/MGBASE-T standards improve I think we will get to 10Gb once 2.5/5Gb becomes more standard.
Thanks
Do I need this when my budget ISP provides only 12MB/s Max?
Hi techstorm I want to setup 10gbps setup for my gaming cafe for ccboot eg want to connect my server with 10gbps card to 10 gbps router can u help with that with cheapest nd quality network
Diagrams are cool, which software used ? visio :S
+Dream Catcher yes Visio is what I used. Glad they helped.
But Mb or Megabits are smaller than MB, Megabytes. The conversion that you did wasn't necessary besides the fact that you tried to multiply Megabytes by 8 to convert to a smaller unit. The point at 2:33 is wrong. The single WD Caviar Green drive can saturate maybe around 10% realistically of the 1GB network connection since 123MB / 1024 MB(1GB) = 12% . But you could boost the speed with RAID 0
+SmellyClown 1 Byte is 8 bits. Network speeds are typically stated in bits. For example 100 Mb, 1000 Mb (1 Gb). To go backwards from bits to bytes you have to divide by 8. Example: 1000 Mb (1 Gb) / 8 bits = 125 MB (mega BYTES)
The drive spec sheet was showing transfer rates in Bytes. So the point of my conversion was to show a one to one comparison. Drive transfer 123 MB Vs. 125 MB (1 Gb).
This concept is confusing to a lot of people. That's one of the reasons I broke it out. Hope this helps...
I should know how to build ower own networks to do bussnies please help in this
Thank you
+Adel Mandani Glad you enjoyed it.
What software was used for the picture at 07:49
+SirTricky ah yes, that was Visio 2013 to make the network diagram and After Effects to pan over the image.
That's is nicely done!
Amazon has the NETGEAR ProSAFE XS708E-200NES (8-Port 10 gig) at just $699 right now.
50PullUps Also Ubiquiti has 8 port 10g Edgerouter Infinity and 16 port 10g Edgeswitch ES-16-XG
+Chenming Chen thanks for the info. Although it sounds like they are having serious compatibility issues with SFP+ adapters and DAC cables. So be careful.
I have good luck with 10GTek DAC cables and Ubiquiti transceivers(some people also report that 10GTek transceivers work but never tried for myself)
+Chenming Chen great information! Thanks for the update.
I think it's funny that a dual port 40/56 GB/s QSFP+ Nic is cheaper than a 10GBaseT one. Even 100 GB/s card are cheaper.
Have fun with that cache lately?
Thanks11
Do you have to pay monthly for 10 gigabit
+ULTIMATE GAMER this is for internal connectivity inside your house, not out to internet.
iTechStorm I’m building an 8700k/1080 ti pc for ultimate gaming (fastest fps).
Will 10 bit gigabyte increase my internet connectivity and give me an advantage for gaming?
Joe Momma no, it won't speed up your Internet, unless you have a faster than Gigabit Internet connection. If you don't then Gigabit Ethernet is enough to saturate your Internet connection.
In that case, it only helps if you want high bandwidth intranet (LAN) for something.
I like faster even if it doesn’t make sense nor seem realistic 😂
YEAH!
And i just Upgrade from 10Mb/s to 100Mb/s
I love your video. Where can I reach you
On my UA-cam channel page select the "About" tab, then "Send Message" button (top right).
0:54 How many twisted pair cables? :)))
If I remember correctly that was 2 cables at 50ft each. But that’s nothing : )
Have you seen my wiring closet video?
actually VERY VERY FEW people actually need 10GBPS networks … interesting but for home use is kind of unnecessary.
Hello. What is your EBAY username....I saw your vlogs on UA-cam. I would like to purchase pci cards......THANK YOU.....I'm building my home lab.....
the new smb3 suport multy sestion multilink transfer
+croquis24 yes, that is correct. It is a very powerful feature too. Unfortunately it will only work when source and destination are both using SMB 3.
And im here with 100MBPS
+branchyapple well, you gotta start somewhere!
where is the next video?
+Slammer Jackson working on it now actually...
I've just liked your video, and it brought a total number of likes to 666! Sorry, lol
+Serge Letunovskiy lol. That's funny.
5:55 I feel less guilty now.
Lol, I tried to cover all the bases for people like us.
Here I am, aping gigabit with a USB Linux.
Throw in a DELL 0272F MELLANOX CONNECTX-4 100GBE DUAL PORT NIC for $350.00 and you'll have 10/100/1000/10000/100000 Ethernet capability.
Why? You mention numbers of what is good about it but what real world use does it have. Also, your cache speed number is only for what is in cache, on that SSD that's 64MB, so you have 6GB/s for the first 64MB and then it's doing direct reads.. I like the video but your reasons for why don't seem to add up..
Yeah right at $1500 for a 10g switch ..... we can wait a little longer.
You're off by a factor of ten, at least. I just bought a Dell 5524P (24x GbE, 2x SFP+ 10G, PoE) for $85. You can buy an Aruba switch with 48x GbE, 4x SFP+ 10G (but no PoE) for $125. Granted, both of those are used. Needs to be new? OK, earlier this year, I bought a new Dell X1052 (like the Aruba, 48x GbE, 4x SFP+ 10G, no PoE) for under $500.
It’s nice to see prices declining on that gear and I know Dell has offered up great pricing on net gear trying to break into the world of networking. I continue to see good things happening on this front.
ja
USB 4 is way far ahead.
2 years out and it's still not cost effective.
He's not considering ROI at all; yes, 10 gb is awesome but it's still relatively expensive to implement in mid-2018 even just adding a 10gbNIC to your NAS and computer and doing a direct connect crossover; so it's not even really networking... my opinion is 1 gbps is perfect for home still, no home user (w/ exceptions such as leasers / etc that essentially operate a MDW out of their house) will ever get a valuable ROI on upgrading to 10 gbps, buttttttt not gonna argue a home office that serves clients on a WAN or geek who doesn't fiscally care totally might...
There is no ROI for home, it's purely a matter of "want to"--but I agree that GbE is perfectly adequate for home (and even most business) applications, which I suspect is why 10G gear is still much more expensive. The demand was never really there (because GbE really is good enough, or at least it has been to this point), so it was never produced in mass quantities, and what was (and still is) produced was/is marketed and priced for the enterprise (i.e., $$$$$). That enterprise gear is now available used for much more reasonable prices, sometimes still under warranty--if you shop carefully, you could do peer-to-peer connection between two machines for around $100 for both NICs and the cable.
I'm running 10G over fiber among my two virtualization hosts, my FreeNAS box, and from there (in an out-building) into my home. Do I need it? Not at all. But it's working very well, and I'm happy with the results.
I completely agree with Dan’s statement. Well said.
(Despite WD's use of the "MB/sec...." I suspect they meant Mbits/sec.)
No, they didn't--or if they did, it would be an exceptionally slow hard drive. 120-150 megabytes/sec is a pretty "normal" transfer rate for a hard drive.
shame i got a windows 10 transfer bug the drops all copying speeds to nothing at all
Amazing how dated these videos get, now we have cheap SSDs, cheap ram and cheap cpu cores but weirdly, 10gbe is STILL fuking expensive.
I'm here with 275 kb/s max...
+TheMusicSoldier you must be talking about your Internet connection. This series deals with an intranet (internal to your home/business). Not broadband connectivity. But that would be nuts, 10Gb internet!
Correction: no way in hell hell you will get sustained 125 Mbytes/sec from a spinning 7200 rpm drive....; you might get an occasional burst of data at SATA3 speeds, but, good luck otherwise.
Sure you can! :) I just setup a quick test with IOmeter using my WDC WD2002FAEX (7200 RPM WD Black Series) drive, which you can verify for yourself on the Task Manager screen shot I just took. Results linked bellow for your reference.
Linked off iTechStorm.com:
Write Test (127 MB/s): goo.gl/KoI8H9
Read Test (136 MB/s): goo.gl/77tbgn
In addition to that you are getting even better read/write speeds from the newer/larger drivers due to the platter density. Just look at the spec sheets as you go from 1TB -> 2TB -> 4TB -> 8TB, etc...
The Samsung 850 Pro only manages 550-ish MBytes/sec....; recommend review of definitions of burst transfer rate, and, definitons of Megabit vs. Megabyte.
Due to massively increased platter density in disks in recent years (same size physically on the outside but many more TB's on the inside) sequential transfer speeds have increased massively. A 8TB HDD can do over 200MB/sec now a days.
What didn't change though was random read/write. So the IOps stayed the same and that's where SSD's shine!
+InterTech absolutely! It's a great time to be alive :). I can remember complaining all the time about what a crazy bottleneck storage always was, and everyone was always so focused on CPU. Oh well. Better late than never!
Yeah so true. I'm guessing you where like me and had WD raptors in your desktop as soon as you could too. ;) Those where the times. :D
Card + Cable = $50
4 Port 10GBit Switch = $943838943zuu894rju8
Wtf? Is this 2007 or what?
NameIst Unbekannt 10Gb router = $999999999999999
10Gb throughput firewall/UTM = $1000000000000000000000
Sounds like he's reading from the Wikipedia xD
+RCTestKid lol, gee thanks...
iTechStorm np
That's right.. talk to people like they're stupid.. That always sells your point well. Ahem... not.
GNU Goats matter too
wifi peasants disliked this.
2007 is now 11 years ago... I still have 10Mb/s down, .75Mb/s over dsl up & no ethernet lol. America is screwed internet wise.
Time to move to a town that understands the importance of bandwidth : )
iTechStorm Thanks for the reply dude!
Everyone seems to understand that the internet meeds to be faster.. but the large companies are the only ones who control that. Aside from areas that have google fiber and some other exceptions, you can't find truely fast internet for a cheap price here.
I remember when 56K dialup was smokin! We will get there. The providers just have much larger geographies to span versus Europe where everything is close together.
@@macboi7601 There's some smaller towns building their own fiber network and only charging $45-$70 for 100\100 or 1gbe