It's been fifteen years since I first got bit by hardware licenses and they're still the dumbest thing I've ever encountered in computing. You already own the hardware! It literally costs them zero more dollars to just let you use the hardware you already bought! I will continue shaking my fist at the sky over this for the foreseeable future.
@@c.m.7037 yep we own nothing in todays time this is how they milk people dry we cant do this at all unless were a big company otherwise they dont give a damn about us alot of this will become ewaste eventually
Some modern vehicles even won't heat your butt if you haven't bought a license. The heater is there and the money for the hardware was spent but it just won't work.
I hate to say it but after I saw the title and then the box my instant thought was licensing fail. When I shared the link with my boss I said without watching the video just the thumbnail and the model number "what was the failure" he came back with license or unsupported SFPs. Brocade is notorious for their licensing. I have had many times when C level management or the procurement people have said I can get this for 10-100K cheaper with this other vendor and we have to then explain to them why the quote they got was for an unlicensed or base license unit. Sorry you got burned on this.
Absolutely. Brocade is atrocious about their licensing. Like, Cisco does licensing for certain feature sets, but I don't think I've encountered switches from Cisco that literally turned off half the ports if you didn't buy the license for them.
There is a very popular STH forums post about Brocade switches and licensing that might be of help to you. It’s called: Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
Agree'd i have the 24 port version of this currently working in my rack, only one set of 40gb ports work as 40gb though, the other set are for breakout cables only!
@@TheTuxprogrammer Fohdeesha indeed. There are so many ICX switches going for pennies on eBay because they're not licensed. I've been buying them up and licensing them myself for my lab. They're great bits of kit when you don't need to worry about the licenses anymore :)
OH, finally somewhere I can chime in! A gentleman by the name of Fohdeesha has flooded the ServeTheHome forums with their extensive knowledge of Brocade switches, and, by Googling their name, you can easily find a Setup and Licensing guide for Brocade ICX series switches :D
Also: I’m strongly considering starting an open source project to reprogram Fiber Transceivers. It’s silly that it’s come to that. FS has a box that does it, but it’s tied to an online portal, making it a weird proposition. I want the hardware and software to be fully open source.
Check out Serve the Home's forum post on the ICX series, there is a way to license these now that they are all EOL. A few people I know run this switch with the config found there and it seems to be working alright from what I hear.
I got the PoE model last year. Bought it due to the STH forum page. I've left a comment but it might not be visible due to it containing a web link. I've tweeted it too. I think he should checkout the Celestica DX010 next ;) I'm hoping to use my Dell S5248F as part of my home lab... though I need to register it to sort out the licensing situation with that. And some solar panels as the angry pixies sure are becoming expensive in the UK
I went with a Brocade 6610 poe switch based off what I learned from STH for cheap. I love having 40g for my Truenas and 10g to a few clients. Using Connectx-3 3 40g cards
Spot on Tux..... I did that exact thing for the Brocade/Ruckus ICX7150 switches. It works fine. Check out ServetheHome's forum post. It covers how to open up the licenses step by step.
You are limited to 55mph... please tap your NFC enabled debt or credit card against the screen if you wish to unlock higher speeds for the duration of this travel. *stop for fuel after driving on interstate for a few hours* You are limited to 55mph... please tap your NFC enabled debt or credit card against the screen if you wish to unlock higher speeds for the duration of this travel.
I have had the same situation very recently with Cisco. I bought two Cisco Aironet 3602i AP from ebay. I thought buying used enterprise level hardware to basicly reuse was not only a good thing but also cheap as hell and a good challenge for me. Oh how wrong I was. After I got the APs I realised I need new Firmware for them as I don't have a controller. Cisco though only gives this firmware out to company's with a service license. So after back and forth with Cisco I found myself with two perfectly fine APs which I cannot use, because Cisco wouldn't give me the firmware. Not to mention these APs were already out of service but still have their autonomous ios software locked behind a giant paywall. If these APs were still being sold I could understand. But Cisco didn't sell these anymore for several months and it doesn't make sense for any companys to use this. As private Consumers cannot reuse them as well Cisco effectively creates tons of unnecessary ewaste
You're starting to figure out that these companies couldn't care less about environmental concerns beyond the ESG scam. Reduce, reuse, recycle is real environmentally sound policy/business practice yet how many of the F500 truly practice any of it?
If you try again, be on the lookout for Aruba APs that support "unified" the AP-345 and newer I think. The new ones do require tracking down their proprietary serial cable though.
But it does make *cents* for them to not allow it to be used... other customers would need to buy new hardware (with a chance it could be their products) instead of making use of old stuff. All we can do is when there are alternatives, make sure to purchase from different companies that don't restrict products like this. Radio Control (RC) hobby is a good example. A lot of RC Radio/Transmitter companies limit software features based on what product you buy or require license upgrades to enable them. FrSky is really getting popular because they don't do that. The hardware they sell have all software features enable for all models of product. Pricing is less than alternatives to for the same feature and hardware.
Quick tip with heavy rack stuff: Temporary install something in the unit below, so you won’t have to carry all the weight whilst installing the new gear.
Sometimes, I would actually test stuff out on a bench first to make sure that the system/unit powers up and is able to do what it is supposed to do in order to look for potentially damage from shipping, especially when ordering from eBay.
@@jamescollins6085 Nope. Really hard because vendors like using various processors (CPU) as the core of a group of switch-chips in each different switch. They of course just recompile the source code, and presto, but you and I?---NOPE (big nope). Sad, I know.
I always tell people the hardest part of IT is failing the saving throws. Sometimes you just hit a wall due to licensing, hardware configs, no longer supported firmware and just greedy vendor issues.
Just a heads up, I hear there's a group that frequent the STH forums that can obtain the requisite licenses for you, at least for the 10G ports. I've been looking at switching to this switch also to get a flew more 10G ports from my FlexFabric 5800 HP.
Just bought one of these now, I've done my research on it before purchase and found that there's work arounds to the issue you had, mine was pretty cheap so I'll see soon if changing the file and ID codes work. Thanks for the video
Mikrotik CRS354-48P-4S+2Q+RM could replace all your switches. A great addition would be either the MikroTik CRS354 or CRS326 to add QSFP+ to your SFP+ setup
I love MikroTik gear. I have several at home and been flawless for me. I too eventually want to upgrade to 40 gig but for now 10 gig networking is fine. I agree the hardware licensing sucks. Especially in the used market when the gear could have had a second life only to be e-waste'd. It's really a waste.
Had a project at work with dual 20 Gbit to Cisco Fabric Interconnect. The best part of the build was finishing the DRS cluster in VMware with dual 20 Gbit VMotion ports. VMotions were insanely fast, as VMware uses both paths without any need for LAGs. It opportunistically uses paths similar to SMB multi channel. The funny part was how the customer’s SANs couldn’t even come close to saturating a single 10 Gbit iSCSI path. Moral of the story is that spinning rust isn’t useful above 10 Gbit unless you have dozens of hard drives.
Just a heads up, there was an odd buzz under the audio while you're in the office. Not something I've heard on previous videos, so I figured I'd mention it in case it was missed. Love the content itself, and definitely good to know just how predatory licenses can be on this kind of thing.
Yeah there is a definite hum when he is in his office. There is a static white noise in front of the rack as others have said but it is different than the hum as mentioned.
There shouldn't be a crack. There should be universal license keys for EOL equipment with a disclaimer that the manufacture no longer supports it so use it at your own risk and is for non-business use. Most of us would have been fine with it.
On the 10 gig ICX switches, you can just type a cli command to 'install' the 10 gig license and it enables the ports. It might also work for the 40 gig.
@@fohdeesha Not sure if the 6610 is full 40gbps routing capable though, should work great for 40gbps switching though, I use one as my main switch and it works great and I have dozens are spare parts due to my job decommisioning all our Brocade equipment.
I got an R710 for free from a friend and man it's been a hell of a ride. Knew nothing about servers a month ago and now know just a tiny bit more than that. Really neat stuff to get into
When you said new in box the first thing that came to mind was Licensing, its why UI and Mikrotik are making great inroads for this sort of environment
As soon as I heard the words Brocade - I understood immediately why this video was labelled as a fail. Brocade even licenses each port on a Fibre switch individually and you have to buy THEIR SFP's for each port.
I went "40G" on the backbone of my home lab a while ago using a Mellanox sx6036 from ebay for about $200. It has 36x 40/56G ports and can work for ethernet and or infiniband - i set mine to straight up ethernet only 56G mode. 56G only works with compatible Mellanox cables/cards, but these are also pretty available on ebay (56G Compatible ConnectX3's can be had for about $50-75). It also supports a breakout mode for some ports that splits a single 40G qsfp into 4x 10G sfp+ connections - this is good for systems that only have 10G. There is a ton of great support for this model on the STH forums.
Those sx6036's went through the roof price wise when the chip shortage hit. Not sure if they have came back down to a reasonable level. IIRC that switch is nice as the power consumption is not insane like some of the others.
Yeah, I snagged one of those a month or so ago on ebay for $135 or somewhere thereabouts. It didn't include the ethernet license and after failing to find any "free" solutions I pulled the trigger on another ebay auction for the license ($50) so I still got a working switch for less than $200. So far it's working like a champ as my homelab backbone network.
As a FSE for a big company, all hardware I’ve noticed uses licenses for everything. I was just recently introduced into an IT position and my eyes were opened when I started learning about all the equipment and the things about them. I hope one day I get to meet you, I myself am in Wilsonville OR
I knew the fail after reading the title and hearing Brocade. "I bet it's licensing!" I have yet to light a brocade up before. We had one in house for a review that was sent to trial along with a 3par 3200 SAN. The fun part was the Brocade was sent all 10g copper and we had 10g MMF on the 3par. We never got around to even lighting up the Brocade. We just shipped it back. We just got a pair of sfp+ adapter plates for our Summit Extremes and ran with 10g MMF sfp+.
Considering you already use Mikrotik hardware, you might consider their CRS354-48G-4S+2Q+RM switch. Alternatively, I personally like the EX4300 series switches from Juniper.
I can relate - I have not a license issue I can see, but a no-firmware-access-from-the-vendor issue and thus I sit with a 100Gbps switching fabric, but no switching connections. The HPE for instance does not hand out much of the firmware if you are not having a contract with them, so before any buying one shall get hands on the required firmwares-software.
im sorry to hear about that, but thank you soo much for pointing this out, i had a bid in for a Brocade unit, glad ive been outbid, will definitely never look for another one again
Late last year I purchased the new Ubiquiti Pro Aggregate switch to replace my HEAVY, LOUD, POWER HUNGRY enterprise Arista Networks 10G switch. The Ubiquiti, for $850 plus the cost of GBICs, is 28 SFP+ ports and four SPF28 ports capable of 25GbE. Using 10Gtek modules for 1Gb, 10Gb and 25Gb fibre, I rewired my network with slim Cat 6A cables from Monoprice, popped four Mellanox 25G cards in two big Synology NASes and two Dell PowerEdge servers and... never looked back. Silent, cool running, decently fast, and not ridiculously expensive.
Look at the ServeTheHome forums about the ICX 6XXX series licensing. Also, the 2/2-5 and 2/2/6-9 ports are 4x 10GbE links each, so they support breakout cables, but I’m not sure if they support 40G but as long as the 40G card on the other side can support 4x 10G links and can be bonded, then you should be fine. I run the ICX 6610-48 at home as my core switch with a MikroTik router
10:40 EE here. Just wanna point out: 9600 is your baud rate. Meaning symbols/second. You are encoding 8 databits into one symbol meaning your effective bitrate is at 9600*8 = 76.8 kBit/s
@@LucienneGainsborough You are right... It's a simple NRZ code and one might say OOK/2-ASK. So yes, each symbol represents one bit. 8 info bits, 10 code bits (consisting of start bit, data bits and one stop bit). Your calculation checks out!
It’s going from ridiculous to criminal that most companies now brick their hardware unless we pay them for the privilege of using the products we buy them .so, I buy a used car from some guy and after that in order to it to work, I need to go to The automaker company and pay them also for it to start moving , and even 10 times more that i payed the original owner .
The icx 6610 is a mint bit of kit. But yes there is a license component. Hopefully someone before me has sent you to the serve the home forum on how to get the 8x10g ports going. As well as for some good info on what ports are real 40g and which are breakout only. If not I suggest hurrying on over to their forums as there is a nice lengthy thread about the icx switches
You should follow that guide and get that switch running, and do a follow-up video. I was wary until I saw comments about how to get them working. But I bought one and followed the guide, and it works fine.
Arista switches are hard to get firmware updates for, but licensing isn't a problem, and it's easy to find a key to unlock optics from other vendors. 7050QX would scratch that 40gig itch.
Not $175, but less than the $3000 license, I work at an ITAD and we just recently listed up some Dell Networking S6100-ON modular top-of-rack switches with a single 40G module, for $770. If you want to do the work, there''s also Celestica switches for a similar price for 40G. They're all ONIE switches so you have a choice in what software to run.
If you take another stab at 40Gb, I'd recommend the FS S5860-20SQ. Its an FS-rebranded Broadcom switch with 20x 10Gb, 4x 25Gb, and 2x 40Gb. And 2 or more can be stacked which is nice so you can do MLAG/VPC, for that completely necessary redundancy in a home lab. I havent had any transceiver compatibility issues with a wide variety of models. Or theres that new Mikrotik CRS504-4XQ-IN that has 4x 100Gb QSFP that supports breakout cables. Kind of wish I had waited for that when I moved my lab to 25/40Gb because its much cheaper.
You can 3d print full height brackets. Very useful when changing and the other bracket, that you definitely saved because you always do, is *somewhere* in your basement.
I know the feeling. I just finished building a VPN for a client. Got everything done only to find out that the clients of my client would not install the VPN client software on their machines. So I configured the Web Portal of the VPN so that they could connect Via their browser. Because of some specific network issues that are out of my control I had to utilize the HTML5 clients for the users to connect into their remote desktop gateway. That part went smooth until more than 2 people tried to connect to remote desktops at the same time. The HTML5 client for remote desktop is licensed separately from the rest of the VPN. And those cost almost 10 times what the actual VPN cost initially.
since i checked on multiple devices is it only me or is there a high pitch noise interference in the background of this video? (Stops around 3:35) Either way, love the videos and your honesty about all things you give a try and do! Really good work there!
I got bit by an Aruba switch that required specific DAC cables. The next model up from mine has command to bypass that check, but not mine. Had to buy expensive cables just so HP could make a few extra bucks. If they hadn't done that, I might have bought another Aruba switch, but never again. Good to know to avoid Brocade too.
Something is with Aruba AP. If you update for example, an AP303 to the firmware 10.x, you also need to buy Aruba Central licences, because they removed the local VC on it...
Time to get into Mikrotik my man. Also assume anything from Brocade is going to be licensing hell.Some older gear of theirs we had per port sfp+ licensing on their 48 port sfp+ switches.
Have a read of the STH forum epic thread on these, there's solutions for your DAC and licensing issues. Probably should have had a good read before starting!
Take a look at Arista. We have some old switches, 40g and 10g, that don't have any license requirements that I know of. Getting updated firmware could be an issue though...
So. a 10Gbit switch? That's not 40Gbit. And no, having 1-2 uplink ports at a different speed doesn't count. At that point you are better off just using point-to-point links.
@@Prophes0r its a 10GB switch with 2 40GB ports, considering the switch he brought was a gig switch with 10gb and 40gb i dont see your point, also he wants 40Gbps to his NAS and backup server which is why i suggested this switch as it has enough 40Gbps ports for this and everything else can be 10Gbps
@@Prophes0r and yes he can ptp his backup and file server but then he still has to have a 10Gbps connection for regular LAN connection this way he still would only need one switch for all his 10Gbps and 40Gbps needs and one switch for his 1Gbps client needs. also means if many 10Gbps clients are hitting the file server at the same time the connection to that switch is bigger without having to mess around with link aggragation which can be a pain to set up corretly
Protip, boxes of paper work great for something not too high as do cardboard shipping boxes for replacement switch parts. Stools with boxes of paper on top also work for stuff that is more than the middle of the rack assuming the weight isn't crazy like a HP C7000 chassis. For leaving a 1U convection space between equipment, the hot swappable removable PSUs from switches or servers are great for spacing things almost perfect. Better to leave a 1U space between equipment when possible to allow for improved cooling. For heavy lifting, worth getting a cheap A/C lift or engine lift from Harbor Freight to move it into place.
Might be late to the party, but, you should give a try with Arista's DCS-7050QX switches, they're pretty good and cheap second handed (and quite compatible w/o licences with what I threw at it).
Sometimes you can get super lucky from eBay. I bought a used brocade that didn’t have a 10gig license. Gave up on 10gig. Then, bought a second unit (needed more ports) and it came with a 10gig license.
I say get skip 40 gig and get the Mikrotik CRS504-4XQ-IN - you can run 100 gig to the storage and editing rig and then break out the other 2 ports to 4 x 25 gig and get the rest of your servers up to 25. Win-win.
First off, I love the glass! Fan of them lead me to lots of others I follow, like you. Secondly, I'm using a mix of Juniper (from ebay) and Netgear (work was throwing them out) switches. I have a reserve Cisco 4948 that used to be my network backbone, but I'm just not a fan of it anymore. All still 1GbE, wanna go faster but, bills come first.
Being your already using Mikrotik switches would you not look to replace it with CRS326-24S+2Q+RM. I purchased this switch which has 24 10g and 2 40g ports. If you only need 2 systems at 40g it might fit the bill. I think its about double the price but it would be new and you get a warranty and no license issues.
I've got a Meraki switch that's just taking up space for the same reason - bought the license for the year, but couldn't justify keeping it up. Luckily it was not $3200. Good luck Jeff!
And I’m still waiting on 10gig for my home setup- I have all dual 10gig cards (4Cards 8 ports) just no cables nor switch….. just deciding on what switch 8-16 ports of sfp+ … or more?
May I recommend the Mikrotik CRS326-24S+2Q+RM, I have two of them at work and they work great. They support 1G media converters so you can run 10/100/1000M copper in them.
Basically this is moving manufacturing / R&D cost from product to license of features that you may don't need when you buy. This also hide hide total cost of product compared to others. So this was basically sold as 1G switch that can be later upgraded to 40G without additional hardware.
I made a different mistake with my 40/56Gbit setup. In my case, I could get the licenses from Mellanox for free as a home user/student. The difference with my setup is that it is IMPOSSIBLY loud. Neighbors coming over to see what the noise is loud. 'I can hear it while wearing headphones, it's on another floor of the house, and my doors are closed' loud. Unusably loud. I was in contact with someone at Mellanox to see if I could bypass the fan-protections so I could watercool it. But that project is stagnating. Oh! and it also draws like...120W while IDLING?!??!! 300ish under full load? I shelved the switch and just direct-attached my workstation to the VM Host. The plus side is it motivated me to build a short rack, rackmount my workstation, and move my VM host next to my desk. Why? Because DAC cables are the "cheap" option. But they aren't THAT cheap. A single 0.5m QSFP+ DAC cost me more than TWO used ConnectX3 cards...
I had this same situation when I first started IT. Luckily I was low-level enough that I wasn't the one dealing with this, but I remember how frustrated everybody was and how long it took to figure out.
It's been fifteen years since I first got bit by hardware licenses and they're still the dumbest thing I've ever encountered in computing. You already own the hardware! It literally costs them zero more dollars to just let you use the hardware you already bought! I will continue shaking my fist at the sky over this for the foreseeable future.
Had that happen to me with a juniper switch, it’s EOL and the web interface won’t open without a license, I am now stuck to CLI instructions.
It's horrible. You can't even operate most hardware now without license, it's dead paper weight, such a waste of materials.
brocade are pieces of shit this hurts small businesses with this type of nonsense
@@c.m.7037 yep we own nothing in todays time this is how they milk people dry we cant do this at all unless were a big company otherwise they dont give a damn about us alot of this will become ewaste eventually
Some modern vehicles even won't heat your butt if you haven't bought a license. The heater is there and the money for the hardware was spent but it just won't work.
I hate to say it but after I saw the title and then the box my instant thought was licensing fail. When I shared the link with my boss I said without watching the video just the thumbnail and the model number "what was the failure" he came back with license or unsupported SFPs. Brocade is notorious for their licensing. I have had many times when C level management or the procurement people have said I can get this for 10-100K cheaper with this other vendor and we have to then explain to them why the quote they got was for an unlicensed or base license unit. Sorry you got burned on this.
I thought the same thing
Absolutely. Brocade is atrocious about their licensing. Like, Cisco does licensing for certain feature sets, but I don't think I've encountered switches from Cisco that literally turned off half the ports if you didn't buy the license for them.
The licenses for this model are freely available with a 2 second Google search in his case, and don't affect the rear qsfp ports
@@fohdeesha Do you have to pay extra for the licences?
@@SirHackaL0t. no, hence the word "freely"
There is a very popular STH forums post about Brocade switches and licensing that might be of help to you.
It’s called: Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
Replying to try and bump this to the top. You can get yourself a license for much less than $3200.
Fohdeesha ftw
Agree'd i have the 24 port version of this currently working in my rack, only one set of 40gb ports work as 40gb though, the other set are for breakout cables only!
Thanks for posting.
@@TheTuxprogrammer Fohdeesha indeed. There are so many ICX switches going for pennies on eBay because they're not licensed. I've been buying them up and licensing them myself for my lab. They're great bits of kit when you don't need to worry about the licenses anymore :)
There is a servethehome thread called "Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)". It contains some very useful information
I swear the Aries LTT Store sight gag is my absolute favorite and I'm going to be sad when that sponsorship is over 😂...well played guys...well played
OH, finally somewhere I can chime in!
A gentleman by the name of Fohdeesha has flooded the ServeTheHome forums with their extensive knowledge of Brocade switches, and, by Googling their name, you can easily find a Setup and Licensing guide for Brocade ICX series switches :D
Also: I’m strongly considering starting an open source project to reprogram Fiber Transceivers. It’s silly that it’s come to that. FS has a box that does it, but it’s tied to an online portal, making it a weird proposition. I want the hardware and software to be fully open source.
Check out Serve the Home's forum post on the ICX series, there is a way to license these now that they are all EOL. A few people I know run this switch with the config found there and it seems to be working alright from what I hear.
I got the PoE model last year. Bought it due to the STH forum page. I've left a comment but it might not be visible due to it containing a web link. I've tweeted it too.
I think he should checkout the Celestica DX010 next ;)
I'm hoping to use my Dell S5248F as part of my home lab... though I need to register it to sort out the licensing situation with that. And some solar panels as the angry pixies sure are becoming expensive in the UK
I went with a Brocade 6610 poe switch based off what I learned from STH for cheap. I love having 40g for my Truenas and 10g to a few clients. Using Connectx-3 3 40g cards
Spot on Tux..... I did that exact thing for the Brocade/Ruckus ICX7150 switches. It works fine. Check out ServetheHome's forum post. It covers how to open up the licenses step by step.
Licensing is getting out of hand, a license for the speed of the connection has to be up there with heated seat subscriptions
This is normal for Brocade, they've been doing port licensing since the 90s.
@@btraker Most vendors have tbf, they all suck. Microtik are unusual in them not doing it. Good guy microtik
You are limited to 55mph... please tap your NFC enabled debt or credit card against the screen if you wish to unlock higher speeds for the duration of this travel.
*stop for fuel after driving on interstate for a few hours*
You are limited to 55mph... please tap your NFC enabled debt or credit card against the screen if you wish to unlock higher speeds for the duration of this travel.
I have had the same situation very recently with Cisco. I bought two Cisco Aironet 3602i AP from ebay. I thought buying used enterprise level hardware to basicly reuse was not only a good thing but also cheap as hell and a good challenge for me. Oh how wrong I was. After I got the APs I realised I need new Firmware for them as I don't have a controller. Cisco though only gives this firmware out to company's with a service license. So after back and forth with Cisco I found myself with two perfectly fine APs which I cannot use, because Cisco wouldn't give me the firmware. Not to mention these APs were already out of service but still have their autonomous ios software locked behind a giant paywall. If these APs were still being sold I could understand. But Cisco didn't sell these anymore for several months and it doesn't make sense for any companys to use this. As private Consumers cannot reuse them as well Cisco effectively creates tons of unnecessary ewaste
You're starting to figure out that these companies couldn't care less about environmental concerns beyond the ESG scam. Reduce, reuse, recycle is real environmentally sound policy/business practice yet how many of the F500 truly practice any of it?
If you try again, be on the lookout for Aruba APs that support "unified" the AP-345 and newer I think. The new ones do require tracking down their proprietary serial cable though.
But it does make *cents* for them to not allow it to be used... other customers would need to buy new hardware (with a chance it could be their products) instead of making use of old stuff. All we can do is when there are alternatives, make sure to purchase from different companies that don't restrict products like this. Radio Control (RC) hobby is a good example. A lot of RC Radio/Transmitter companies limit software features based on what product you buy or require license upgrades to enable them. FrSky is really getting popular because they don't do that. The hardware they sell have all software features enable for all models of product. Pricing is less than alternatives to for the same feature and hardware.
They sell them online because most sysadmins know how to get the firmware free online.
I have seen sites with cisco bin files kicking around btw
The opening line is awesome!
Quick tip with heavy rack stuff: Temporary install something in the unit below, so you won’t have to carry all the weight whilst installing the new gear.
yeah, those old HP G4 DL360's empty cases are great weight holders :+
the septup.exe from patchbox seems like a great tool for that type of scenario. Haven't used it myself though.
Sometimes, I would actually test stuff out on a bench first to make sure that the system/unit powers up and is able to do what it is supposed to do in order to look for potentially damage from shipping, especially when ordering from eBay.
setup.exe is AWESOME. I use it everyday.
Thanks for sharing, another company to add to my list to the ones that I will NEVER buy any kind of hardware.
share the list pls
@@CatalystReaction Cisco charge a ton for unlocking features too on their newer routers and switches.
Has anybody made any custom firmware for these switches?
@@jamescollins6085 Nope. Really hard because vendors like using various processors (CPU) as the core of a group of switch-chips in each different switch. They of course just recompile the source code, and presto, but you and I?---NOPE (big nope). Sad, I know.
@@Doesntcompute2k Ah, I see. Thank you for explaining.
The good ol, "ye got a license for that m8?" pitfall
loicense*
I always tell people the hardest part of IT is failing the saving throws. Sometimes you just hit a wall due to licensing, hardware configs, no longer supported firmware and just greedy vendor issues.
Just a heads up, I hear there's a group that frequent the STH forums that can obtain the requisite licenses for you, at least for the 10G ports. I've been looking at switching to this switch also to get a flew more 10G ports from my FlexFabric 5800 HP.
They released everything now since they are EOL. I bought a 6610-48p for $49 and everything is unlocked now.
Just bought one of these now, I've done my research on it before purchase and found that there's work arounds to the issue you had, mine was pretty cheap so I'll see soon if changing the file and ID codes work. Thanks for the video
Mikrotik CRS354-48P-4S+2Q+RM could replace all your switches.
A great addition would be either the MikroTik CRS354 or CRS326 to add QSFP+ to your SFP+ setup
I love MikroTik gear. I have several at home and been flawless for me. I too eventually want to upgrade to 40 gig but for now 10 gig networking is fine. I agree the hardware licensing sucks. Especially in the used market when the gear could have had a second life only to be e-waste'd. It's really a waste.
I have two of these and they are awesome! (Well, I have the non-PoeE version) …moral of the story is to keep buying MikroTik :)
Love Microtik, it's basically enterprise gear without the licensing
I had a microtik airfiber thing in a rural town
Had a project at work with dual 20 Gbit to Cisco Fabric Interconnect. The best part of the build was finishing the DRS cluster in VMware with dual 20 Gbit VMotion ports. VMotions were insanely fast, as VMware uses both paths without any need for LAGs. It opportunistically uses paths similar to SMB multi channel.
The funny part was how the customer’s SANs couldn’t even come close to saturating a single 10 Gbit iSCSI path. Moral of the story is that spinning rust isn’t useful above 10 Gbit unless you have dozens of hard drives.
Just a heads up, there was an odd buzz under the audio while you're in the office. Not something I've heard on previous videos, so I figured I'd mention it in case it was missed.
Love the content itself, and definitely good to know just how predatory licenses can be on this kind of thing.
I heard it when he was in front of the Cabinet. I presume It's the "noise filter" to remove all the server noise.
It sounds almost like a broken cable or a ground loop
@@deusqain No, the hum was actually gone when he was in front of the server rack. It's at the beginning and at the end of the video.
Yeah there is a definite hum when he is in his office. There is a static white noise in front of the rack as others have said but it is different than the hum as mentioned.
That buzz is very annoying
Wonder if there is a crack for the license like there is for the Supermicro IPMI stuff.
yes there is, there is a site called "fohdesha" where a dude has written some info to do that
There shouldn't be a crack. There should be universal license keys for EOL equipment with a disclaimer that the manufacture no longer supports it so use it at your own risk and is for non-business use. Most of us would have been fine with it.
anybody else hear a buzzing in the main video but not the intro? Clears up after 4(ish) minutes
Yeah I'm getting that too
comes back in the outro as well. Good content as always though!
Yep same
Unfortunately that's the NSA surveillance 5g waves. Not much one can do.
No idea what happened there. We didn't notice it in editing, but it's definitely there. That's my bad....
This is unfortunate, but I appreciate you making and releasing the video. I wasn't aware of this even being a thing, and I'm grateful for the warning.
this is why easy return laws need to be a thing, you can always miss something about a product and only notice it once you have it
On the 10 gig ICX switches, you can just type a cli command to 'install' the 10 gig license and it enables the ports. It might also work for the 40 gig.
the 40gb don't require a license, but it has to be in switch mode not router, requiring the sw firmware.
To add only 2 ports are 40gb the other 2 are 10gb x 4 breakout type.
@@Oyashiro_Chama the 40gb ports work just fine with the full router firmware
@@fohdeesha Not sure if the 6610 is full 40gbps routing capable though, should work great for 40gbps switching though, I use one as my main switch and it works great and I have dozens are spare parts due to my job decommisioning all our Brocade equipment.
@@Oyashiro_Chama the 40gbE ports will route at full line speed regardless of features enabled like the rest of the ports
I got an R710 for free from a friend and man it's been a hell of a ride. Knew nothing about servers a month ago and now know just a tiny bit more than that. Really neat stuff to get into
When you said new in box the first thing that came to mind was Licensing, its why UI and Mikrotik are making great inroads for this sort of environment
As soon as I heard the words Brocade - I understood immediately why this video was labelled as a fail. Brocade even licenses each port on a Fibre switch individually and you have to buy THEIR SFP's for each port.
Yep, even synology charges extra licenses on its home NAS systems for the surveilance station app above the "free" two cameras.
Unlike brocade, the Synology licenses are transferable
I was not expecting an hilarious ad... I got one. Thank you good sir!
I went "40G" on the backbone of my home lab a while ago using a Mellanox sx6036 from ebay for about $200. It has 36x 40/56G ports and can work for ethernet and or infiniband - i set mine to straight up ethernet only 56G mode. 56G only works with compatible Mellanox cables/cards, but these are also pretty available on ebay (56G Compatible ConnectX3's can be had for about $50-75). It also supports a breakout mode for some ports that splits a single 40G qsfp into 4x 10G sfp+ connections - this is good for systems that only have 10G. There is a ton of great support for this model on the STH forums.
Those sx6036's went through the roof price wise when the chip shortage hit. Not sure if they have came back down to a reasonable level. IIRC that switch is nice as the power consumption is not insane like some of the others.
I have the SX6012, which wasn't working, I think I need to use the FAE command to enable off-brand DACs
Wow, an excellent price.
Yeah, I snagged one of those a month or so ago on ebay for $135 or somewhere thereabouts. It didn't include the ethernet license and after failing to find any "free" solutions I pulled the trigger on another ebay auction for the license ($50) so I still got a working switch for less than $200. So far it's working like a champ as my homelab backbone network.
@@ajhieb There are TONS of links to help unlock all those features. Shame you spent the money already. :(
Well, welcome to the world of QSFP :D I had a similar issue with mellanox IS5025
Jeff, take a look at Fohdeesha's Brocade guide - it covers license unlocking for this exact switch.
Congratulations on being the only person in the comments spelling my nick right
@@fohdeesha ha, thanks. I have a sneaking suspicion that this was an intentional failure to make it a multi video series, but we shall see.
As a FSE for a big company, all hardware I’ve noticed uses licenses for everything.
I was just recently introduced into an IT position and my eyes were opened when I started learning about all the equipment and the things about them.
I hope one day I get to meet you, I myself am in Wilsonville OR
I knew the fail after reading the title and hearing Brocade. "I bet it's licensing!" I have yet to light a brocade up before. We had one in house for a review that was sent to trial along with a 3par 3200 SAN. The fun part was the Brocade was sent all 10g copper and we had 10g MMF on the 3par. We never got around to even lighting up the Brocade. We just shipped it back. We just got a pair of sfp+ adapter plates for our Summit Extremes and ran with 10g MMF sfp+.
Considering you already use Mikrotik hardware, you might consider their CRS354-48G-4S+2Q+RM switch. Alternatively, I personally like the EX4300 series switches from Juniper.
There's a guide on how to do it! Sent it via twitter dm! I've been about to pull the trigger on the switch myself and found the guide recently.
I can relate - I have not a license issue I can see, but a no-firmware-access-from-the-vendor issue and thus I sit with a 100Gbps switching fabric, but no switching connections. The HPE for instance does not hand out much of the firmware if you are not having a contract with them, so before any buying one shall get hands on the required firmwares-software.
im sorry to hear about that, but thank you soo much for pointing this out, i had a bid in for a Brocade unit, glad ive been outbid, will definitely never look for another one again
Late last year I purchased the new Ubiquiti Pro Aggregate switch to replace my HEAVY, LOUD, POWER HUNGRY enterprise Arista Networks 10G switch. The Ubiquiti, for $850 plus the cost of GBICs, is 28 SFP+ ports and four SPF28 ports capable of 25GbE. Using 10Gtek modules for 1Gb, 10Gb and 25Gb fibre, I rewired my network with slim Cat 6A cables from Monoprice, popped four Mellanox 25G cards in two big Synology NASes and two Dell PowerEdge servers and... never looked back. Silent, cool running, decently fast, and not ridiculously expensive.
fodeesha on the STH forums has a full guide for unlocking every single feature on these...
Dude. Overkill with the box knife lol
Look at the ServeTheHome forums about the ICX 6XXX series licensing. Also, the 2/2-5 and 2/2/6-9 ports are 4x 10GbE links each, so they support breakout cables, but I’m not sure if they support 40G but as long as the 40G card on the other side can support 4x 10G links and can be bonded, then you should be fine.
I run the ICX 6610-48 at home as my core switch with a MikroTik router
10:40 EE here.
Just wanna point out: 9600 is your baud rate. Meaning symbols/second. You are encoding 8 databits into one symbol meaning your effective bitrate is at 9600*8 = 76.8 kBit/s
I believe each symbol only represents one bit in RS232. And given 8b/10b encoding it only yields 960Byte/s or 7.68kbit/s
@@LucienneGainsborough You are right... It's a simple NRZ code and one might say OOK/2-ASK. So yes, each symbol represents one bit. 8 info bits, 10 code bits (consisting of start bit, data bits and one stop bit). Your calculation checks out!
Could you revisit this project with the Fohdeesha guides for licensing?
Time to go Office Space on that switch.
Years ago Alcatel-Lucent introduced 'port-sensitive pricing' where you had to license each port in the switch for it to work at all.
It’s going from ridiculous to criminal that most companies now brick their hardware unless we pay them for the privilege of using the products we buy them .so, I buy a used car from some guy and after that in order to it to work, I need to go to The automaker company and pay them also for it to start moving , and even 10 times more that i payed the original owner .
This is the primary thing killing the used market for kit such as this which in turn drives more sales so don't expect it to change any time soon.
@@davidmcken You spelled EXTORTION wrong, bruh....
The icx 6610 is a mint bit of kit. But yes there is a license component. Hopefully someone before me has sent you to the serve the home forum on how to get the 8x10g ports going. As well as for some good info on what ports are real 40g and which are breakout only. If not I suggest hurrying on over to their forums as there is a nice lengthy thread about the icx switches
You should follow that guide and get that switch running, and do a follow-up video. I was wary until I saw comments about how to get them working. But I bought one and followed the guide, and it works fine.
Arista switches are hard to get firmware updates for, but licensing isn't a problem, and it's easy to find a key to unlock optics from other vendors. 7050QX would scratch that 40gig itch.
“Get in losers” best opener ever 😂
I think the clip at 13:50 would have made a great opener :)
Not $175, but less than the $3000 license, I work at an ITAD and we just recently listed up some Dell Networking S6100-ON modular top-of-rack switches with a single 40G module, for $770. If you want to do the work, there''s also Celestica switches for a similar price for 40G. They're all ONIE switches so you have a choice in what software to run.
Thanks for explaining virtIO vs E1000 in the Dave's Garage video! I never knew what the performance difference was! 🙏😁
I do that with brackets all the time or you can unbend the top and *"retrofit"* the card. 🤓😎
Thanks for the video, you taught me a major "gotcha" in planning homelab hardware.
If you take another stab at 40Gb, I'd recommend the FS S5860-20SQ. Its an FS-rebranded Broadcom switch with 20x 10Gb, 4x 25Gb, and 2x 40Gb. And 2 or more can be stacked which is nice so you can do MLAG/VPC, for that completely necessary redundancy in a home lab. I havent had any transceiver compatibility issues with a wide variety of models.
Or theres that new Mikrotik CRS504-4XQ-IN that has 4x 100Gb QSFP that supports breakout cables. Kind of wish I had waited for that when I moved my lab to 25/40Gb because its much cheaper.
I owned this S5860 and it's an amazing switch for the price. And best of all you don't need any licences to use all the speed available
You can 3d print full height brackets. Very useful when changing and the other bracket, that you definitely saved because you always do, is *somewhere* in your basement.
Wow this is rage worthy!
The coil whine ground loop non isolated noise was dank.... Like that beer
I know the feeling. I just finished building a VPN for a client. Got everything done only to find out that the clients of my client would not install the VPN client software on their machines. So I configured the Web Portal of the VPN so that they could connect Via their browser. Because of some specific network issues that are out of my control I had to utilize the HTML5 clients for the users to connect into their remote desktop gateway. That part went smooth until more than 2 people tried to connect to remote desktops at the same time. The HTML5 client for remote desktop is licensed separately from the rest of the VPN. And those cost almost 10 times what the actual VPN cost initially.
since i checked on multiple devices is it only me or is there a high pitch noise interference in the background of this video? (Stops around 3:35) Either way, love the videos and your honesty about all things you give a try and do! Really good work there!
Ah A teaching moment for all you home-labbers. Great video.
I'd be interested in seeing you review the Mikrotik CRS354-48G-4S+2Q+RM.
The CRS354-48P-4S+2Q+RM also has POE+
I got bit by an Aruba switch that required specific DAC cables. The next model up from mine has command to bypass that check, but not mine. Had to buy expensive cables just so HP could make a few extra bucks. If they hadn't done that, I might have bought another Aruba switch, but never again. Good to know to avoid Brocade too.
Something is with Aruba AP. If you update for example, an AP303 to the firmware 10.x, you also need to buy Aruba Central licences, because they removed the local VC on it...
I ran into the same problem with a Cisco ISR 4321, all the ports were limited to 100mbps without a license.
Thanks for the video mate. No wonder they are so cheap used. They basically just a 1gbe switch.
Ok the RAM Joke at the beginning was Great 🤣
Time to get into Mikrotik my man.
Also assume anything from Brocade is going to be licensing hell.Some older gear of theirs we had per port sfp+ licensing on their 48 port sfp+ switches.
Have a read of the STH forum epic thread on these, there's solutions for your DAC and licensing issues. Probably should have had a good read before starting!
Hopefully he sees this. That thread helped me a ton
Take a look at Arista. We have some old switches, 40g and 10g, that don't have any license requirements that I know of. Getting updated firmware could be an issue though...
Jeff have a look at the Mikrotik CRS326-24S+2Q+RM it has 24 10Gbps SFP+ and 2 40 Gbps QSFP+
So. a 10Gbit switch?
That's not 40Gbit.
And no, having 1-2 uplink ports at a different speed doesn't count.
At that point you are better off just using point-to-point links.
@@Prophes0r its a 10GB switch with 2 40GB ports, considering the switch he brought was a gig switch with 10gb and 40gb i dont see your point,
also he wants 40Gbps to his NAS and backup server which is why i suggested this switch as it has enough 40Gbps ports for this and everything else can be 10Gbps
@@Prophes0r and yes he can ptp his backup and file server but then he still has to have a 10Gbps connection for regular LAN connection this way he still would only need one switch for all his 10Gbps and 40Gbps needs and one switch for his 1Gbps client needs. also means if many 10Gbps clients are hitting the file server at the same time the connection to that switch is bigger without having to mess around with link aggragation which can be a pain to set up corretly
Protip, boxes of paper work great for something not too high as do cardboard shipping boxes for replacement switch parts. Stools with boxes of paper on top also work for stuff that is more than the middle of the rack assuming the weight isn't crazy like a HP C7000 chassis. For leaving a 1U convection space between equipment, the hot swappable removable PSUs from switches or servers are great for spacing things almost perfect. Better to leave a 1U space between equipment when possible to allow for improved cooling. For heavy lifting, worth getting a cheap A/C lift or engine lift from Harbor Freight to move it into place.
Might be late to the party, but, you should give a try with Arista's DCS-7050QX switches, they're pretty good and cheap second handed (and quite compatible w/o licences with what I threw at it).
Juniper EX4300 is a great 40g option.
I saw it coming but it still hurt to see the typical license road block.
Have a look at the Mikrotik CRS354-48G-4S+2Q+RM or CRS354-48P-4S+2Q+RM
ah man. I'm just south of you in LO and can feel your pain brother. All my kit is aruba 3810s and got lucky that I never faced this brick wall. Cheers
Look into old POTS dial-up internet service. 10:45
I once used 2.4K modem.
Sometimes you can get super lucky from eBay. I bought a used brocade that didn’t have a 10gig license. Gave up on 10gig. Then, bought a second unit (needed more ports) and it came with a 10gig license.
thats the switch we use in our studio. amazing but need to consider cooling and noise, some fans are better than others on the PSU
I say get skip 40 gig and get the Mikrotik CRS504-4XQ-IN - you can run 100 gig to the storage and editing rig and then break out the other 2 ports to 4 x 25 gig and get the rest of your servers up to 25. Win-win.
I hope Lexar were appreciative. That was amazing 🤣
Thanks Jeff! My curiosity is satisfied without putting in hours of work and $300
I recommend looking into Cisco Nexus 3000 (cheaper) or Dell S4048-ON .
Cisco and newer Dell switches are usually rock solid.
First off, I love the glass! Fan of them lead me to lots of others I follow, like you.
Secondly, I'm using a mix of Juniper (from ebay) and Netgear (work was throwing them out) switches. I have a reserve Cisco 4948 that used to be my network backbone, but I'm just not a fan of it anymore. All still 1GbE, wanna go faster but, bills come first.
Being your already using Mikrotik switches would you not look to replace it with CRS326-24S+2Q+RM. I purchased this switch which has 24 10g and 2 40g ports. If you only need 2 systems at 40g it might fit the bill. I think its about double the price but it would be new and you get a warranty and no license issues.
I've got a Meraki switch that's just taking up space for the same reason - bought the license for the year, but couldn't justify keeping it up. Luckily it was not $3200. Good luck Jeff!
And I’m still waiting on 10gig for my home setup- I have all dual 10gig cards (4Cards 8 ports) just no cables nor switch….. just deciding on what switch 8-16 ports of sfp+ … or more?
I've got a Mellanox SX6012 for doing 40G and it doesn't work, but I believe I can use a secret FAE command to enable off-brand DACs
Enterprise licenses are absolutely the worst thing - as someone that has been in the industry for 16 years it has only gotten worse somehow :(
Reminded of an Old King of Queens episode, "The money is in the licenses!"
May I recommend the Mikrotik CRS326-24S+2Q+RM, I have two of them at work and they work great. They support 1G media converters so you can run 10/100/1000M copper in them.
Basically this is moving manufacturing / R&D cost from product to license of features that you may don't need when you buy.
This also hide hide total cost of product compared to others. So this was basically sold as 1G switch that can be later upgraded to 40G without additional hardware.
Switch Mafia: "That's a nice looking switch you've got there, it'd be a real shame if you didn't have a license to use all the ports on it..."
I made a different mistake with my 40/56Gbit setup.
In my case, I could get the licenses from Mellanox for free as a home user/student.
The difference with my setup is that it is IMPOSSIBLY loud.
Neighbors coming over to see what the noise is loud.
'I can hear it while wearing headphones, it's on another floor of the house, and my doors are closed' loud.
Unusably loud.
I was in contact with someone at Mellanox to see if I could bypass the fan-protections so I could watercool it. But that project is stagnating.
Oh! and it also draws like...120W while IDLING?!??!! 300ish under full load?
I shelved the switch and just direct-attached my workstation to the VM Host.
The plus side is it motivated me to build a short rack, rackmount my workstation, and move my VM host next to my desk.
Why? Because DAC cables are the "cheap" option. But they aren't THAT cheap.
A single 0.5m QSFP+ DAC cost me more than TWO used ConnectX3 cards...
If he ever gets the 6610 running it's got some pretty beefy noisemakers in it too. There's a whole modding community just to quiet the fans on it.
0:53 I'm glad you're still Jeff!
Just once instead of "as always, I'm Jeff" I would love to hear, "but today, I'm Francis."
Doesnt brocade have an "honour system" like cisco that you can install whatever license you want? I did that on a catalyst 3750x
I had this same situation when I first started IT. Luckily I was low-level enough that I wasn't the one dealing with this, but I remember how frustrated everybody was and how long it took to figure out.