Thank you to everyone for watching and taking the time to leave such kind words about the project! I'll have some more information on the channel very soon!
To add vehical information you could possibly send the images to a database of cars and have it figure out what kind of car it is, it would be cool to have a version of ChatGPT and figure out a way to interact with the helmet controls in place of Jarvis, but great job thats looks so freaking cool
You do realize that you basically just made your own VR headset, right? Very awesome stuff. I had brain-built something like this, but wasn't able to put the time, money, or skill into it. You did a WAY better job than I could have, and not only am I impressed, but hugely thankful that you took this to stratospheric levels. I can't compliment you enough!
Could you possibly put a small camera in the helmet to provide retina tracking so as to sync it up to the object detection? This should be an easy mod for you and it would add stability to the system in large open areas. Great video btw!!
It’d take too much memory to build a database of any possible object that object detection could lock on to. Maybe instead could pair it up to google images and maybe a simple AI like alexa to display relevant info
Yeah you could also lower the opacity and size of the UI elements and maybe lower the resolution of them then blur it so you don’t notice, so that you can see more, but when you look at one it will get bigger and come to full opacity. As another comment said you could use an AI such as GPT-3 and display relevant info of an object using Google. You could also add interactivity to the UI e.g have it so you can look at something and blink twice to select it. This could also allow you to easily toggle object detection on and off when you do/don’t need it which could help with performance. Another thing that could help with performance is using foveated rendering to lower the quality of the screen if it is in your peripheral vision, where it is already blurry to you.
Once in a while, youtube recommendations actually produce some gold. This is one of those times. Excellent build and I look forward to see further advancements and features to be incorporated into the design!
This is great! I always felt like the Iron Man suit (at least early versions) did eye tracking to see where Tony was looking. If you could get that implemented then you could be more specific over object detection and potentially use it as a control interface. In fact, a button in the suit glove and eye tracking should be plenty to control it without having to hold that keypad up to your face.
I would imagine you also want your “Jeeves” to provide you with queues on what you’re not currently looking at. That’s more proactive than reactive. IMO, getting stable and reliable output from the object detector is more important. Just my cents (by the way, what happened to the cents symbol on my phone keyboard).
The fact that you could fit all that inside the helmet is just crazy! That's so tight! And you even manage to not make the eye looks weird! This is next level
Thank you! It seems everyone has different opinions about the eyes. For some people they stand out and for others they don't. I think it matter a lot how close you are.
@@kerseyfabs As someone who's in the process of converting a premade display prop Halo Spartan helmet into essentially this, fitting it all in has been hours and hours of dremelling and 3D printing adapter mounts/plates for everything. Definitely gonna take some notes from your work and see if i can revisit my internal layout !
Yeah, the Nano was great for experimenting but not enough memory for much else. The Xavier is a lot better and I can't wait to get my hands on an Odin!
Kris, I saw the time on this - over 30 minutes - at the end, I could not believe how fast it went, you did a fantastic job designing , building, programming and testing. This is a project you are justifiably proud of and will be fun to follow as it continues to develop
Chris you should be so proud of your accomplishments! Thank you for sharing your experience and proving this is possible. I'm so inspired to do this with my builds now!
so, you want to have an update feature so it can change the simple "car" label later. so, it sends the "car" info to a remote server, and the info from that search is listed. could do the same for adding a label to people, to look up your friends list on Facebook or something :P but, adding the rest of the armor, you will have more room for more computation, and cooling options. hell, having the hottest part on your back with fans blowing out vent ports as if you are trying to fly off, would be a fun gimmick for cons. taking advantage of ar glasses may be your next step. using the transparent displays will give you real time and batt independent view of the world around you, while also giving you the gui hud you want. along side the option of remote computations and search handling, you should be able to get even closer to true iron man hud tech, using those cameras for zoom options, along side the recordings for youtube.
If you used some micro cameras like a VR headset does, you could add hand tracking so you could do some sort of hologram 3d workspace within the helmet like Iron Man did. Might take a while to get down but just a thought anyway. It would also be really cool if you added some sort of eye tracking like the Apple headset, a code similar to the OpenCV Laser Point Tracking system, this way it would only identify objects that your looking at, saving the computer some effort and making it less crowded and more able to hold up the tracking part of the display instead of it cutting in and out. But, my addition ideas aside, this was really awesome, best video I have ever seen.
Great job! For the lag :You can split the video with hardware right at the camera's output. From the split section you connect your video directly to the output mixer as background( hardware again). From the second split section you feed into your computer and retrieve only the interface. Project the interface on top by connecting to the output mixer. This will give you a live feed without lag. The only lag that can possibly exist, will be at the interface.
That is so amazing and really shows how amazing and talented a real-life Tony Stark would be in figuring out how to fit all those electronics in such a small space and make it work wirelessly.
the fact that more people trying to approach utilitarian perspective where it "actually" works. and not just gimmick is what's going to advance human technology to next level. Keep up the work my sir!
I've got to say, that is absolutely amazing! From having a concept/idea to making it a reality. Keep wishing you the best in all your future endeavors and am glad I stuck with you since the beginning. I look foward to your future content, always have and always will. Laughed at the end when the kid said, ain't you suppose to be dead.
@@kerseyfabs Ouu yee. Thats a great idea. This is where a helmet like this comes in handy. Maybe a project a bit like from the Street Hawk series or the RoboCop 2019 movie (badass helmet design). I'm a motorcyclist and 3D designer (also deals with 3D printing), I've often thought of a similar idea. HUD display in the helmet, and switches under the thumb at the handle - unless voice control, as in some intercoms. It's better to have a GPS notification on the helmet display than to poke around in the phone while driving. GPS gauges, message notification and maybe even readings from the machine itself; there is certainly something to put in such an interface, but the truth is that it must be quite minimalistic. What if Jarvis found a detour and said "Sir. I found a shorter way?" Cool thing.
2:40 lmao forgot about that part. There’s something so satisfying about watching 1) someone else work and 2) seeing an entire two years boiled down into a 30 minute video. Absolutely fantastic. I commend you on your efforts. I also realize, thanks to you, how much engineering you put into the (more than just a) helmet. I’m also amazed at the breadth of your skill level. Thanks for sharing this. I was particularly interested in how you developed the GUI, nice job J6. You guys killed it.
Not me watching this thinking... halo fans and iron man fans are in a race to make functional suits. This guy already has the HUD down, and Alex Labs has the arc reactor and repulsor tech down... For halo, Installation00 has the helmet working already. Now we just have to wait and see which side makes a complete suit first
LET'S FUCCIN GOOOOOOO!!!! Just started planning a similar idea to this but more Cyberpunk inspired! You've done me an amazing service with this video sir.
@@kerseyfabs I’m going to start with getting the basics up and running, but I’d like to add IR optics as well! I was super impress with your video showcasing the new nano so I’ll probably use the new NX to see what kind of hardware encoding it can do. While im not *super* concerned about recording, it would be awesome to just have that extra headroom
Congratulations on the success of this build, I'm absolutely blown away by how awesome the helmet and the amount of tech you were able to squeeze into such a small space. I want one so much to add to my collection even it means more ear ache from the wife it would be so worth it big love from Ireland can't wait to see how your creation evolves
You did it, you did it! In theory with the field of vision you now have you should be able to walk around with the helmet without problems, the only additions you could make are microphones on the sides to hear well since the helmet encapsulates your head and cutting the sounds, then if you want you could insert a microphone and a speaker to make your voice heard and add effects if you want. I too have the dream of realizing this project, to save space horizontally in the helmet, I had thought of positioning the screens at the bottom of the mask pointing upwards with the lens above, then positioning two mirrors in front of the eyes at an angle of 45 ° so that they reflect the images of the screens, if desired the mirrors could be rotated so that when the system is off you can still see through the slots on the mask. As for additional information, you could insert a function that tracks where you are looking and then provides you with the data and information without filling your field of view too much Think with the technology of next generation viewers how compact all this can be, the only difficulty will be hiding the cameras.
Sorry for taking so long to reply Drew but you had a very thoughtful comment and I wanted to reply to your thoughts! The microphones and speakers were ideas I've had and I may implement them relatively soon. The mirror idea is interesting but I'm not 100% sure how it could save space. I'll do some research/thinking on it. Eye tracking is on my wish list but it requires additional cameras. Hiding the cameras is a work in progress. Thanks again for the feedback!
Ive been wanting to do a gundam cosplay with a HUD system just like this. The fact that you will make this available for others to use actually motivates me to actually plan out doing this now rather than what my original plans were gonna be.
Random idea, have fake 3d graphics like doom uses, but instead of the vertical axis, be the horizontal one, ie: the one inline the direction you are facing. Headache is too much to think it out more. Also perhaps if put a lcd ontop another lcd you can have the bottom show the environment and the top show any computer stuff to avoid lag, makers muse did a dual lcd layer for different reasons but it is a good demo of what it is.
YESS this is what I always wanted to see. I've been looking for something like this for 4 months now!! RRespect cant wait to see the updates & Upgrades
This absolutely rocks. You should put the screen that shows what you are seeing on your back so when you are walking about people behind you can see that you’ve done an absolutely awesome job.
It is absolutely phenomenal. The only thing is the helmet sticks out from your face a little bit but that doesn’t detract from how amazing this is. Do you plan to make a full suit with this thing?
You have completely inspired me good Sir! This is absolutely amazing, I always had a sneaking suspicion that this technology was possible. Thank you for paving the way.
As many super hero (Iron Man/Spider man) video projects I have seen, this one is by far the best and most interesting one I have watched to this day. I have no clue how to build such things so watching someone else do it brings me much happiness. Good job. I will be watching.
"IRONMAN...! I thought you were dead..." 😂😂😂 I scared my upstairs, elderly neighbor cause that caused me to break out in a loud, barking laughter - he thought a vicious dog had got in my house. LOL! Your work with that tech is just astonishing! I'm working on a Mandalorian helmet (just Mandalorian in general - not THEE Mandalorian) and this video has me wondering how I could incorporate a HUD like yours into my own bucket. Thank you for the video! Subbed!
I can’t wait for you to release this so we can see what the community does with it! You are just one person that has come this far imagine what a whole community can do with your work as the base.
Ngl, I've had that idea for years ever since I got my first VR but I never actually did anything so seeing how similar your project was to what I envisioned makes me proud in a "I wasn't too far off" way
I can definitely see this taking off. Like this could be militarized. With the a huge amount of funding and a awesome team behind this. This could be the start of a real life hero.
I think this is the best thing I've ever seen on UA-cam you're a fricking legend dude, I would love to see someone with the reactors attached to their hands, the full armor and your helmet this would be insane
I coined you your genius, when you noted putting everything in a PDF for others. That’s what I call a worthy channel to watch & progressive planning. Due to the fact that even if it was just for yourself you wouldn’t have to waste time revisiting your writing to code once again. I actually have been thinking of doing something similar myself although I love originality so I’d have to conceive a mask worthy to bring in reality. I’ll have to take you up on your programming never has it been my strong suit. Men like you are few Continue, Continuing on your legacy champ
I really appreciate all of that. I'm glad I can share all of this and that there are people interested in the details of the project. I'm still working on some details behind the scenes before I release the code but it's coming.
This is truly awesome. I'd love to see computer technology progress to where this is more miniaturized and into a set of goggles for surgeons & nursing staff to wear. The surgeon could be looking at a patient in the OR/ER, visualize the damaged area, and receive guidance from another physician + have patient stats pulled up. It'd be awesome to couple the software with unique RFID signatures for tools; this would be great for an Astronauts HUD to see what tools are where vs. having to hunt for them if there's an issue.
I love your ideas! It's one of the reasons I'll be open sourcing the project. I'd like for it to be used in other ways. I've already been contacted by others that are interested in expanding it.
2 роки тому+1
That´s how it starts. Just as a lot of tech we have today were inspired by Star Trek, imagine 40 years from now. An you are already there. I hope I live this long to see it.
me from 2 years ago would be fainting from excitement. I was at the height of my Iron man phase. Now, I my interest in Iron man is resurfacing. I've always thought a helmet with a HUD would be the coolest thing, and it's so cool to see you just completely going for it, and making it as close as possible to the movies
Thank you! I never lost sight of the dream. I really wanted to take what Hacksmith did to the next level. It just took some time. There's more to do still!
Soon everything will be upgraded and seamless, like the display being one screen vs two and higher memory running to help prevent crashes. This would be really fun to keep an eye on and see what you do for upgrades.
Maybe a 9DOF on your left wrist that has an input system overlayed to the HUD as a GUI that moves with your wrist. Then cameras detect your right hand as the input peripheral. Seriously incredible build. Thank You for sharing the journey! Can't wait for more...
I love the idea. With the repulsor video I just put out, it ties in perfectly. There are some even newer sensors too with amazing sensor and gesturing ability.
26:30 When you want the HUD like Iron Man, but you see the tall, daunting task of making it. Wow. You have more patience than me! I love tech, but I'm more of an artistic type of guy. I hope one day these components can be more compact. 27:15 You're local?! Wow! 29:30 I heard that record player scratch sound fx and thought, " Hey at least that kid saw "Endgame"." Whelp, time to get back to work! Great video.
This is so cool! As a fellow SWE I would love to see more of the software side, all of it! Especially the gstreamer and Ui elements! Such an inspiration, thanks!
Good to hear from you Tim(othy)! I'm working on a complete open source release and I get closer all the time. Keep an eye out on this channel for more information.
You have certainly done a lot of heavy lifting on the way to a real useful AR . I love that you focused on the practical application of existing and emerging technology. I have had an idea for some time now that would run parallel to your project . If I can make some headway, I would love to share it with you. Meanwhile, thanks for shooting this and taking all the time to get it out to us. I know it is not as easy as breathing. In fact there is a ton of work that clearly went in to all of this. I am impressed.
This is exactly what I want to do. But I also want to add an internal and external set of mics and speakers so that I can both talk to Jarvis to automate parts of the suit, but also to communicate better with people outside of the suit. And possibly modulate vocal pitch down just slightly, which they definitely did with RDJ on the first couple Iron Man movies. And hopefully have it all work with a faceplate that moves. Not sure if I can pull that all off, but that’s my goal.
Check it out! Here's the status of my AI assistant! ua-cam.com/video/vR6_FkFsi3Y/v-deo.htmlsi=0vzzh7nzCljoz_yc AND ua-cam.com/video/0bnFI3myK7Y/v-deo.htmlsi=jqNW8-v7KKqJ9782
Man it's like seriously marvellous move ... People can't even easily fit something in that shape but you did and made world's first real iron man helmet
Great job... and great project. But def NOT the first/only Iron Man HUD project as stated. Hacksmith posted (and they did a variant as well).. still a great job. (just not the first).
Mine is the first fully-functional Iron Man HUD. The Hacksmith's first video 3 years ago was a camera with no HUD. Their updated helmet was Halo based and added some HUD elements but not all of the motion or GPS components. JLaservideo also did a camera in a helmet with some apps built into the display. No shade at all to those that came before me. I've watched them all.
@@kerseyfabs I guess if adding more features (like the OpenCV/GPS stuff) lets you claim being the first.. ok. :) I know mine has a live camera, animated/overlays.. and also real-time bi-directional data from (wireless) external circuits. (such as the Arc Reactor [Uni-Beam] & repulsors) so anytime those are used, you will see real-time updates/feedback in the HUD display. (Also fully functional database to save/log (whatever).. no GPS added into mine. So I guess you are still 'first'. Either way still a nice project!
@@xl97 Well, it's the internet and all claims are made in regards to what has been shared and what I knew about at the time. If you've made any videos or posted about any of your work, I'm sorry but I haven't seen it. All the best and thanks!
you know what would be amazing is if you could somehow fit some thermal cameras in there so you could get thermal optic visuals in 3D augmented reality. Or maybe some powerful infrared LED lights and cameras that have night vision capabilities. And maybe even a zoom function would give it more of a feeling of having useful utility. But definitely add a fan in there for cooling your face, because it could really make a big difference in comfort, and could even reduce the moisture level in the helmet which can't be good for those components.
It's already possible using the AR tech available on Amazon. Hologram tech was simply used in the movie so audiences could see it, when tbh, the more accurate & tech involved version would be basic AR style with eye tracking. Much more compacted, but far more immersive.
I get what you're talking about. I've seen what's available off the shelf. The biggest problem with transparent tech is that visibility is incredibly bad in the helmet. If you have full lighted eyes, that hinders your vision. Plus, the eye holes are very small and offer very little peripheral vision in any direction. You can see in Iron Man 1 that when the helmet goes dark, his visibility isn't the same. Second, I don't know any of the off the shelf products that have an open API that would allow you to code your own UI or applications.
This just game me soo many ideas!! Thank you so much for this. I never got to the point of putting cameras in my suit/helmet. I get that same comment all the time from kids though when I'm in my suit "Hey, I thought you were dead". At least now I just say that wans't me, that was another universe's Tony Stark. I'm still here.
@@kerseyfabs So true, everyone is a critic these days. I'm thinking of building a large cosplay suit, Groot, or maybe a Jurrasic World dinosaur, where I think the cameras would come in perfectly.
I am gobsmacked. This is exactly what I’ve wanted to build since the first Ironman film. You have done amazing work. I have a couple of ideas which I would be happy to share with you, if you are interested. I know no one else has done them and I think you would have the skills to do them
Wow! It's absolutely incredible. I'm looking forward to v2. Perhaps some curved screens to reduce/eliminate the lenses and space needed. Also, what about some airflow channels to reduce heat inside the helmet? Nothing crazy like an A/C unit. Just a small fan (an inch or two dia.) to push air through. Another thought...what about using a similar system that cars use to see around the vehicle, to increase field of vision? Like the 'Fish Eye' cameras on the side mirrors that then use software to unbend the image for display?
Thanks Allen! I have a curved display on the way as a potential upgrade. I don't think it will eliminate the need for lenses though as our eyes are not great at a few centimeters from the display. So far I haven't needed fans in the helmet but, as we get back into warmer weather, I'll consider it. Right now people are already complaining about the cameras, so I don't think I'll add extra ones yet but I do love the idea of doing the warped wrap around. My vehicle has that and it's very cool!
I'm looking at venturing into making Destiny cosplay, so this tech would be phenomenal in those completely closed face helmets with no lenses. Though, I would most likely not need any heads up stuff. Just the ability to see. But still! This is amazing man!
Nice work , I like it ! idea that I would like to share as object detection is messy in real word / outside, you should : 1- Display only one object. 2- Display the object that appears in a specific spot / angle and track only one object at a time. 3- Display object detection animation in a static / specific / same spot of screen . Looking forward to see how you will iterate the design and optimize portability (Energy/ batteries + Compute Power ) = heat management :) good luck !
I appreciate it! I'm going to replacing the current per frame object detection with proper object tracking. This was just the simplest to implement. Thanks for the ideas!
the coolest Iron man helmet I have ever seen!!! Hoping for a metal build update. I work in AI and there are a lot of opensource ML models available that you can incorporate in this project. Custom voice assistant, face detection and marking an ID against each unique face (basic face match model) . stream all those face list to some cloud database. You can also capture a lot of useful data you see on a day to day basis, like vehicle number plates, color model (there are ML models for these), Faces, along with GPS coordinates, Audio samples from surrounding etc. and build huge data base and try to churn any juice out of the information ( Marketing , security, etc .). hahah or I am just overthinking 😂
Thank you! You're not overthinking it at all! I've had many of the same ideas and, in the coming months, you'll see some of them actually be incorporated.
That ui tech would be amazing for motor bike helmets to use . that way they can get all the info from the bike dash sent over local Wi-Fi/Bluetooth to their headset like their speed temps fuel amount and if any error show up as well as blinker alerts.
Thank you to everyone for watching and taking the time to leave such kind words about the project! I'll have some more information on the channel very soon!
To add vehical information you could possibly send the images to a database of cars and have it figure out what kind of car it is, it would be cool to have a version of ChatGPT and figure out a way to interact with the helmet controls in place of Jarvis, but great job thats looks so freaking cool
I wonder if this would be possible in all metal with a possible suit
I have an all metal helmet that I'll be working towards. 😉
All in the works! Thanks!
this is really cool
This is awesome!!!
Thank you for watching! It means a lot!
Something id expect from you guys. His build is dope being contained in the arc tho!
Glad to see you about James!! Keep up the fight! You’re a winner!! You’re your own hero!!
I bet you could do this Hacksmith
Hire him
A MAD MAN AT WORK. one of the coolest things I’ve seen 👏🏻
Thanks Emily! I really appreciate it!
You do realize that you basically just made your own VR headset, right?
Very awesome stuff. I had brain-built something like this, but wasn't able to put the time, money, or skill into it. You did a WAY better job than I could have, and not only am I impressed, but hugely thankful that you took this to stratospheric levels. I can't compliment you enough!
Thanks Jake! I really appreciate the feedback. Yeah, it turned into a real VR/AR project and come March, it's going to get crazier!
Time and money are the worst. 😂
well it would be AR
@@Sa0lgoodman Which is so much cooler and more useful. There's so much cool software that can be added here like he said.
Could you possibly put a small camera in the helmet to provide retina tracking so as to sync it up to the object detection? This should be an easy mod for you and it would add stability to the system in large open areas. Great video btw!!
Yes! It's on my very long to do list! Thanks for the suggestion. Glad you enjoyed it!
What is an example or use case, cool idea.
It’d take too much memory to build a database of any possible object that object detection could lock on to. Maybe instead could pair it up to google images and maybe a simple AI like alexa to display relevant info
Yeah you could also lower the opacity and size of the UI elements and maybe lower the resolution of them then blur it so you don’t notice, so that you can see more, but when you look at one it will get bigger and come to full opacity. As another comment said you could use an AI such as GPT-3 and display relevant info of an object using Google. You could also add interactivity to the UI e.g have it so you can look at something and blink twice to select it. This could also allow you to easily toggle object detection on and off when you do/don’t need it which could help with performance. Another thing that could help with performance is using foveated rendering to lower the quality of the screen if it is in your peripheral vision, where it is already blurry to you.
You mean iris detection????
Once in a while, youtube recommendations actually produce some gold. This is one of those times. Excellent build and I look forward to see further advancements and features to be incorporated into the design!
Thank you so much! I'm glad you found the channel and enjoyed the content!
This is great!
I always felt like the Iron Man suit (at least early versions) did eye tracking to see where Tony was looking. If you could get that implemented then you could be more specific over object detection and potentially use it as a control interface. In fact, a button in the suit glove and eye tracking should be plenty to control it without having to hold that keypad up to your face.
Thanks for the suggestion! It's on my list and I'll work on it in version 2 or 3.
I would imagine you also want your “Jeeves” to provide you with queues on what you’re not currently looking at. That’s more proactive than reactive. IMO, getting stable and reliable output from the object detector is more important. Just my cents (by the way, what happened to the cents symbol on my phone keyboard).
Thank you for sharing this project in all details!
Always! Thanks for dropping the comment!
The fact that you could fit all that inside the helmet is just crazy! That's so tight! And you even manage to not make the eye looks weird! This is next level
Thank you! It seems everyone has different opinions about the eyes. For some people they stand out and for others they don't. I think it matter a lot how close you are.
@@kerseyfabs As someone who's in the process of converting a premade display prop Halo Spartan helmet into essentially this, fitting it all in has been hours and hours of dremelling and 3D printing adapter mounts/plates for everything. Definitely gonna take some notes from your work and see if i can revisit my internal layout !
@@StormBurnX Awesome! Good luck with your build!
Jetson Nano-Half the power of the Nintendo Switch, in the palm of your hand!
Now, the Xavier NX, on the other hand, is kinda nuts.
Yeah, the Nano was great for experimenting but not enough memory for much else. The Xavier is a lot better and I can't wait to get my hands on an Odin!
Kris, I saw the time on this - over 30 minutes - at the end, I could not believe how fast it went, you did a fantastic job designing , building, programming and testing.
This is a project you are justifiably proud of and will be fun to follow as it continues to develop
Thank you David! That means a lot to me as a content creator! This was a labor of love.
@@kerseyfabs I know 2022 has been a difficult year for you hope 2023 is better, this should attract many new viewers!
i didnt even realize it was 30!
@@alexanderatg6588 I really appreciate that!
This is so freakin cool!!!!
Thanks Frank!
Chris you should be so proud of your accomplishments! Thank you for sharing your experience and proving this is possible. I'm so inspired to do this with my builds now!
Thank you so much! Keep reaching!
so, you want to have an update feature so it can change the simple "car" label later. so, it sends the "car" info to a remote server, and the info from that search is listed. could do the same for adding a label to people, to look up your friends list on Facebook or something :P
but, adding the rest of the armor, you will have more room for more computation, and cooling options. hell, having the hottest part on your back with fans blowing out vent ports as if you are trying to fly off, would be a fun gimmick for cons. taking advantage of ar glasses may be your next step. using the transparent displays will give you real time and batt independent view of the world around you, while also giving you the gui hud you want. along side the option of remote computations and search handling, you should be able to get even closer to true iron man hud tech, using those cameras for zoom options, along side the recordings for youtube.
If you used some micro cameras like a VR headset does, you could add hand tracking so you could do some sort of hologram 3d workspace within the helmet like Iron Man did. Might take a while to get down but just a thought anyway. It would also be really cool if you added some sort of eye tracking like the Apple headset, a code similar to the OpenCV Laser Point Tracking system, this way it would only identify objects that your looking at, saving the computer some effort and making it less crowded and more able to hold up the tracking part of the display instead of it cutting in and out. But, my addition ideas aside, this was really awesome, best video I have ever seen.
I’d LOVE to fly my paramotor while wearing that thing! (Or take you as a passenger)
Dude! That would be incredible! Would it be alright if I drop you an email?
Great job! For the lag :You can split the video with hardware right at the camera's output. From the split section you connect your video directly to the output mixer as background( hardware again). From the second split section you feed into your computer and retrieve only the interface. Project the interface on top by connecting to the output mixer. This will give you a live feed without lag. The only lag that can possibly exist, will be at the interface.
There's only a 20ms lag plus this allows me to record what I'm seeing without any additional hardware. Thanks for the ideas!
This is by far the most impressive iron man helmet I've ever seen. You definitely need more views
I appreciate the watch and comment! I'm trying to get the word out! 😀
That is so amazing and really shows how amazing and talented a real-life Tony Stark would be in figuring out how to fit all those electronics in such a small space and make it work wirelessly.
Thanks! Yeah, he did a lot in a very short amount of time. Having the resources of a multi-billionaire helped too though.
the fact that more people trying to approach utilitarian perspective where it "actually" works. and not just gimmick is what's going to advance human technology to next level. Keep up the work my sir!
Thank you! Making it work for real is the best part! Gimmicks are fun and all but seeing it do what it was meant to do real time is so cool!
I've got to say, that is absolutely amazing!
From having a concept/idea to making it a reality.
Keep wishing you the best in all your future endeavors and am glad I stuck with you since the beginning.
I look foward to your future content, always have and always will.
Laughed at the end when the kid said, ain't you suppose to be dead.
Thank you so much! I appreciate your support and I'm glad you enjoyed it!
A brilliant case for a motorcycle helmet when your hands are full. These helmets are the future. Great design.
Thank you! I've thought about making one. Should I work on it?
@@kerseyfabs Ouu yee. Thats a great idea. This is where a helmet like this comes in handy. Maybe a project a bit like from the Street Hawk series or the RoboCop 2019 movie (badass helmet design). I'm a motorcyclist and 3D designer (also deals with 3D printing), I've often thought of a similar idea. HUD display in the helmet, and switches under the thumb at the handle - unless voice control, as in some intercoms. It's better to have a GPS notification on the helmet display than to poke around in the phone while driving. GPS gauges, message notification and maybe even readings from the machine itself; there is certainly something to put in such an interface, but the truth is that it must be quite minimalistic. What if Jarvis found a detour and said "Sir. I found a shorter way?" Cool thing.
Outstanding. If this is made available I’m 100% putting this in my helmet
Awesome! I hope you do! I'm still working on the release.
Whoa! Amazing. A rear view camera and a speaker for vocal projection would be dope..
All in due time... Thanks!
2:40 lmao forgot about that part. There’s something so satisfying about watching 1) someone else work and 2) seeing an entire two years boiled down into a 30 minute video. Absolutely fantastic. I commend you on your efforts. I also realize, thanks to you, how much engineering you put into the (more than just a) helmet. I’m also amazed at the breadth of your skill level. Thanks for sharing this. I was particularly interested in how you developed the GUI, nice job J6. You guys killed it.
Thanks for all the feedback! I'm glad you enjoyed the video. It may have been harder to produce than the helmet. 😆 Cheers!
Not me watching this thinking... halo fans and iron man fans are in a race to make functional suits. This guy already has the HUD down, and Alex Labs has the arc reactor and repulsor tech down... For halo, Installation00 has the helmet working already. Now we just have to wait and see which side makes a complete suit first
Heh... hint: we're working together to a certain extent. I'm involved with the Installation00 team. One day there may be some integrations.
LET'S FUCCIN GOOOOOOO!!!! Just started planning a similar idea to this but more Cyberpunk inspired! You've done me an amazing service with this video sir.
Thank you so much! Can't wait to see what you make!
@@kerseyfabs I’m going to start with getting the basics up and running, but I’d like to add IR optics as well! I was super impress with your video showcasing the new nano so I’ll probably use the new NX to see what kind of hardware encoding it can do. While im not *super* concerned about recording, it would be awesome to just have that extra headroom
Congratulations on the success of this build, I'm absolutely blown away by how awesome the helmet and the amount of tech you were able to squeeze into such a small space. I want one so much to add to my collection even it means more ear ache from the wife it would be so worth it big love from Ireland can't wait to see how your creation evolves
Thanks a ton!
You did it, you did it!
In theory with the field of vision you now have you should be able to walk around with the helmet without problems, the only additions you could make are microphones on the sides to hear well since the helmet encapsulates your head and cutting the sounds, then if you want you could insert a microphone and a speaker to make your voice heard and add effects if you want.
I too have the dream of realizing this project, to save space horizontally in the helmet, I had thought of positioning the screens at the bottom of the mask pointing upwards with the lens above, then positioning two mirrors in front of the eyes at an angle of 45 ° so that they reflect the images of the screens, if desired the mirrors could be rotated so that when the system is off you can still see through the slots on the mask.
As for additional information, you could insert a function that tracks where you are looking and then provides you with the data and information without filling your field of view too much
Think with the technology of next generation viewers how compact all this can be, the only difficulty will be hiding the cameras.
Sorry for taking so long to reply Drew but you had a very thoughtful comment and I wanted to reply to your thoughts!
The microphones and speakers were ideas I've had and I may implement them relatively soon.
The mirror idea is interesting but I'm not 100% sure how it could save space. I'll do some research/thinking on it.
Eye tracking is on my wish list but it requires additional cameras.
Hiding the cameras is a work in progress.
Thanks again for the feedback!
YES YES YES SOMEONE FINALLY DID IT!!!!! AWSOME WORK DUDE!
Dude! I appreciate it!
This is insanely amazing! Looking forward to the technical details of this incredible journey!
Thanks Tony! Coming soon!
Ive been wanting to do a gundam cosplay with a HUD system just like this. The fact that you will make this available for others to use actually motivates me to actually plan out doing this now rather than what my original plans were gonna be.
Yes please, ask him to do a collab
I'm working on some of the details and new hardware now!
@@kerseyfabs thats exciting! will there be some sort of update video showing off any changes?
@@knightdaiguren3208 Absolutely! More videos coming soon!
Sir you are a true Engineering hero an inspiration to many and a hardworking genuis. This is perfect ❤❤
Thank you so much!
Random idea, have fake 3d graphics like doom uses, but instead of the vertical axis, be the horizontal one, ie: the one inline the direction you are facing. Headache is too much to think it out more. Also perhaps if put a lcd ontop another lcd you can have the bottom show the environment and the top show any computer stuff to avoid lag, makers muse did a dual lcd layer for different reasons but it is a good demo of what it is.
This would be a pile of fun tied into an FPV system for a drone.
Yeah! I've thought of a couple of cool remote viewing ideas like that.
That’s a masterpiece! I really enjoyed watching the entire process from the idea to the implementation! Keep it up!!
Thanks! It was really a lot of fun to put it together. A very different process than my usual video.
This is absolutely amazing! I never thought that something like this is even possible. Great job!!
Thank you for that! Cheers!
Brooo, this is dope! … I can’t wait to see the whole suite assembled 😎👍✨
Thank you! Helmet upgrade video coming very soon! With AI!
@@kerseyfabs Man I am sooo there! 💯👈🤩
"I thought you were dead!" 🤣🤣🤣
Thanks for sharing the behind the scenes on your awesome build.
Absolutely! Glad you enjoyed it!
YESS this is what I always wanted to see. I've been looking for something like this for 4 months now!! RRespect cant wait to see the updates & Upgrades
Thanks for watching! I really appreciate it!
Wow, despite the external help you are the truly Tony Stark in real life.
Thank you so much!
This absolutely rocks. You should put the screen that shows what you are seeing on your back so when you are walking about people behind you can see that you’ve done an absolutely awesome job.
I think it being on my back would take away from the cosplay a bit but I do have the one we can carry around.
It is absolutely phenomenal. The only thing is the helmet sticks out from your face a little bit but that doesn’t detract from how amazing this is. Do you plan to make a full suit with this thing?
Thanks and you're right on both counts. Yes, I'm currently working on the full suit with a lot of upgrades.
@@kerseyfabs that is awesome dude and I can’t wait to see it
You have completely inspired me good Sir! This is absolutely amazing, I always had a sneaking suspicion that this technology was possible.
Thank you for paving the way.
Thank you for the kind words! All of the source is now available! oasisproject.net/
bro deserves so much more!
I appreciate that! New build in the works!
@@kerseyfabs cannot wait!
"Hey Ironman I thought you were dead?"
Too soon. 😭😭😭😭
I live! 😆😎
There's something about Tony Stark having a fanny pack that feels right.
next tony stark
This gives me fuel my friend!
As many super hero (Iron Man/Spider man) video projects I have seen, this one is by far the best and most interesting one I have watched to this day. I have no clue how to build such things so watching someone else do it brings me much happiness. Good job. I will be watching.
Wow, thank you! I'm glad you enjoyed it!
"IRONMAN...! I thought you were dead..." 😂😂😂 I scared my upstairs, elderly neighbor cause that caused me to break out in a loud, barking laughter - he thought a vicious dog had got in my house. LOL! Your work with that tech is just astonishing! I'm working on a Mandalorian helmet (just Mandalorian in general - not THEE Mandalorian) and this video has me wondering how I could incorporate a HUD like yours into my own bucket. Thank you for the video! Subbed!
You are Really a genius, please write to this management what parts you put there and how you created the program and so on
This is CRAZY awesome! Great job!
Thank you! Cheers!
I can’t wait for you to release this so we can see what the community does with it! You are just one person that has come this far imagine what a whole community can do with your work as the base.
ua-cam.com/users/shortsiqjbmHYmVuo?feature=share
Thanks! I hope I get a lot of contributions to make it awesome!
Ngl, I've had that idea for years ever since I got my first VR but I never actually did anything so seeing how similar your project was to what I envisioned makes me proud in a "I wasn't too far off" way
That's awesome! Thanks for watching!
I think adding an infrared camera to the device could help it differentiate some of the objects and people. But project is very good
I actually have an infrared module I've written code for but that's a future video! Thanks for commenting!
I can definitely see this taking off. Like this could be militarized. With the a huge amount of funding and a awesome team behind this. This could be the start of a real life hero.
While I'm not all into the militarization, I'm definitely going to be developing this further!
I think this is the best thing I've ever seen on UA-cam you're a fricking legend dude, I would love to see someone with the reactors attached to their hands, the full armor and your helmet this would be insane
The repulsors for the hands are coming! Maybe not fully functional but I'm proud of how they look!
This is the best project I have seen❤❤Hates off to you sir. And one more thing can you make for Spidey
Thank you! Maybe a Spidey HUD in the future!
I coined you your genius, when you noted putting everything in a PDF for others. That’s what I call a worthy channel to watch & progressive planning. Due to the fact that even if it was just for yourself you wouldn’t have to waste time revisiting your writing to code once again. I actually have been thinking of doing something similar myself although I love originality so I’d have to conceive a mask worthy to bring in reality. I’ll have to take you up on your programming never has it been my strong suit. Men like you are few Continue, Continuing on your legacy champ
I really appreciate all of that. I'm glad I can share all of this and that there are people interested in the details of the project. I'm still working on some details behind the scenes before I release the code but it's coming.
This is so cool, I’ve always wondered if it was possible to fit all that in a helmet. The kid’s “I thought you were dead” made me burst out laughing!
Yeah, hanging out and getting random reactions is a lot of fun!
Man deserves fame
Thank you again! 😀
This by far is the coolest helmet yet. Just add J.A.R.V.I.S. and voice control and Hacksmith Industries should be soooo jealous!!!!
Thank! I have both now! Video coming as soon as possible.
This is truly awesome. I'd love to see computer technology progress to where this is more miniaturized and into a set of goggles for surgeons & nursing staff to wear. The surgeon could be looking at a patient in the OR/ER, visualize the damaged area, and receive guidance from another physician + have patient stats pulled up. It'd be awesome to couple the software with unique RFID signatures for tools; this would be great for an Astronauts HUD to see what tools are where vs. having to hunt for them if there's an issue.
I love your ideas! It's one of the reasons I'll be open sourcing the project. I'd like for it to be used in other ways. I've already been contacted by others that are interested in expanding it.
That´s how it starts. Just as a lot of tech we have today were inspired by Star Trek, imagine 40 years from now. An you are already there. I hope I live this long to see it.
Yep! Looking to SciFi is a great source of inspiration!
me from 2 years ago would be fainting from excitement. I was at the height of my Iron man phase. Now, I my interest in Iron man is resurfacing. I've always thought a helmet with a HUD would be the coolest thing, and it's so cool to see you just completely going for it, and making it as close as possible to the movies
Thank you! I never lost sight of the dream. I really wanted to take what Hacksmith did to the next level. It just took some time. There's more to do still!
@@kerseyfabs I love that a lot of the things from the movies are possible in real life, as long as you have the right components
I LOVE this. Awesome stuff, Kris!
Soon everything will be upgraded and seamless, like the display being one screen vs two and higher memory running to help prevent crashes. This would be really fun to keep an eye on and see what you do for upgrades.
Maybe a 9DOF on your left wrist that has an input system overlayed to the HUD as a GUI that moves with your wrist. Then cameras detect your right hand as the input peripheral.
Seriously incredible build. Thank You for sharing the journey! Can't wait for more...
I love the idea. With the repulsor video I just put out, it ties in perfectly. There are some even newer sensors too with amazing sensor and gesturing ability.
@@kerseyfabs I watched the repulsor one last night after this one and thought it might tie in nicely with that!
This is so cool AF, tony would be proud!
Thank you so much! 👊
Great job Kris this is awesome!!!
Thank you Oz! 😀
This is freaking sick dude. Please keep making awesome maker videos like this, holy cow Batman…
More to come! Thanks!
Great work!!
Thank you!
26:30 When you want the HUD like Iron Man, but you see the tall, daunting task of making it. Wow. You have more patience than me! I love tech, but I'm more of an artistic type of guy. I hope one day these components can be more compact.
27:15 You're local?! Wow!
29:30 I heard that record player scratch sound fx and thought, " Hey at least that kid saw "Endgame"."
Whelp, time to get back to work! Great video.
Thanks for watching!
This is so cool! As a fellow SWE I would love to see more of the software side, all of it! Especially the gstreamer and Ui elements! Such an inspiration, thanks!
Good to hear from you Tim(othy)! I'm working on a complete open source release and I get closer all the time. Keep an eye out on this channel for more information.
You have certainly done a lot of heavy lifting on the way to a real useful AR . I love that you focused on the practical application of existing and emerging technology. I have had an idea for some time now that would run parallel to your project . If I can make some headway, I would love to share it with you.
Meanwhile, thanks for shooting this and taking all the time to get it out to us. I know it is not as easy as breathing. In fact there is a ton of work that clearly went in to all of this. I am impressed.
Thanks! It's been a fantastic project and I've been very pleased with the response.
Kris,
This is truly amazing!
I’m very impressed!
Thank you! I'm glad you enjoyed it!
Kudos, watching this totally got me pumped!
Thanks for the inspiration.
I'm happy I could do it!
Hands down, this is the coolest project I've seen in my life
You made my morning! Thanks for that! Cheers!
This is exactly what I want to do. But I also want to add an internal and external set of mics and speakers so that I can both talk to Jarvis to automate parts of the suit, but also to communicate better with people outside of the suit. And possibly modulate vocal pitch down just slightly, which they definitely did with RDJ on the first couple Iron Man movies. And hopefully have it all work with a faceplate that moves. Not sure if I can pull that all off, but that’s my goal.
Check it out! Here's the status of my AI assistant!
ua-cam.com/video/vR6_FkFsi3Y/v-deo.htmlsi=0vzzh7nzCljoz_yc
AND
ua-cam.com/video/0bnFI3myK7Y/v-deo.htmlsi=jqNW8-v7KKqJ9782
Man it's like seriously marvellous move ... People can't even easily fit something in that shape but you did and made world's first real iron man helmet
Thank you so much! Cheers!
Great job... and great project. But def NOT the first/only Iron Man HUD project as stated. Hacksmith posted (and they did a variant as well).. still a great job. (just not the first).
Mine is the first fully-functional Iron Man HUD. The Hacksmith's first video 3 years ago was a camera with no HUD. Their updated helmet was Halo based and added some HUD elements but not all of the motion or GPS components. JLaservideo also did a camera in a helmet with some apps built into the display. No shade at all to those that came before me. I've watched them all.
@@kerseyfabs I guess if adding more features (like the OpenCV/GPS stuff) lets you claim being the first.. ok. :) I know mine has a live camera, animated/overlays.. and also real-time bi-directional data from (wireless) external circuits. (such as the Arc Reactor [Uni-Beam] & repulsors) so anytime those are used, you will see real-time updates/feedback in the HUD display. (Also fully functional database to save/log (whatever).. no GPS added into mine. So I guess you are still 'first'. Either way still a nice project!
@@xl97 Well, it's the internet and all claims are made in regards to what has been shared and what I knew about at the time. If you've made any videos or posted about any of your work, I'm sorry but I haven't seen it. All the best and thanks!
Dude you may not be the first to make a HUD for an iron man helmet by holy hell did you knock it outta the park! Cant wait to see more!
Thank you! I really appreciate it!
you know what would be amazing is if you could somehow fit some thermal cameras in there so you could get thermal optic visuals in 3D augmented reality. Or maybe some powerful infrared LED lights and cameras that have night vision capabilities. And maybe even a zoom function would give it more of a feeling of having useful utility. But definitely add a fan in there for cooling your face, because it could really make a big difference in comfort, and could even reduce the moisture level in the helmet which can't be good for those components.
You are iron man to many. Amazing work😮
Thank you so much 😀
It's already possible using the AR tech available on Amazon. Hologram tech was simply used in the movie so audiences could see it, when tbh, the more accurate & tech involved version would be basic AR style with eye tracking. Much more compacted, but far more immersive.
I get what you're talking about. I've seen what's available off the shelf. The biggest problem with transparent tech is that visibility is incredibly bad in the helmet. If you have full lighted eyes, that hinders your vision. Plus, the eye holes are very small and offer very little peripheral vision in any direction. You can see in Iron Man 1 that when the helmet goes dark, his visibility isn't the same. Second, I don't know any of the off the shelf products that have an open API that would allow you to code your own UI or applications.
This just game me soo many ideas!! Thank you so much for this. I never got to the point of putting cameras in my suit/helmet. I get that same comment all the time from kids though when I'm in my suit "Hey, I thought you were dead". At least now I just say that wans't me, that was another universe's Tony Stark. I'm still here.
Awesome! Be careful with the cameras though, now the aesthetic gets picked on. 😆
@@kerseyfabs So true, everyone is a critic these days. I'm thinking of building a large cosplay suit, Groot, or maybe a Jurrasic World dinosaur, where I think the cameras would come in perfectly.
@@JasonLabbe-h5e That sounds awesome! I will continue to refine mine to make them less visible.
I am gobsmacked. This is exactly what I’ve wanted to build since the first Ironman film. You have done amazing work. I have a couple of ideas which I would be happy to share with you, if you are interested. I know no one else has done them and I think you would have the skills to do them
Thanks! If you have ideas, please feel free to share them here or send me a message on any social media platform.
Wow! It's absolutely incredible. I'm looking forward to v2. Perhaps some curved screens to reduce/eliminate the lenses and space needed. Also, what about some airflow channels to reduce heat inside the helmet? Nothing crazy like an A/C unit. Just a small fan (an inch or two dia.) to push air through.
Another thought...what about using a similar system that cars use to see around the vehicle, to increase field of vision? Like the 'Fish Eye' cameras on the side mirrors that then use software to unbend the image for display?
Thanks Allen! I have a curved display on the way as a potential upgrade. I don't think it will eliminate the need for lenses though as our eyes are not great at a few centimeters from the display. So far I haven't needed fans in the helmet but, as we get back into warmer weather, I'll consider it.
Right now people are already complaining about the cameras, so I don't think I'll add extra ones yet but I do love the idea of doing the warped wrap around. My vehicle has that and it's very cool!
@@kerseyfabs I didn't mean to sound as if to say to add more cameras, just to replace them with ones that have the wider FOV.
@@Raniko2020 Ahh! Maybe eventually. To do that properly I'd have to add a lot of distortion compensation. More processing!
I'm looking at venturing into making Destiny cosplay, so this tech would be phenomenal in those completely closed face helmets with no lenses. Though, I would most likely not need any heads up stuff. Just the ability to see. But still! This is amazing man!
That would be cool! Thanks!
this project is gonna be INSANE! been wanting to see something like this for ages. thanks for taking the first steps!
You bet! Thanks for following along!
Wow, really impressing. Fantastic work.
🙏 Thank you!
Nice work , I like it !
idea that I would like to share as object detection is messy in real word / outside, you should :
1- Display only one object.
2- Display the object that appears in a specific spot / angle and track only one object at a time.
3- Display object detection animation in a static / specific / same spot of screen .
Looking forward to see how you will iterate the design and optimize portability (Energy/ batteries + Compute Power ) = heat management :) good luck !
I appreciate it! I'm going to replacing the current per frame object detection with proper object tracking. This was just the simplest to implement. Thanks for the ideas!
One of the most impressive videos iv ever watched in years.
Much appreciated! Thank you Danny!
This is such a crazy cool project!
I can't wait to see the future of Iron Man suits.
Thanks! Keep watching!
the coolest Iron man helmet I have ever seen!!! Hoping for a metal build update. I work in AI and there are a lot of opensource ML models available that you can incorporate in this project. Custom voice assistant, face detection and marking an ID against each unique face (basic face match model) . stream all those face list to some cloud database. You can also capture a lot of useful data you see on a day to day basis, like vehicle number plates, color model (there are ML models for these), Faces, along with GPS coordinates, Audio samples from surrounding etc. and build huge data base and try to churn any juice out of the information ( Marketing , security, etc .). hahah or I am just overthinking 😂
Thank you! You're not overthinking it at all! I've had many of the same ideas and, in the coming months, you'll see some of them actually be incorporated.
That ui tech would be amazing for motor bike helmets to use . that way they can get all the info from the bike dash sent over local Wi-Fi/Bluetooth to their headset like their speed temps fuel amount and if any error show up as well as blinker alerts.
Yeah! I've though a lot about using the UI in cars or motorcycle helmets.
This is the coolest project I have ever seen! Definitely gonna try make that HUD one day!
Thanks! I can't wait for others to start to recreate this! My source code is coming soon!
Such an AWESOME job!! Loved how you put this together!!
Thank you! Cheers!
Two years hard work!!?? Mad respect for your dedication and hard work! It looks awesome! Keep going!
Thank you! Will do!
That is some awesome engineering in both hardware and software
Thank you!