If I want to build contribute by building the DIY pair based on this design, & contribute by building an app for it, what should I use out of these options? -Unity (C#) -React (JavaScript) -Andriod Studio (Java/Kotlin) I’ll use Python for backend stuff
Really can't wait to see where this project goes in the future. With 3d printers being commercially available, these types of open source projects will be the frontline to the future for a lot of people. What seemed like sci fi just a few years ago will soon be in the hands of the people. You guys are leading the way into the future, and it's amazingly cool to see it happen. Keep up the good work, you're heroes to the community. (What community? All of them. Civilization)
Finally got around to wathcing this video, Cayden the open source smart glasses have come a long way with you continuing to be a frontier innovator within the smart glasses space. You do a brilliant job combining your technical projects with parts of your day to day living and I love the $50.00 comment. Can't wait to see more updates on the open source smart glasses and WIS and of course, great seeing you and Alex at CES.
As a deaf person I look forward to subtitling glasses, so I can LOOK at people when they are talking and SEE what they say. Even so I am still not ready to whack out $400 for something which may have a limited life. K Paterson MBE (UK)
I love this project, its exactly what i have been curious about manufacturing for myself. My prototype was just a video display setup using DLP and mirrors to produce viewable video superimposed, and just view my computer/ phone/ whatever else through the glasses, but this seems revolutionary in its own right. Very impressive work!
Awesome work!!, may I know what kind of hardware display did you use? I was planning to integrate display in the microscopes used for micro soldering,,
If I want to build contribute by building the DIY pair based on this design, & contribute by building an app for it, what should I use out of these options? -Unity (C#) -React (JavaScript) -Andriod Studio (Java/Kotlin) I’ll use Python for backend stuff
Fascinating! I have been (and still am!) working on my own pair of AR technologies; I can't so much call them glasses, as I believe there can be more efficient designs. This video is such an inspiration, and will definitely help me moving forward! If you don't mind, is there any way I can contact you?
Do you think it is possible to design the glasses as a simple attachment to any pair of glasses and put all the hardware wired into a box you can put in your pocket?
Prism aren't the solution, but neither are bird baths. Bird baths are heavy, bulky, and obstruct the eyes. Waveguides or another technology will prevail - something lightweight that doesn't obstruct the eyes.
@@caydengineer True, north's focal has come a long way on that front, but I was talking about a baseline standard. We're a few years away from seeing something like focal at the 2-300 dollar price point.
Hey bro love the content and subscribed! Question, do you think picking up the nreal airs would be the best off the shelf for gaming and productivity? Or should I wait for the next generation of wearables?
Gaming, probably yes! Productivity, maybe. When you're travelling in a cramped space it could be a good monitor. You likely won't ever use this as a monitor if you have a real one on hand.
Maybe at some point AR glasses plus an AI assistant could function as an optician to adjust the screen appropriately to your eyes. This would save a lot of hassle and money.
Perhaps for a test procedure, but it doesn't seem economically viable for every prescription lens glasses to be electronic and programmatic prescription. I imagine we'll see this with automated eye tests long before everyone wears glasses that change to their eyes.
AFAIK actual auto-adjust prescription glasses exist in research and medical, but there's not market pushing them forward as they cost 100x a regular pair of glasses, and prescriptions change slowly, so what's the point?
Is there a Way to build these myself, if so what is the Investment/skills required? I have some soldering skills, 3D printing skills, and perseverance. I also have absolutely no coding skill.
Important work, looking forward to seeing someone add a camera, ideally one with a high FOV. It really aggravates me that it's the norm for smart glasses to have low FOV cameras.
Thanks. High FOV is harder because it requires higher red, which is higher bandwidth, and AFAIK requires a fisheye style lens which sticks out from the glasses, which looks weird. I do agreed that higher FOV cameras on smart glasses are better! I'd rather lower PPD and more content to understand the context.
@@caydengineer higher red? The lens doesnt need to stick out much at all, look at any modern phone, they got very nice fov on the widest lens. My S10 in portrait mode can capture a document on the table in front of me more or less.
Possible to do if you upgraded to have multiple microphones, which is needed for localization. Would want to expiement with various modalities of HCI for this use case. Visual might be work but I imagine spatial haptic would be better.
@@caydengineer Is ~95% of the cost the Sony 336C OLED display? I don't see any other really expensive parts. Can't find a BOM on the project github or discord.
Man I'd be a amazing if the UA-cam algorithm recommended this to lots of William Osman, The Backyard Scientist, Nile Red, Allen Pan, Michael Reeves, Safety Third, Tom Scott, Vsauce or Mark Rober fans like me that may be fairly entertained/interested by watching this video That'd be crazy, huh
You laughed at my word there ( classes), I have noticed it after 1 year, but i have noticed too you still need more.... how can we reach to the second level?! 👍
). This Option Will Potentially Create A Paradigm Shift In Industry Practices,Directing A Flow Of Consciousness And Resources Into A Safer,More Transparent And User-Friendly Electronic Market. Overall, The Suggestion Of A Transparent Phone Will Take A Collaborative Effort From Engineers,Designers,Marketers And End Users.The Potential Benefits Are Endless,But It Is Up To Us To Make It A Reality. CBAI
I have a mobile android/ios app for education. This app have a backend using php which have some info related to students. Can can you recommend smart glasses in order to scan student face than connect to backend to fetch info for that student from database without using the acute app in mobile to navigate through multiple pages to display that student info...?!
Hey man! Big fan of your work, I just had a doubt, are your open source glasses from 6 months ago HUD one? I randomly came across your work few days ago and I'm new to it, so don't mind me and can you tell how they work Sorry for the inconvenience Keep rocking!!
Thanks! Checkout the first 90 seconds of this video for some details on that. The previous video was audio glasses with no HUD. This video we added the HUD. Cheers!
@@caydengineer Hey man! Are you planning to use waveguide optics or MOMS in the future? And also if you don't mind can you make a video on different technologies used in smartglasses Great work man! All the best!
Quite a bit, but briefly: The OpenSourceSmartGlasses are open source, moncular, and wireless, designed to be worn around in daily life. Nreal Light and Air are tethered, stereoscopic, with better optics for screen viewing but not designed for all day use.
hello caydengineer im 16 currently and i want to make these smart glasses how do i start also im very new to this so its my humble request if you could help me out i want to complete the project in 1month and 15 days from now on. please help...
It's something to highly consider, but it's mostly the same problem as smart phones. The novel issue here is the potential to collect even more invasive and continuous personal sensory data. There's a lot of angles to discuss this from, but from a pragmatic, market-driven angle - these things are coming either way, so let's solve/mitigate the issue. We're doing so, partially, by creating open source tools (namely the smart glasses manager) that provides a layer of user autonomy over their data and, importantly, their sensory experience/reality.
@@caydengineer we need personal intranets that we can build and keep at our house physically separated from the internet. That way we can compile our data for our own possible uses.
@@caydengineer they are all rubbish though. Last thing you want inside a motorcycle helmet is a solid piece of matter which may be mashed into your face/eye on a bad day. The projector needs to be embedded into the foam shell besides the eye/cheek and be projected directly onto the inner surface of the visor. Also, very specific functionality and operational characteristics are necessary for it to be widely adopted by riders. HUD for speed, adjustable bike settings, warning indicators, P2P coms only and a range of simple, effective and immediately accessible control interface for things like position/translucency/brightness/selected info etc. Some people may wish to have integration with Google maps, phone call/message, music, etc but these are all hit and miss and unless the fundamentals are done perfectly it's all a waste of time and effort anyway. Other features a smart helmet could/should have is built in, high powered LED lighting for seeing through corners when riding in darkness (could have auto dimming and/or power off when encountering oncoming vehicles. The battery pack / power would most likely have be remotely mounted but it's not out of the scope of possibilities and if a tether was incorporated, an additional line could be included for water / visor ventilation....) Once the key things are done properly and no encroachment on the desirable elements of riding are imposed on the rider as a trade off, smart helmets will take off. Just don't try do too much, less is more and any unnecessary complexity/inconvenience will detract 1000x more than the desired /elements/benefits will add to the desirability factor.
got here after seeing the vest arrangement of reactions to Xreal an such hehe but the issue is there nearly enough assistance in building because I have jack shit to work with reeeee
Hey, I'm currently applying for Thiel Fellowship and want to start a project regarding smart glasses. But I'm currently doesn't have any team or people to work with. If I got the fellowship would you join my team?? I would love to work with you..
Come on...don't make it into another highly specialized business type do nothing device. Where is gps? youtube videplayback, or at least wireless mirrorlink. we want multipurpose, easy to use, especially with standard android applications glasses that won't scare people on the streets.
Features i want is word search function. Glance around a supermarket and the item your looking for is highlighted. Basic Heads up display : heart beat graph, body temp, blood pressure, O2 lvl, time, humidity? Maybe a mini map/gps map or instead a 3d display of that path you’ve taken. So you can see where you maybe wasted time or steps. Would also help for back tracking when losing things. As you would know your path and head orientation could help you to stop from looking in the same spots. Obviously it needs to have auto dim and be able to display web pages. If i could go further id pack a ir camera and a ir LED in there for night vision. We could source very tiny high def cameras from drones. It would be pretty basic night vision but it should be better then nothing. If thats not possible just put a led in there with a focusing cone so you can read with it.
This has been loads of fun to work on. Thank you to all the other OSSG developers, and stay tuned everyone for more info on the SmartGlassesManager!
Great work man! It wouldn't have happened without your contributions.
If I want to build contribute by building the DIY pair based on this design, & contribute by building an app for it, what should I use out of these options?
-Unity (C#)
-React (JavaScript)
-Andriod Studio (Java/Kotlin)
I’ll use Python for backend stuff
Can't wait for the beta units for folks to try out!
Awesome stuff, thanks for documenting it! Looking forward to the beta units
Thanks Greg!
Really can't wait to see where this project goes in the future. With 3d printers being commercially available, these types of open source projects will be the frontline to the future for a lot of people. What seemed like sci fi just a few years ago will soon be in the hands of the people. You guys are leading the way into the future, and it's amazingly cool to see it happen. Keep up the good work, you're heroes to the community. (What community? All of them. Civilization)
Thank you very much!
Finally got around to wathcing this video, Cayden the open source smart glasses have come a long way with you continuing to be a frontier innovator within the smart glasses space. You do a brilliant job combining your technical projects with parts of your day to day living and I love the $50.00 comment. Can't wait to see more updates on the open source smart glasses and WIS and of course, great seeing you and Alex at CES.
Thanks Tom, great to meet you IRL at CES. Looking forward to the next IRL event.
Exciting developments! Can't wait to see your next steps.
As a deaf person I look forward to subtitling glasses, so I can LOOK at people when they are talking and SEE what they say. Even so I am still not ready to whack out $400 for something which may have a limited life. K Paterson MBE (UK)
Yep, great use case. See Xander, XRAI, and TranscribeGlass.
I love this project, its exactly what i have been curious about manufacturing for myself. My prototype was just a video display setup using DLP and mirrors to produce viewable video superimposed, and just view my computer/ phone/ whatever else through the glasses, but this seems revolutionary in its own right. Very impressive work!
Wow guys congratulations! and wow that must have been some journey!
Thanks Erik, it was an adventure!
Awesome work!!, may I know what kind of hardware display did you use? I was planning to integrate display in the microscopes used for micro soldering,,
All info in the GitHub
This is dope man!!! You’re an inspiration bro, keep it up!
This feels like it should have been longer than a 9 minute video
Thanks! First edit was 30 minutes, lol. Had to cut a lot.
If I want to build contribute by building the DIY pair based on this design, & contribute by building an app for it, what should I use out of these options?
-Unity (C#)
-React (JavaScript)
-Andriod Studio (Java/Kotlin)
I’ll use Python for backend stuff
Android Studio - build with AugmentOS
This is a godsend! As someone with ADHD my thoughts can be gone in minuets something like this could be a great solution!
Cool, how do you envision using it/how would it work to help your ADHD?
Another awesome video, love it!
Thanks!
I need a pair of these I got a cool idea I haven't seen before and Is very much needed.
What do you want to make?
Interesting
Do you know a smart glasses that shows and view pdf files, for reading?
Thanks for helping in advance
Hi , I ll try esigh4 low vision smart glasses in France 5 April, Tks your approach. Tks
Let me know your thoughts on the experience using the esight 4!
@@caydengineer I ll, hope it works, in myself, and give me again autonomy… the only problem, here, is is 10000€, the device
I ll send you a message
Fascinating! I have been (and still am!) working on my own pair of AR technologies; I can't so much call them glasses, as I believe there can be more efficient designs. This video is such an inspiration, and will definitely help me moving forward! If you don't mind, is there any way I can contact you?
Cool! Feel free to share your project! Yes, contact me on Discord, see description or teamopensmartglasses.com
Oh yeah!! 🔥🔥🔥
Do you think it is possible to design the glasses as a simple attachment to any pair of glasses and put all the hardware wired into a box you can put in your pocket?
Yes, but this ussually results in a very uneven and uncomfortable and odd looking experience. Full integration is the better solution in my opinion.
@@caydengineer Your design seems to have lenses in them; do you support prescription lenses? How do expect that process to work?
Answered my own question; looks like the frames are very similar *cough cough* to a pair from Zenni. Good choice, whoever made that call.
@@davidskidmore3442 you are right!
This is really cool, but I think the xreal approach has become the new standard in glasses display tech.
Prism aren't the solution, but neither are bird baths. Bird baths are heavy, bulky, and obstruct the eyes. Waveguides or another technology will prevail - something lightweight that doesn't obstruct the eyes.
@@caydengineer True, north's focal has come a long way on that front, but I was talking about a baseline standard. We're a few years away from seeing something like focal at the 2-300 dollar price point.
Do you have a full bill of materials available somewhere? Great vid, cheers!
Thank you! Everything is on the Github linked in the description.
This is cool and all, but how about combining it with some of the LiDAR inside a motorcycle helmet for collision avoidance and HUD while riding?!?
freaking awesome.
Bro the couch staircase got me weak lmfao 😂
Haha best part.
Neat, but you have to get smaller batteries with similar capacity and get them at or under 100 grams.
Haha, please link said batteries.
Hey bro love the content and subscribed! Question, do you think picking up the nreal airs would be the best off the shelf for gaming and productivity? Or should I wait for the next generation of wearables?
Gaming, probably yes! Productivity, maybe. When you're travelling in a cramped space it could be a good monitor. You likely won't ever use this as a monitor if you have a real one on hand.
That's so cool, maybe I won't have to sell my kidney to afford a smart glass!
Best of lucks!!! you do deserve it!!
🍀🍀🍀🍀🍀🍀🍀🍀🍀
Cheers and thanks a lot!
Maybe at some point AR glasses plus an AI assistant could function as an optician to adjust the screen appropriately to your eyes. This would save a lot of hassle and money.
Perhaps for a test procedure, but it doesn't seem economically viable for every prescription lens glasses to be electronic and programmatic prescription. I imagine we'll see this with automated eye tests long before everyone wears glasses that change to their eyes.
Hi, could you do a Tutorial on how to install your software on open source glasses?
It's all on the GitHub and GitHub wiki linked in the description.
I wonder any commercial MR/XR glasses that are open source to program? in js preferable
You can do so with the SmartGlassesManager on most major consumer smart glasses (Vuzix, Inmo, Activelook, etc). Not in JS, but in Java (Android).
What a journey! Excited to see what's next
is there any where I can buy only the glass and create my own frames and also has an SDK so I can develop apps?
Wow you are genius
That's what my mom always says.
Are these available for purchase yet?
No, you would have to build your own or have someone build you a pair.
Where can you order? And how much does it cost?
You can't order/buy it.
Are there any smart glasses with prescription auto adjusted to the eye. ?
Many of these glasses offer the opportunity to integrate a prescription lens insert.
AFAIK actual auto-adjust prescription glasses exist in research and medical, but there's not market pushing them forward as they cost 100x a regular pair of glasses, and prescriptions change slowly, so what's the point?
@@caydengineer i see.
Is there a Way to build these myself, if so what is the Investment/skills required? I have some soldering skills, 3D printing skills, and perseverance. I also have absolutely no coding skill.
All info is on the GitHub and GitHub wiki, linked in description. Resourcefulness is as important as perseverance.
@@caydengineerThanks, is there a build guide available anywhere?
@@crashtestrc7213 I just told you where it is. You are not resourceful enough to successfully build smart glasses.
@@caydengineerOk, I'll stick to airplanes.
will you consider the immersive android os that is coming?
it is open source and its better then reinventing the wheel
Can you link to it? I doubt it though, Android is too power hungry. The first consumer smart glasses will use MCUs.
where we can found all stuff needed to build our own glasses ?
See the GitHub
Important work, looking forward to seeing someone add a camera, ideally one with a high FOV.
It really aggravates me that it's the norm for smart glasses to have low FOV cameras.
Thanks.
High FOV is harder because it requires higher red, which is higher bandwidth, and AFAIK requires a fisheye style lens which sticks out from the glasses, which looks weird.
I do agreed that higher FOV cameras on smart glasses are better! I'd rather lower PPD and more content to understand the context.
@@caydengineer higher red?
The lens doesnt need to stick out much at all, look at any modern phone, they got very nice fov on the widest lens.
My S10 in portrait mode can capture a document on the table in front of me more or less.
What about something like sound direction indicator. Like in video games could be useful for deaf people as a visual aid.
Possible to do if you upgraded to have multiple microphones, which is needed for localization. Would want to expiement with various modalities of HCI for this use case. Visual might be work but I imagine spatial haptic would be better.
This is AWSOME!!! Hats off to you. How much $$$ do you think it would take to make this myself?
~$500 if you made only 1 and already had all the tools.
😳im a broke kid lol. can u make a vid for a low cost smart glasses?
@@caydengineer Is ~95% of the cost the Sony 336C OLED display? I don't see any other really expensive parts. Can't find a BOM on the project github or discord.
Man I'd be a amazing if the UA-cam algorithm recommended this to lots of William Osman, The Backyard Scientist, Nile Red, Allen Pan, Michael Reeves, Safety Third, Tom Scott, Vsauce or Mark Rober fans like me that may be fairly entertained/interested by watching this video
That'd be crazy, huh
One day! ;)
This is exactly what I was looking for! how can I get one! You're aswome!
Thank you! They aren't for sale. You can build your own, or buy a COTS smart glasses, like Vuzix Blade 2 or Activelook Engo 2.
@@caydengineer Thanks again, love your work!
Where can I get the prism?
It's all on the GitHub and GitHub wiki linked in the description.
Im hearing impaired. i really need these
You laughed at my word there ( classes), I have noticed it after 1 year, but i have noticed too you still need more.... how can we reach to the second level?! 👍
So true!
How Do I Fuse My GUI OS With HD Camera (Transparent Phone?
If you provide more detail, I may be able to help.
). This Option Will Potentially Create A Paradigm Shift In Industry Practices,Directing A Flow Of Consciousness And Resources Into A Safer,More Transparent And User-Friendly Electronic Market.
Overall, The Suggestion Of A Transparent Phone Will Take A Collaborative Effort From Engineers,Designers,Marketers And End Users.The Potential Benefits Are Endless,But It Is Up To Us To Make It A Reality. CBAI
I have a mobile android/ios app for education. This app have a backend using php which have some info related to students. Can can you recommend smart glasses in order to scan student face than connect to backend to fetch info for that student from database without using the acute app in mobile to navigate through multiple pages to display that student info...?!
Vuzix Shield!
Hey man! Big fan of your work, I just had a doubt, are your open source glasses from 6 months ago HUD one?
I randomly came across your work few days ago and I'm new to it, so don't mind me and can you tell how they work
Sorry for the inconvenience
Keep rocking!!
Thanks! Checkout the first 90 seconds of this video for some details on that. The previous video was audio glasses with no HUD. This video we added the HUD. Cheers!
@@caydengineer Hey man! Are you planning to use waveguide optics or MOMS in the future?
And also if you don't mind can you make a video on different technologies used in smartglasses
Great work man! All the best!
What's the difference between yours and nreal
Quite a bit, but briefly:
The OpenSourceSmartGlasses are open source, moncular, and wireless, designed to be worn around in daily life.
Nreal Light and Air are tethered, stereoscopic, with better optics for screen viewing but not designed for all day use.
Looks like Google smart glass got jacked.
Lol
Nice!!
Where is the link for what you need to build a pair
teamopensmartglasses.com
Wau awsome.
I am an mechanical engineer maby we can team up together and kick it to the next level.
so cool man
Is it possible me to build these by my self?
Yep! That's what I did! See the repo in the description.
Would it be possible to put step by step "how to guige" to the GitHub repo.
I like smart glasses but I can't endorse these until they're full lens *AND* prescription .
They have display and prescription already.
hello caydengineer im 16 currently and i want to make these smart glasses how do i start also im very new to this so its my humble request if you could help me out i want to complete the project in 1month and 15 days from now on. please help...
Nice gadget but also a potential data protection nightmare
It's something to highly consider, but it's mostly the same problem as smart phones. The novel issue here is the potential to collect even more invasive and continuous personal sensory data.
There's a lot of angles to discuss this from, but from a pragmatic, market-driven angle - these things are coming either way, so let's solve/mitigate the issue. We're doing so, partially, by creating open source tools (namely the smart glasses manager) that provides a layer of user autonomy over their data and, importantly, their sensory experience/reality.
@@caydengineer we need personal intranets that we can build and keep at our house physically separated from the internet. That way we can compile our data for our own possible uses.
Can you tell us the exact parts you used
It's all on the github
@@caydengineer I don’t have GitHub
But I don’t have GitHub
@@caydengineer but I don’t have GitHub
is this available in the market?
Nope.
It's available open source to be built.
Now do this for a motorcycle visor...
It's a good idea, there are a number of these on the market (search for motorcycle helmet AR display HUD).
@@caydengineer they are all rubbish though. Last thing you want inside a motorcycle helmet is a solid piece of matter which may be mashed into your face/eye on a bad day. The projector needs to be embedded into the foam shell besides the eye/cheek and be projected directly onto the inner surface of the visor. Also, very specific functionality and operational characteristics are necessary for it to be widely adopted by riders. HUD for speed, adjustable bike settings, warning indicators, P2P coms only and a range of simple, effective and immediately accessible control interface for things like position/translucency/brightness/selected info etc. Some people may wish to have integration with Google maps, phone call/message, music, etc but these are all hit and miss and unless the fundamentals are done perfectly it's all a waste of time and effort anyway.
Other features a smart helmet could/should have is built in, high powered LED lighting for seeing through corners when riding in darkness (could have auto dimming and/or power off when encountering oncoming vehicles. The battery pack / power would most likely have be remotely mounted but it's not out of the scope of possibilities and if a tether was incorporated, an additional line could be included for water / visor ventilation....)
Once the key things are done properly and no encroachment on the desirable elements of riding are imposed on the rider as a trade off, smart helmets will take off. Just don't try do too much, less is more and any unnecessary complexity/inconvenience will detract 1000x more than the desired /elements/benefits will add to the desirability factor.
Can you make smart glasses with chatgpr
Yes, we're working on that!
got here after seeing the vest arrangement of reactions to Xreal an such hehe
but the issue is there nearly enough assistance in building because I have jack shit to work with reeeee
What support do you need?
Hey, I'm currently applying for Thiel Fellowship and want to start a project regarding smart glasses. But I'm currently doesn't have any team or people to work with. If I got the fellowship would you join my team?? I would love to work with you..
Help me make these with prescription lenses 😂 and a means to playing retro games for like GBA using a Bluetooth controller
Can u built smart glases for me, i just need smart glases with can help me see in the dark
Get night vision goggles.
I need
$$$$ WHAT IS BUILD COST???
Come on...don't make it into another highly specialized business type do nothing device. Where is gps? youtube videplayback, or at least wireless mirrorlink. we want multipurpose, easy to use, especially with standard android applications glasses that won't scare people on the streets.
Features i want is word search function. Glance around a supermarket and the item your looking for is highlighted. Basic Heads up display : heart beat graph, body temp, blood pressure, O2 lvl, time, humidity? Maybe a mini map/gps map or instead a 3d display of that path you’ve taken. So you can see where you maybe wasted time or steps. Would also help for back tracking when losing things. As you would know your path and head orientation could help you to stop from looking in the same spots. Obviously it needs to have auto dim and be able to display web pages.
If i could go further id pack a ir camera and a ir LED in there for night vision. We could source very tiny high def cameras from drones. It would be pretty basic night vision but it should be better then nothing. If thats not possible just put a led in there with a focusing cone so you can read with it.
Hello,
Can you help me to choose a smartglass to me? If you can send me your email I will explain better. Thank you.
Feel free to describe your needs here or send me an email.
en.wikipedia.org/wiki/Phaedrus_(dialogue)