We Built Open Source Smart Glasses

We built a pair of DIY, open source smart glasses in 2023 that are fully functional, fully open source, and have a suite of use cases. I travelled across North America in a mobile RV hacker lab while while designing circuit boards, doing CAD, writing firmware, integrating displays, etc. to make these Open Source AR Glasses a reality. Then, we realized the beta version 1.0 and went to CES 2023 to show off the Open Source Smart Glasses to the world!
You can access all of the technical resources in the link below in order to build your own smart glasses - fully DIY smart AR glasses!
If you like smart glasses, neurotech, futurism, singularity, AI, etc., subscribe to my channel!
Cayden Pierce (me): caydenpierce.com
Open Source Smart Glasses: github.com/TeamOpenSmartGlass...
Alex Israelov: www.alexisraelov.com/

[@AlexIsraelov]

This has been loads of fun to work on. Thank you to all the other OSSG developers, and stay tuned everyone for more info on the SmartGlassesManager!

[@caydengineer]

Great work man! It wouldn't have happened without your contributions.

[@KeithPatersonMBE]

As a deaf person I look forward to subtitling glasses, so I can LOOK at people when they are talking and SEE what they say. Even so I am still not ready to whack out $400 for something which may have a limited life. K Paterson MBE (UK)

[@caydengineer]

Yep, great use case. See Xander, XRAI, and TranscribeGlass.

[@gunloco5207]

Bro the couch staircase got me weak lmfao 😂

[@caydengineer]

Haha best part.

[@jasonhedtke659]

Can't wait for the beta units for folks to try out!

[@gregstretton]

Awesome stuff, thanks for documenting it! Looking forward to the beta units

[@caydengineer]

Thanks Greg!

[@AlanUnis]

Exciting developments! Can't wait to see your next steps.

[@TomFleay]

Finally got around to wathcing this video, Cayden the open source smart glasses have come a long way with you continuing to be a frontier innovator within the smart glasses space. You do a brilliant job combining your technical projects with parts of your day to day living and I love the $50.00 comment. Can't wait to see more updates on the open source smart glasses and WIS and of course, great seeing you and Alex at CES.

[@caydengineer]

Thanks Tom, great to meet you IRL at CES. Looking forward to the next IRL event.

[@wont_take_it]

Really can't wait to see where this project goes in the future. With 3d printers being commercially available, these types of open source projects will be the frontline to the future for a lot of people. What seemed like sci fi just a few years ago will soon be in the hands of the people. You guys are leading the way into the future, and it's amazingly cool to see it happen. Keep up the good work, you're heroes to the community. (What community? All of them. Civilization)

[@caydengineer]

Thank you very much!

[@ErikGoff]

Wow guys congratulations! and wow that must have been some journey!

[@caydengineer]

Thanks Erik, it was an adventure!

[@leonofdragonstone1250]

I love this project, its exactly what i have been curious about manufacturing for myself. My prototype was just a video display setup using DLP and mirrors to produce viewable video superimposed, and just view my computer/ phone/ whatever else through the glasses, but this seems revolutionary in its own right. Very impressive work!

[@Jay-yz4gc]

I need a pair of these I got a cool idea I haven't seen before and Is very much needed.

[@caydengineer]

What do you want to make?

[@isaiahballah2787]

Another awesome video, love it!

[@caydengineer]

Thanks!

[@SLAVKINGRED]

freaking awesome.

[@dranirbande]

Oh yeah!! 🔥🔥🔥

[@IanDangerfield]

Hey bro love the content and subscribed! Question, do you think picking up the nreal airs would be the best off the shelf for gaming and productivity? Or should I wait for the next generation of wearables?

[@caydengineer]

Gaming, probably yes! Productivity, maybe. When you're travelling in a cramped space it could be a good monitor. You likely won't ever use this as a monitor if you have a real one on hand.

[@jessesanchez08]

What a journey! Excited to see what's next

[@pyrusspangj]

Fascinating! I have been (and still am!) working on my own pair of AR technologies; I can't so much call them glasses, as I believe there can be more efficient designs. This video is such an inspiration, and will definitely help me moving forward! If you don't mind, is there any way I can contact you?

[@caydengineer]

Cool! Feel free to share your project! Yes, contact me on Discord, see description or teamopensmartglasses.com

[@zakuro8532]

Do you think it is possible to design the glasses as a simple attachment to any pair of glasses and put all the hardware wired into a box you can put in your pocket?

[@caydengineer]

Yes, but this ussually results in a very uneven and uncomfortable and odd looking experience. Full integration is the better solution in my opinion.

[@iiJDSii]

Do you have a full bill of materials available somewhere? Great vid, cheers!

[@caydengineer]

Thank you! Everything is on the Github linked in the description.

[@vexedin-7091]

This is a godsend! As someone with ADHD my thoughts can be gone in minuets something like this could be a great solution!

[@caydengineer]

Cool, how do you envision using it/how would it work to help your ADHD?

[@victorpdiez7688]

Best of lucks!!! you do deserve it!! 🍀🍀🍀🍀🍀🍀🍀🍀🍀

[@caydengineer]

Cheers and thanks a lot!

[@samc7381]

so cool man

[@AlulaDroneLab]

Nice!!

[@Dtr146]

This feels like it should have been longer than a 9 minute video

[@caydengineer]

Thanks! First edit was 30 minutes, lol. Had to cut a lot.

[@alfredocosta6887]

Hi , I ll try esigh4 low vision smart glasses in France 5 April, Tks your approach. Tks

[@caydengineer]

Let me know your thoughts on the experience using the esight 4!

[@alfredocosta6887]

@@caydengineer I ll, hope it works, in myself, and give me again autonomy… the only problem, here, is is 10000€, the device I ll send you a message

[@Buharialtinee]

Wow you are genius

[@caydengineer]

That's what my mom always says.

[@HappyHands.]

Im hearing impaired. i really need these

[@iskandarsulaili]

I wonder any commercial MR/XR glasses that are open source to program? in js preferable

[@caydengineer]

You can do so with the SmartGlassesManager on most major consumer smart glasses (Vuzix, Inmo, Activelook, etc). Not in JS, but in Java (Android).

[@Neozone1234]

Hi, could you do a Tutorial on how to install your software on open source glasses?

[@caydengineer]

It's all on the GitHub and GitHub wiki linked in the description.

[@FlockofSmeagles]

This is really cool, but I think the xreal approach has become the new standard in glasses display tech.

[@caydengineer]

Prism aren't the solution, but neither are bird baths. Bird baths are heavy, bulky, and obstruct the eyes. Waveguides or another technology will prevail - something lightweight that doesn't obstruct the eyes.

[@FlockofSmeagles]

@@caydengineer True, north's focal has come a long way on that front, but I was talking about a baseline standard. We're a few years away from seeing something like focal at the 2-300 dollar price point.

[@AlOqab_]

will you consider the immersive android os that is coming? it is open source and its better then reinventing the wheel

[@caydengineer]

Can you link to it? I doubt it though, Android is too power hungry. The first consumer smart glasses will use MCUs.

[@zakuro8532]

That's so cool, maybe I won't have to sell my kidney to afford a smart glass!

[@fahadaldhafairi2322]

I have a mobile android/ios app for education. This app have a backend using php which have some info related to students. Can can you recommend smart glasses in order to scan student face than connect to backend to fetch info for that student from database without using the acute app in mobile to navigate through multiple pages to display that student info...?!

[@caydengineer]

Vuzix Shield!

[@travisrouse4041]

Are these available for purchase yet?

[@caydengineer]

No, you would have to build your own or have someone build you a pair.

[@theFLshark]

Neat, but you have to get smaller batteries with similar capacity and get them at or under 100 grams.

[@caydengineer]

Haha, please link said batteries.

[@orion93939]

This is AWSOME!!! Hats off to you. How much $$$ do you think it would take to make this myself?

[@caydengineer]

~$500 if you made only 1 and already had all the tools.

[@orion93939]

😳im a broke kid lol. can u make a vid for a low cost smart glasses?

[@perspectivex]

​@@caydengineer Is ~95% of the cost the Sony 336C OLED display? I don't see any other really expensive parts. Can't find a BOM on the project github or discord.

[@maxjuan2222]

You laughed at my word there ( classes), I have noticed it after 1 year, but i have noticed too you still need more.... how can we reach to the second level?! 👍

[@caydengineer]

So true!

[@tayyabshamas209]

Are there any smart glasses with prescription auto adjusted to the eye. ?

[@caydengineer]

Many of these glasses offer the opportunity to integrate a prescription lens insert.

[@caydengineer]

AFAIK actual auto-adjust prescription glasses exist in research and medical, but there's not market pushing them forward as they cost 100x a regular pair of glasses, and prescriptions change slowly, so what's the point?

[@tayyabshamas209]

@@caydengineer i see.

[@SierraSierraFoxtrot]

Important work, looking forward to seeing someone add a camera, ideally one with a high FOV. It really aggravates me that it's the norm for smart glasses to have low FOV cameras.

[@caydengineer]

Thanks. High FOV is harder because it requires higher red, which is higher bandwidth, and AFAIK requires a fisheye style lens which sticks out from the glasses, which looks weird. I do agreed that higher FOV cameras on smart glasses are better! I'd rather lower PPD and more content to understand the context.

[@SierraSierraFoxtrot]

@@caydengineer higher red? The lens doesnt need to stick out much at all, look at any modern phone, they got very nice fov on the widest lens. My S10 in portrait mode can capture a document on the table in front of me more or less.

[@laszlototh872]

Where can you order? And how much does it cost?

[@caydengineer]

You can't order/buy it.

[@melvinolivet7740]

where we can found all stuff needed to build our own glasses ?

[@caydengineer]

See the GitHub

[@beelikebunny]

Looks like Google smart glass got jacked.

[@caydengineer]

Lol

[@rensogomez5753]

This is exactly what I was looking for! how can I get one! You're aswome!

[@caydengineer]

Thank you! They aren't for sale. You can build your own, or buy a COTS smart glasses, like Vuzix Blade 2 or Activelook Engo 2.

[@rensogomez5753]

@@caydengineer Thanks again, love your work!

[@Literallynothing-sw7bk]

Hey man! Big fan of your work, I just had a doubt, are your open source glasses from 6 months ago HUD one? I randomly came across your work few days ago and I'm new to it, so don't mind me and can you tell how they work Sorry for the inconvenience Keep rocking!!

[@caydengineer]

Thanks! Checkout the first 90 seconds of this video for some details on that. The previous video was audio glasses with no HUD. This video we added the HUD. Cheers!

[@Literallynothing-sw7bk]

​​@@caydengineer Hey man! Are you planning to use waveguide optics or MOMS in the future? And also if you don't mind can you make a video on different technologies used in smartglasses Great work man! All the best!

[@fajile5109]

What about something like sound direction indicator. Like in video games could be useful for deaf people as a visual aid.

[@caydengineer]

Possible to do if you upgraded to have multiple microphones, which is needed for localization. Would want to expiement with various modalities of HCI for this use case. Visual might be work but I imagine spatial haptic would be better.

[@crashtestrc7213]

Is there a Way to build these myself, if so what is the Investment/skills required? I have some soldering skills, 3D printing skills, and perseverance. I also have absolutely no coding skill.

[@caydengineer]

All info is on the GitHub and GitHub wiki, linked in description. Resourcefulness is as important as perseverance.

[@crashtestrc7213]

@@caydengineerThanks, is there a build guide available anywhere?

[@caydengineer]

@@crashtestrc7213 I just told you where it is. You are not resourceful enough to successfully build smart glasses.

[@crashtestrc7213]

@@caydengineerOk, I'll stick to airplanes.

[@iwayanjuliantapradnyana3264]

Hey, I'm currently applying for Thiel Fellowship and want to start a project regarding smart glasses. But I'm currently doesn't have any team or people to work with. If I got the fellowship would you join my team?? I would love to work with you..

[@emmanuelponce6380]

How Do I Fuse My GUI OS With HD Camera (Transparent Phone?

[@caydengineer]

If you provide more detail, I may be able to help.

[@emmanuelponce6380]

). This Option Will Potentially Create A Paradigm Shift In Industry Practices,Directing A Flow Of Consciousness And Resources Into A Safer,More Transparent And User-Friendly Electronic Market. Overall, The Suggestion Of A Transparent Phone Will Take A Collaborative Effort From Engineers,Designers,Marketers And End Users.The Potential Benefits Are Endless,But It Is Up To Us To Make It A Reality. CBAI

[@DK.47]

Where is the link for what you need to build a pair

[@caydengineer]

teamopensmartglasses.com

[@Galaxia53]

Maybe at some point AR glasses plus an AI assistant could function as an optician to adjust the screen appropriately to your eyes. This would save a lot of hassle and money.

[@caydengineer]

Perhaps for a test procedure, but it doesn't seem economically viable for every prescription lens glasses to be electronic and programmatic prescription. I imagine we'll see this with automated eye tests long before everyone wears glasses that change to their eyes.

[@ShawankumarParida]

Where can I get the prism?

[@caydengineer]

It's all on the GitHub and GitHub wiki linked in the description.

[@danieldewindt3919]

Wau awsome. I am an mechanical engineer maby we can team up together and kick it to the next level.

[@muntee33]

Now do this for a motorcycle visor...

[@caydengineer]

It's a good idea, there are a number of these on the market (search for motorcycle helmet AR display HUD).

[@muntee33]

@@caydengineer they are all rubbish though. Last thing you want inside a motorcycle helmet is a solid piece of matter which may be mashed into your face/eye on a bad day. The projector needs to be embedded into the foam shell besides the eye/cheek and be projected directly onto the inner surface of the visor. Also, very specific functionality and operational characteristics are necessary for it to be widely adopted by riders. HUD for speed, adjustable bike settings, warning indicators, P2P coms only and a range of simple, effective and immediately accessible control interface for things like position/translucency/brightness/selected info etc. Some people may wish to have integration with Google maps, phone call/message, music, etc but these are all hit and miss and unless the fundamentals are done perfectly it's all a waste of time and effort anyway. Other features a smart helmet could/should have is built in, high powered LED lighting for seeing through corners when riding in darkness (could have auto dimming and/or power off when encountering oncoming vehicles. The battery pack / power would most likely have be remotely mounted but it's not out of the scope of possibilities and if a tether was incorporated, an additional line could be included for water / visor ventilation....) Once the key things are done properly and no encroachment on the desirable elements of riding are imposed on the rider as a trade off, smart helmets will take off. Just don't try do too much, less is more and any unnecessary complexity/inconvenience will detract 1000x more than the desired /elements/benefits will add to the desirability factor.

[@loycross]

Man I'd be a amazing if the KZbin algorithm recommended this to lots of William Osman, The Backyard Scientist, Nile Red, Allen Pan, Michael Reeves, Safety Third, Tom Scott, Vsauce or Mark Rober fans like me that may be fairly entertained/interested by watching this video That'd be crazy, huh

[@caydengineer]

One day! ;)

[@DK.47]

What's the difference between yours and nreal

[@caydengineer]

Quite a bit, but briefly: The OpenSourceSmartGlasses are open source, moncular, and wireless, designed to be worn around in daily life. Nreal Light and Air are tethered, stereoscopic, with better optics for screen viewing but not designed for all day use.

[@renzsalvador9700]

is this available in the market?

[@caydengineer]

Nope.

[@caydengineer]

It's available open source to be built.

[@senritsujumpsuit6021]

got here after seeing the vest arrangement of reactions to Xreal an such hehe but the issue is there nearly enough assistance in building because I have jack shit to work with reeeee

[@caydengineer]

What support do you need?

[@eemelilaurila5803]

Is it possible me to build these by my self?

[@caydengineer]

Yep! That's what I did! See the repo in the description.

[@eemelilaurila5803]

Would it be possible to put step by step "how to guige" to the GitHub repo.

[@JohnDrose-mr1fi]

with glasses u need to go design before function. if u want wide adoption. ideally 4 designers on your team, fashion.

[@caydengineer]

I mostly agree. Aesthetics, I.e. social comfort is huge. Physical comfort usually follows if social comfort is met (not always, weight be roughly

[@Andi187187]

Nice gadget but also a potential data protection nightmare

[@caydengineer]

It's something to highly consider, but it's mostly the same problem as smart phones. The novel issue here is the potential to collect even more invasive and continuous personal sensory data. There's a lot of angles to discuss this from, but from a pragmatic, market-driven angle - these things are coming either way, so let's solve/mitigate the issue. We're doing so, partially, by creating open source tools (namely the smart glasses manager) that provides a layer of user autonomy over their data and, importantly, their sensory experience/reality.

[@fajile5109]

@@caydengineer we need personal intranets that we can build and keep at our house physically separated from the internet. That way we can compile our data for our own possible uses.

[@TheInunah]

I like smart glasses but I can't endorse these until they're full lens *AND* prescription .

[@caydengineer]

They have display and prescription already.

[@GabeS986]

Can you tell us the exact parts you used

[@caydengineer]

It's all on the github

[@GabeS986]

@@caydengineer I don’t have GitHub

[@GabeS986]

But I don’t have GitHub

[@GabeS986]

@@caydengineer but I don’t have GitHub

[@RiyadElyakouty-de6wq]

I want a tutorial so badly so I can help the deaf and old people

[@thango7677]

Can you make smart glasses with chatgpr

[@caydengineer]

Yes, we're working on that!

[@dimasmahardhika5333]

Can u built smart glases for me, i just need smart glases with can help me see in the dark

[@caydengineer]

Get night vision goggles.

[@tdawg222]

$$$$ WHAT IS BUILD COST???

[@mikhailkova]

Come on...don't make it into another highly specialized business type do nothing device. Where is gps? youtube videplayback, or at least wireless mirrorlink. we want multipurpose, easy to use, especially with standard android applications glasses that won't scare people on the streets.

[@fajile5109]

Features i want is word search function. Glance around a supermarket and the item your looking for is highlighted. Basic Heads up display : heart beat graph, body temp, blood pressure, O2 lvl, time, humidity? Maybe a mini map/gps map or instead a 3d display of that path you’ve taken. So you can see where you maybe wasted time or steps. Would also help for back tracking when losing things. As you would know your path and head orientation could help you to stop from looking in the same spots. Obviously it needs to have auto dim and be able to display web pages. If i could go further id pack a ir camera and a ir LED in there for night vision. We could source very tiny high def cameras from drones. It would be pretty basic night vision but it should be better then nothing. If thats not possible just put a led in there with a focusing cone so you can read with it.

[@daddyyyyyyyyyyyy]

*this looks good kzbin.info/www/bejne/oHq6qH2unp6Vr9U why in your this video you have put a prism as in your previous video there was no such thing*

[@caydengineer]

The video you linked is featuring the Vuzix Blade. It's a completely different pair of smart glasses than the OpenSourceSmartGlasses we built in this video.

[@jacmoraes7925]

Hello, Can you help me to choose a smartglass to me? If you can send me your email I will explain better. Thank you.

[@caydengineer]

Feel free to describe your needs here or send me an email.