How I made a Pokedex for Real Life with AI / GPT4o

[@BroskiPlays]

This is literally the coolest way of using the gpt4o vision ever! Amazing job! I am currently number one in the leader boards with my entries!

[@AdrianTwarog]

Success!

[@ariffirdaus5376]

Oooh x3 sugggestions : - Search by Type - Scanned Objects may have a Potential Rarity which gives a sense of acomplishment and a reason to go on the leaderboards - Auto fullscreen to complete the Pokedex feel - Custom categories for users to sort their snaps in

[@HT79]

How can we determine the rarity of a snap though? For example, (keeping the irl objects aside for now), a Pikachu could be worth more to someone than a charmander but vice versa for the other person.

[@lilev1954]

@@HT79 its not a value or what is it worth, it's literally how often you can "meet" the object in question, so like a rhino would be ultra rare and a dog or a road sign would be common

[@JohnLewis-old]

This is how AI should be used. To leverage passion projects into reality.

[@AdrianTwarog]

Agreed!

[@Kongongongg]

Don’t be police of fun please

[@JohnLewis-old]

@@Kongongongg What are you even talking about?

[@alex.g7317]

@@KongongonggOI! ITS THE FUN POLICE! 📢🗣️🗣️🫵

[@alex.g7317]

Just wait till your hear someone complain that he didn’t pay anyone to record every line in the Pokédex

[@CourageToGroww]

I wasnt wondering why you were building this. It's obviously because its an awesome idea!

[@AdrianTwarog]

Thanks :)

[@ralphrabago4957]

This is the first AI Tech video that actually put a smile on my face. Thank you :)

[@unquestionabletv]

Bro a Pokédex with all recognized real life species of animals would actually be dope. And can only capture via camera instead of through photos on-system, and can use AI/lidar to tell if it’s a photo of a real life thing instead of a photo of someone’s computer screen. 🔥

[@AdrianTwarog]

Exactly!

[@BobderBenchpresser]

Isnt that just Google Lens with a Pokémon Theme?

[@Ree1981]

Lidar! That's smart. I was like "Hmmm, how do we keep kids from cheating? I mean, they'll likely be able to cheat the AI, but once a human becomes involved..... nahhh, that'd take too much resources".

[@unquestionabletv]

@bedxntathat’s not a game

[@ariffirdaus5376]

@@BobderBenchpresser imagine making a pokedex skin mod for google lens

[@ruralpastorva]

Dude, you are a genius and you have the cleanest desk and creative process I’ve seen.

[@Onyaga]

wow this video is an absolute masterpiece, showing the whole process is really motivating and insightful

[@shuakki]

This is insane! As a fellow dev, props on the attention to detail. I can really see the passion behind this. 🏆

[@HT79]

Great video and great product! Haven't gone through the source code yet and you've probably implemented this way already but, GPT has problems reproducing the same text for the same prompt unless you set a very low temperature in which case it's usually gibberish. So what would happen is different people scanning Pikachu would create different entries for it. To save on the database size and keep things consistent for everyone, what you could do is have a two layer prompt for GPT. First one will only get the pokemon/rl object name and the second prompt would get the description and stats for the name. The very first time you get a response for the second prompt, you could save it in the db. The second person who would've scan a Pikachu would get the stored records from the vector search. This will even save up on the GPT tokens. Another added benefit would be being able to poll PokemonDB for accurate stats for actual pokemons. Database, however, needs to be redesigned a bit to have two collections - one for saving the embeddings and one for saving the user snaps. Btw, do you have a Gitter or something similar to discuss this more, if interested?

[@AdrianTwarog]

Quite good considerations, and things I think are work building in. I think if this project had a progression plan this would be on the list!

[@El.Desarrollador]

Wow first time I see something like this in youtube

[@AdrianTwarog]

Haha awesome!!!

[@psf021]

Wow! This is inspiring! I'm trying to show my kids what the creation process looks like and how satisfying it is! Pokemon sure is a great way to do this! You always amaze!

[@AdrianTwarog]

Yep idea iteration to make a project is one of the most interesting things to me!

[@orelhassid5812]

And you did it while recording and creating an amazing production video you are a LEGEND! I enjoyed every single minute watching this video

[@AdrianTwarog]

Wow, thanks!

[@weizhixie9678]

As a mobile app developer for many years, learned a ton from your video. Thanks for sharing!

[@lucasmdo]

Really awesome project and video altogether. I'm grateful youtube has recommended me your channel, it was a nice surprise. I'm eager to see what enhancements you and the community come up with.

[@sometimesILeftAComment]

Bro, I don't know what's more impressive, the fact that you programmed that or your pixel perfect design from scratch with Figma.

[@JeremyBotta]

This is freaking amazing! Shared with all my Pokemon friends!

[@AdrianTwarog]

Haha that's great!!! Thanks!

[@bharl7226]

It’s even more impressive that you know real life Pokémon 😮

[@AlanPCS]

Really nice project! :) a great demonstration that we can stitch several pieces without needing to know any of them in depth and make something unique.

[@AjinkyaBhushan]

This is just epic, I had the same idea for creating an app just like this, but I wouldn't have created it to this perfection level. You are hands down 10X developer who knows UI/ UX. Really got inspired from you and I want to keep learning and developing to become like you.

[@munnabg117]

This is One of the videos I found that actually takes us through the thought process and every detail of how a project is actually made. Thanks a lot Adrian for this, this came to me just in time. It's my first time on your channel and you just earned a subscriber 👍

[@Bbb78651]

I just recently encountered and learned next JS at work, as a data scientist. Doing stuff with RAG and chatbots, so this is def up my ally. I am also an ALL TIME Pokémon fan, currently playing radical red. Thank you for this MASTERPIECE of a video combining mine and I’m sure so many others love for tech and AI with Pokémon. Keep innovating, you’ve easily earned a sub!

[@StavXO]

Bro's using every gadget and device available in the world jesus

[@AdrianTwarog]

I should of coded some of it in VR too!

[@Roshank231]

Fantastic project and such nice presentation on the video. This deserves to go viral, good stuff man.

[@s-sameer]

How are you covering the costs for running the services?

[@LeagueOfGameCasters]

I’m amazed by your efficiency. great video, love the format. Would love to see more like these!

[@AdrianTwarog]

Thanks

[@BitYoungjae]

이 영상은 어떤 도구를 어떻게 멋지게 써야하는지 집중하는 것이 아니라 결국 무엇을 만드느냐가 중요하다는 것을 상기시켜주었습니다 ㅠㅠ.. 많이 배워가네요..

[@adityasrivastava9008]

This was suck a cool and crazy good project to witness, the way you explained the whole process felt like you were teaching us the little bits about the project, this was amazing and inspired me to make an ai based project myself, thanks adrian

[@evidentfoil027]

This was awesome. Motivates me to develop my own passion project and showed me some great frameworks to use. Looking forward to future videos!

[@lupker]

Another thing and remove all pokemon images: Nintendo does not like this and you might need to remove it. Which wpuld be a real shame!

[@Milkman-c8f]

As much as I am interested in the PokeDex itself for the same reasons you are, I really appreciate the explanation and project pre-development process and your mindset/breakdown going into it much more. That came to be one of the more valuable things i got from this video, thanks.

[@Paladin-ev1gg]

Wow wow wow. As a 20 years old guy who's going through the process of trying to get first coding job this seems insane. I took the huge inspiration from this video, for example. the Figma preparatios. I'm used to take colors by the "rule" 60/30/10" for the colors but your process is way more efficient. I cannot afford graphic tablet but maybe I could try to save it as in the video it looked so useful. You've earned my sub, definitly gonna watch something else too.

[@pelago_]

You legend, this is a really ingenious way to tie all of this cool technology together. Great work!

[@imthecardbox5158]

This is really inspiring for a pokemon fan just dipping into the surface of computer science and design! Good work

[@GeorgeZoto]

Thank you for putting such creative and technical energy and effort into this project and for sharing it, amazing :)

[@bojanperic1160]

Inspirational how far creativity and persistence can take you. Thank you for this gem of a video 🙏

[@AdrianTwarog]

Glad you enjoyed it! Yep lots of persistence for this one!!

[@tdombui]

really sick project man. Awesome work

[@philstlt]

Such a cool idea, great result and as a plus a little tutorial how to structure a project like this. These are the videos i love the internet for.

[@TheOnlyIchiban]

I am super surprised you haven't done TS yet! It's a game changer and once you do it there's no going back. Awesome project! I'm looking to do a project like this as well so it's really informative that you went through each step in good enough detail instead of a super high level brushthrough!

[@AdrianTwarog]

I think I'm going to have to do a dedicated video of me learning it!

[@MortMort]

I was telling my partner the other day that I wish there was a IRL Animal Crossing Flower, bird, Animal etc catalog you could go and fill out , and sure you could just take picture of your monitor but the fun is in discorvering things on your own imo. this hit that itch very close, first entry is already my doggo!

[@TheUselessgeneration]

Amazing to open source this. Ill definitely be adding stable diffusion to convert all images into pokemon cartoon style.

[@codinginflow]

You have amazing design skills. How did you acquire these?

[@MathieuCruzel]

This is fantastic, you can even branch this concept to emulate a Star Trek tricorder, your imagination is the limit. Brilliant !

[@thecollector4575]

This is amazing!!! If you released it as an app I would pay for it!

[@thecoldmage_]

This is super cool, great explanation on the process too.

[@AdrianTwarog]

the goal was to show how ideas can be put together!

[@pallasplaysyt]

What was that tablet you were using to take notes before you pulled out the iPad? It looks sick and I'd love to get one.

[@deltasmaragd2773]

Was asking myself the same

[@Rohit-cj6eb]

Maybe any random android tab

[@pallasplaysyt]

@@Rohit-cj6eb I watched the video again and saw a logo briefly appears. Turns out it was the reMarkable tablet.

[@pallasplaysyt]

@@deltasmaragd2773 Turns out it was the reMarkable tablet

[@ZikkemanYT]

Hello good sir, what is that tablet you drew your idea sketches on like at 3:00

[@mukithasan9684]

How much time did it take to build the database with all those data and where did you get it did you do manually or automatically

[@SnakeCaseGuy]

After identifying a bird, make it resemble the pokemon.

[@AdrianTwarog]

Ahha probably could do that too!

[@hassanad94]

The design... Wow GG, i wish you would talk about it more, how you implemented it. Really nice UI...

[@JoJo.Orjuwan]

Wow, that's really an impressive work !

[@MyDigitalHub]

I'm super impressed! Thanks for making this into reality.

[@CatDribble]

I feel the rabbit is like a pokedex, but if someone ate a pokedex, digested it and then shat it out

[@Lugge1999]

What a passionate project! I love the idea! This is what AI should be used for. Making simple dreames become reality

[@mrkammytv]

This is AMAZING!! How many days in total it took you to make this project?

[@o_oyash]

damn I was planning on doing this too. When I saw 4o get announced with the camera feature I instantly thought “wow thats a real life pokedex!”

[@Burbanana]

this is amazing, do you have any tips on using figma and making web designs like you did? I dont have access to fancy sketching hardware but I have a powerful desktop. I was also working on a pokedex app, but more like an informational db with tools like a stat builder using Go and HTMX.

[@lupker]

I love this. I would like to use this in my classroom. But it needs to be translated to work. I think it would be not to difficult for the AI to add a language feature?

[@just._.wonder]

I can't even describe how amazing that video is. And there is so much to learn about .

[@MathieuLaforce-q5f]

cool project, thanks for going over your process. took a few things that i'll apply on mine.

[@davidmgmg6032]

This is so cool. So excited to try it. My first project at my uni was also a C# pokedex. But it is not actually that good but I am proud for my first project. Pokemon is literally my childhood too.

[@aitboss85]

What about adding the option to save the results locally or in a service like Google Drive, Microsoft OneDrive, etc., and so we don't consume additional database storage?

[@zac0511]

This app is incredible. I discovered that bananas had 5 HP with this. You should add a button that allows sharing an entry (like the banana one) with someone else.

[@IamSinistor]

really cool the only thing i think would really help is if the initial line was the "dragonite the knight pokemon and the evolved form of dragonair" line at the start and then limit the response to a single sentence other than that great video i thought the use of AI in the title meant you were gonna ask chat gpt to write the code and test it as you implement it, you would be surprise how much that is going to happen in the future though i dont see it as a difference as using an API at this point its just a tool, great vid :D

[@spooky4655]

That ui design is really good

[@cool4funny606]

This Guys Is A Legend Bringing Our ChildHood Dreams In Our Hand and for Free! omg Tysm For Ur Hard Work We Would Be Waiting

[@Mr.Auberpunt]

What is name of the device in this 2:38

[@raulbarros8077]

Good thing Pokemon is so mainstream we got people covering us for this stuff I thought about doing the same thing, also with current voice AI you could probably have one that describe things using pokedex voice

[@zadzadny]

I'm wondering - what's the tool you use on 2:50? Is it Remarkable or something else? 😊

[@AdrianTwarog]

Remarkable!

[@Historiasinsomnio]

I swear I was just talking about this a few weeks ago with my brother… Im glad yt showed me this

[@FlorinPop]

Adrian you have to pick: Pokemon or JavaScript 👀

[@AdrianTwarog]

Hmmm, I can make Pokemon with JavaScript, but I can't make JavaScript with Pokemon!

[@Shaojeemy]

Hmm why not tensorflow? I made a small prototype for the first gen, the issue was that each pokemon needs about 100+ pictures which can bloat the app size if not using a server

[@reubzkinterestingthings]

This is freaken beyond amazing!!! 😁😁😁

[@neroknight9787]

What is that tablet you were using not the ipad it was the first one you showed??

[@yihaowan861]

What's your coding font? I like the cleanliness of it. It's like Cascadia but better

[@abdiel_hd]

Could you make it that it uses the primary camera by default instead of the ultra-wide camera? Also, when i touch the camera it opens my main camera app, which is nice, but after I take the photo it tells me that it couldn't finish the process because of low memory... But I'm not low on memory. Or it it RAM? I only have 6GBs (Samsung S20FE)

[@pfever]

This is the best quality tutorial I have seen online~ I loved you show the whole process in such detail and even open source it! Thank you! I just have a question, the app as it is today costs you money to run... Specially becaude of the calls to OpenAI. How could you make a profit with an app like this? If this were to become really popular I think you would need to turn it down?

[@YyoavV]

suggestions what if you take a picture of something you already have? that shouldn't count to your score delete previous entries add sound preview of what the pokemon sounds like but wow what a good work ethic you're amazing. it turned out great

[@VaibhavShewale]

there should also be option where if the pokedex has nothing it will ask user to if they wanted to add this new things to entry in pokedex like in pokemon

[@emeriktremblay3881]

I recommend using the new Gpt4o-mini it's a fraction of the cost and should do the same work ! Nice project

[@RyluRocky]

Fraction as in 1/30th of the price.

[@RodrigoMendoza7]

Adrian, what about taking this amazing project a notch? Making it a PWA will be the cherry on the cake.

[@AdrianTwarog]

I thought about it! I thought making it a website that looks like a mobile app would be the best starting step to let anyone try it!

[@RodrigoMendoza7]

@@AdrianTwarog Awesome! 😃 Please, don't forget to document that as well. Videos rich in detail like this one are really appreciated.

[@rabidrivas]

Loving it! Can you change the icon when it is installed as a web app?

[@AdrianTwarog]

Hmm good idea!

[@lenoschristou5831]

Hi! I'm curious about the costs of running this application. As more users try it out, won't the costs become too large to maintain?

[@AdrianTwarog]

Indeed, it's the cost of operation, all businesses who use anything from OpenAI have to sort of pay it!

[@elemeno0pee]

​@@AdrianTwarogBut isn't this an open source project, and not a business??

[@elemeno0pee]

​@@AdrianTwarogAh, I just checked out the repo and saw that you're no longer hosting it due to costs. Makes sense 😄

[@A.Rgamez-u3w]

This is amazing i tried it out and its like my dream come true! I always have been looking for a thing like this that isn’t a 200+ dollar investment. I suggest at some point in time show both types as I noticed that the dragonite was mono flying. Keep up the amazing work!!

[@thezcrew86]

This is great! You should create another childhood dream I have by making a megaman netnavi personal assistant next!

[@lasagna-dd]

wow great video now i have an idea for my capstone project

[@mehran7449]

Didnt "Abe's projects" do the same exact thing you did and also made like a separate pokedex device?

[@TimBrownYoutube]

I made an app similar to this before the ai era but ai really is a game changer here. There are many id apps out there but as you stated surprisingly none with pokedex style branding. Merlin Bird ID has shown me that audio capture is also a game changer. Can capture 10 birds effortlessly on a short walk. Would be cool to see that option when there is a public model available.

[@AdrianTwarog]

Woah cool, yes a friend of mine that likes plans loved that you could scan and type of flower or plant and it tells you the type!

[@ChkChkB00om]

Hey just finding this video now and see it is not live due to the cost of AI - what do you think the viability of projects like this is for real use? what would you realistically need to charge the average user to break even, or make a little profit? I recently dabbled in AI and the cost quickly made me rethink things

[@CaptainEffort]

So I took a couple of pictures with it and was pretty blown away, seriously this is super cool, but the next time I went on my pictures were all gone. I’m signed in through Google btw so I’m surprised they didn’t seem to save. Any ideas?

[@gokujr.7382]

I was wondering if there was a way for it to scan a image and then check the pokedex tab for similar image that is stored and pull up the information that is already there.

[@AdrianTwarog]

Can do this, though I haven’t made that feature yet, could be a wiki of comment entries! Cool idea

[@yourmagicfilm]

Wow so you and a guy on Etsy has made a working Camera based pokedex that both use AI! I've already been testing the one from Etsy and it's very good. Can tell what pokemon cards are, plushies, very random 3D versions of pokemon I have like LEGO. Just wish it had a better camera and closer focus! Your generated voice was very impressive.

[@Hataken999]

This is so inspiring to me. Thanks Adrian for making this video ❤

[@AdrianTwarog]

Thanks lots of effort was put into this!

[@DTrackFinder]

Love it! Waiting for updates!

[@AdrianTwarog]

Haha will add!

[@anassabbou5259]

Great work. Lovely to watch this process from ideation, design thinking, prototyping until implementation 🫡👏

[@limited06]

Whats the ChatGPT usage like? Surely this will cost a ton as its open to all?

[@lucasmarques2871]

Awesome video! Which macbook is yours?

[@manu.vision]

I’m currently number 1 in the leaderboard. Just wanted to say that, have a good day!

[@AdrianTwarog]

Hahha that was quick! I wonder just how many people will be on the leaderboard!

[@mihawk1096]

I have a question, let's day you are using GPT-4O dont you think there might be a problem of too much users taking pictures and all causing you to pay extra for its API ? How can you solve it? Sorry I have a similar idea but based on thr real time video and I'm not able to find a good AI for it.

[@AdrianTwarog]

The cost of doing business!

[@nilaier1430]

I'm pretty sure Gemini 1.5 Pro accepts video as an input, but I don't know if you can attach a video outside of AI Studio, since i haven't tried Vertex AI or Google Cloud.

[@MaybeKinich_png]

Please make this into an actual app, I don't care how long it takes, your work is something to wait for, never give up dude!

[@bramba0147]

Yes then i probely acualy get it

[@rayansailani4465]

Omg! I saw another KZbin video where a physical Pokédex was designed. I’m very similar to you in that -that I’ve followed Pokémon for most of my life and it doesn’t make sense for me to not follow it anymore! I really wanted to build something like this but was slacking off because of not having a process in place for this. You video seems to be great for that. I’d be disappointed if this was a tutorial xD