ChatGPT Vision: The Best Way to Transform Your Paper Notes Into Digital Text

[@richardbouma2007]

1. As others have reported, there does not seem to be a “vision” option available in ChatGPT 3.5. So the transcription method described in this video appears to work only in the paid chatGPT 4.0 application. 2. However, the good news is that Google Lens (a free part of the Google search application) does a pretty good job transcribing handwritten notes. Take a picture of the page that has the notes, then store the picture in your phone’s photos. Then let Google Lens upload that picture. One of the Lens options allows you to copy the text identified by Lens from the picture. Paste that text in a word processing application of your choice. It’s not perfect, but it is serviceable. I am working with an iPhone. I assume that an Android would work substantially the same way.

[@ayanleyusuf4733]

Thank it worked 😊

[@SeymourClearly2]

Thank you for this, I found Google lens also works if you photograph it directly rather than just import the photo. What it doesn't do is to understand what you've written. I pasted some handwritten notes about using Wix to develop a website that I'd made from a KZbin video, but Chat GPT wrote it's own version which left out some of the detail I'd recorded, but because it had drawings in the notes I think it couldn't understand that part of my notes. Still, it was pretty good. Might have to start paying for Chat GPT!

[@sudeepand]

It seems that the idea works with Bing copilot as well, once you enable the GPT-4 option. However, I have not tested explicitly how well it performs relative to the Chatgpt app with a GPT-4 subscription.

[@Jesi-xn]

bless your soul, sire

[@Ferkoel]

0:00 Intro 0:39 Why ChatGPT Vision is Different 1:24 6 Steps to Follow 2:35 Mistakes and Limitations 3:11 3 Possibilities ChatGPT Vision opens 4:08 Conclusion

[@thewebstylist]

I just sent this to my Mom who does all her interior design biz notes by hand, awesome!

[@duniel3000]

Just gave it a try on a handwriten diary in cursive script: GPT4 confidently produces complete hallucinations of what's on the page. I mentioned this to GPT4 which in turn produced another different "reading", that had as little to do with the actual text as the first. Since I can decipher the text 99.9% of the time, I propose this as a future benchmark for AI, when it catches up. For the time being I'll stick with speech-to-text with google now on android, which is in the high 90ies, accuracy-wise.

[@kerrylindsey7312]

with my Remarkable 2 I’ve replaced all my old handwritten notebooks, while still getting the greater creative capacity that comes with handwriting. It converts all my notes at the push of a button And keep a file tree as complex as Microsoft word. Absolutely changed my productivity

[@Jaszkin]

Nice! I've used Remarkable 2 and unfortunately writing was very laggy and the device - faulty :( I had much better experience with Onyx Boox Note 3, but ultimately I moved back to paper notes and journalling 😅

[@koto9x]

@@Jaszkinwhy did you move back

[@JDMaple85]

Fantastic stuff. So glad I'm set free from my tablet.

[@KSJsounds]

Just gave this a try on the normal free chatGPT version without expecting anything to work and YO IT ACTUALLY WORKED! This will make the marking of student essays that much more easier! :D Elated.

[@girlyvoice3210]

This is the kind of thing libraries should provide. An automatic book scanner with an LLM running locally, saved to a usb stick

[@DailenGunter]

As an IT Pro, I'm truly impressed at your adept adoption of AI in your content!

[@PalashBackup]

You have made some significant upgrades to my notetaking journey. Thanks Tiago for your help.

[@bram_adams]

one thing id add to the video, you can do all the regular prompting you do in gpt! so you can leave unfinished equations, or drawings on the page, and have chatgpt think about them, solve them, describe them!

[@IsaacBlencowe]

This is the sort of thing I have been wanting for years. Thank you for making me aware this now exists ✌️ Look forward to trying it out. One thing I will say though. Digitizing notes in no way means they will last forever. If anything physical notes are always going to last longer if kept well. You just never know what could happen in the future 😂 All it would take is a massive solar flare or global crisis and the digital world we live in is gone. The digital world isnt as failsafe as many believe. Of course its very unlikely. But just thought id raise that point. Paper will always outlast digital at least in the sense that digital can fail. Still great to be able to digitize notes for the utility of it though ✌️

[@JuJoPiSan]

Hi! Any thoughts on privacy regarding some of those personal notes/images being OCRed by GPT? Where are they stored (whose servers) and who else, besides me, can access them? Thanks!

[@ServantStatusMinistries]

I would not consider scanning private notes because ChatGPT is designed to take whatever has been scanned or collected by it and use it to answer other peoples questions which would likely mean that they keep that information on their server

[@JuJoPiSan]

@@ServantStatusMinistries Thanks!

[@ServantStatusMinistries]

@@JuJoPiSan You're very welcome!

[@PTewogbola]

@juanpineiro2911 If you’re using the paid version of ChatGPT, you can also change your settings such that your chats aren’t used to train the model

[@JuJoPiSan]

@@PTewogbola Awesome. Thanks!

[@Xzous221]

Good stuff! Sadly, I think it is limited to text only and won’t capture drawings so it has to be done manually.

[@aldenfalkofficial]

awesome tip, im gonna try this with my old bullet journals =)

[@Ataraxia1]

Wow, you jsut saved me a bunch of time, thanks!! I am just passing my old notepads to digital.

[@jasontheflynn]

I've been able to do 3-4 pages at a time with no problem. I write in all caps handwriting, and I have to tell it "transcribe to regular case" and it does it perfectly usually

[@manyasoni2312]

Very helpful ❤ and real advice it works for me thank you

[@FitblkmanMr]

Rocket book is great as well

[@wakeuptoreality20231]

Is our data then used to train Chatgpt further?

[@hadiuzzaman]

Great.............Very helpful video.

[@boukmananddessalines5522]

Thanks. I learned something new.

[@leatherwiz]

Man, thanks for the tipp, I just tried this.... it's amazing.....and scary at the same time.

[@Nerdytimhieu]

thank you this is so much help full

[@andrewwalsh1430]

Bro this is gold. Thank you

[@monochromios]

Alternatively, you can use an e-ink tablet as Supernote A5x and A6x2 🤓

[@alpha12th]

I can't upload photos with note to the ChatGPT 3.5.

[@joanneyoung8590]

Neither can I. :(

[@Gazzaroo]

Major fricking omission in this guide. Wasted my time Chatgpt please advise on a decent youtuber to follow who can give me accurate advice on how to use you

[@acdnintheusa]

Thanks Tiago. I’m a small caps writer. iOS does horribly with it. I’ll give ChatGPT a go. Perhaps I have to include my writing style in my prompt.

[@kendrewreviews]

Interesting but it gives Big Tech (and thus Government, Digital Agencies, or Private Investigators) access to anything we have written: health records, financial records, personal journals, ect. This tech would be great for non-sensitive work related stuff, but NOT personal.

[@impulsesystems]

Agreed. That was my first thought: why would I share these notes with unknown readers?

[@ficarbs_official]

There’s the temporary chat option that doesn’t keep the history. Have you tried that?

[@JustGotALife]

@@ficarbs_official love you're naive to believe it doesn't collect the data

[@stewarthunt3563]

thanks for that - i will try it

[@JacanaProductions]

What is the state of this in Oct 2024 with the new OpenAI models - presume it's got better or is the vision model still the same?

[@ayanleyusuf4733]

I cant upload pics on the app😢? Doesn’t someone have the same problem

[@sandycover]

V useful, thanks. However, the Nuwa pen might be the solution (though expensive), since it records handwriting on any paper, from a notebook to a scrap of paper (i.e. it doesn't have to be in a dedicated notebook) and uploads it digitally. it's to become available later this year.

[@jasonchapman6318]

But have you used it - all of the digi recording pens I have tried have been bulky and poor. I saw this one, but didn't pull the trigger and go-fund as I have spend hundreds of GBP over the years.

[@rhintzen]

Is this a payed feature for ChatGPT4? Do I need to get Plus? I don't see where you can upload the picture?

[@CaressenceTm]

Great idea but it doesn't work on paid feature either

[@Sjk123001]

HELP Downloaded ChatGPT, can’t find Vision. Found reference to you digitising notes. Doesn’t work. Do I need to buy GPT+ ?

[@carinaverakinsman]

Love this!! I currently have the free 3.5 version of Chat GPT, and a Samsung phone. Will it work for me, or is it only for IOS and paid Chat GPT? :/

[@lecoleadstefnum]

A second brain: The world's first real one I'm building exocortex. It => takes text, audio, video, image input => remind you to follow up on tasks => automatically organize notes => does research for you => execute tasks Imagine as a developer that you can record a voice note and your Jira board is updated with tasks for your next sprint. Or you're a writer and you take a picture of a scene you want in your novel and you have 10 show not tell storylines ready. Yes you, you're like me. Your mind is oversaturated with ideas. Why not dump it on your second brain and forget about it. It will give you a breakdown of what you need to do tomorrow. With one click, it gets your idea up and running. Best of all, you will never forget anything cause you never needed to remember, your second brain syncs with your calendar and informs you. Up for a chat?

[@synaesthete]

Interested.

[@brennanhudson2960]

Lets go! HMU

[@AS-Aeros]

Man its for ChatGPT 4 3.5 can't do these! Any alternative solution for this?

[@mariuslevin5785]

I tried using IOS build in camera transcription. It gave me a lot of errors, but then I pasted it into ChatGPT 3.5 from notes and it corrected all the errors. Even in danish. I was impressed.

[@othername2428]

Yep! It's easy... just pay for GTP4. 🤯. It's definitely worth it. And if you don't have $20 extra every month, you have issues and need to get your priorities straight.

[@samanthahaggart5261]

Use Google lens copy to text then paste to word thats what I do

[@arnoldbijlsma7478]

Does that work with hand-written text?

[@oddball_oddity]

I do this too. I use OCR apps available on the google playstore. I got excited with this video, but unfortunately it's only available for Plus, which I can't afford at the moment. OCR apps work just fine, but I have to be mindful and use my best handwriting though 😅😅

[@JacanaProductions]

Also can you comment on 1) cost - quite expensive for lots and lots of pages $1 for 50 I've heard so 1000s of journal page entries might get pricey but may still be worth it and 2) uploading all your person data to OpenAI is probably a no go for a lot of folks.

[@sd-1539]

Looks like this is limited to Plus members only?

[@DaarthVader]

Yes, I tried it on my free account. But its says tha GPT Vision is only available for plus members.

[@aspen51481]

How do i connect my notes to the folder structure on my computer for storing artifacts and files that aren’t notes?

[@DaveRider719]

Man it recognize even my shitty hand written words and letters. Awesome

[@missions4life377]

What's another option since this does not work for average person?

[@RonLWilson]

Hopefully soon they will able to digitize drawings as well.

[@DebbieKatzav]

What languages does this work in?

[@vavu1503]

Being a maths teacher, i have never seen a perfect app to convert handwritten maths calculus equations to text like this. Is there any way to do that. I am taking about calculus, matrices like equations. This one is good for normal note taking

[@petercinque1421]

MathPix uses ML to do this. Very good.

[@vavu1503]

@@petercinque1421 Thank you so much

[@globalislamicreminders]

We can not upload photos

[@anaykulkarni9932]

How to subscribe chatgpt.....I am having problems of declining my debit card multiple times 😭

[@ioanac7256]

it did not work with my notes; it saw the photo of the notes as an image

[@jeffhallum]

Options not available -- iPhone -- latest IOS -- latest ChatGPT

[@liush12]

Is this for paid chatgpt version only?

[@DaarthVader]

Yes

[@chanyoung3725]

Pretty cool but privacy is important so I’ll stick to the good old Moleskine.

[@MarkSaenz]

I want to ditch pen and paper all together. Is there a digital notebook that works with ChatGPT? Maybe Remarkable to ChatGPT?

[@DanielKirillov-iv3ww]

It’s gonna take 1000 years

[@mansolof]

Yeah right?

[@kevinhuxley9252]

❤️

[@Ninja_Samurai-dd3kq]

is it free or paid?

[@muratgoldybiz]

Did not work with my handwriting

[@Jianfa88Tsai]

Average person can write 20 words per minute. If you spend 2 hours writing continuously per day without breaks, that’s 2,400 handwritten words per day. If you write for 88 years till your last breath, that’s 211,000+ words. You can fill an A4 page with 150 words. You need at least 1400+ pages per lifetime. That’s seven 200 page notebook. However you might write significantly more during retirement, give up halfway, or unexpectedly pass away. Life is unpredictable. Ten 200 page notebooks don’t take up a lot of storage space.

[@alyssajennings8668]

You forgot that there are 365 days in a year... 211,000 words is only 2 hours a year. If you wrote for 2 hours every day for 88 years, you would have 77,088,000 words. Or 2,570 200-page A4 notebooks.

[@gurujollu6217]

20 words per min 20 words * 120 mins (2hrs) 2400 words / 1 day 2400 x 365 days = 876k 876k a year Let says u started at 20 and died at 90, that's 70 years That's 61.3 mikl

[@steveohlawrow3854]

To add to the context, I print at ≈30 wpm, with cursive even faster. And I'd estimate 150 words per page if you skipped lines. A college-ruled sheet for myself is usually 350 wpp.

[@FBombinHornFan]

It’s not the space things take up, it’s being able to search for something contained in the notes.

[@rozy2cool]

​@@FBombinHornFanexactly this

[@CHEDDARANDWAFFLES]

oh man this just saved me $200 by not having to buy a digital pen

[@aniokay]

The only beef I have with this is the amount of energy consumption the AI servers are gonna have if we all decide to do our digitalization through chat-gpt....

[@jayl271322]

Yeah, no it can’t think. It can pattern match or predict.

[@vaishnaviudamale9461]

Chatgpt doesn't do this anymore because it's violates its usage rights

[@Justgoodvids]

Cool but not brand new

[@WillPower311]

Too much ai

[@MichalPiechocki89]

It simply doesn’t work. Gpt just makes a rubbish transcription…

[@davidwalker575]

Ridiculous. This is not a game changer, this level of accuracy has been available to the average person for over five years. It does know better than Google docs and has an abysmal user experience

[@tbc_2024]

This sounds very good. So what about privacy of your information that is now in ChatGPT? Did you just give away your IP?