Testing the Context Window of ChatGPT

[@WesGPT]

If you liked this video, you might like to know that ChatGPT is worse than before: kzbin.info/www/bejne/l2rZhoGfjJuHqMk

[@omingole7304]

Isn't context window the number of words in a prompt? Isn't it different from memory? (I am new to all this stuff)

[@WesGPT]

Kind of. Context window is basically how much the GPT model can remember from past conversations. So, in a ChatGPT conversation, context window means how far back in the chat the model is still getting information. My most recent test blew our past results out of the water. So much so that context window length isn't really a problem anymore. You can watch it here: kzbin.info/www/bejne/hYuVoYd8irR2etU

[@_sudipidus_]

I actually wanted to try this and did a quick google search and your video came up.. With new gemini model supporting up to 1M, I am amazed to realize how fast things are progressing

[@WesGPT]

Yeah, it's so crazy! This video is an old one though and we were actually able to hit the context window limit for the newest model. Check it out here: kzbin.info/www/bejne/hYuVoYd8irR2etU

[@estrangeiroemtodaparte]

Just experimented this with the latest update of ChatGPT, and it appears to have significantly expanded its context window capacity, potentially handling over 30,000 tokens now!

[@WesGPT]

Oh no way! That's amazing 💯 I literally tested this yesterday so the newest update must have changed things.

[@estrangeiroemtodaparte]

@@WesGPT Indeed, bro. Pretty amazing. This happens on the chatgpt-4 "all tools", where everything gets united into one. If you don't have it yet, you should pretty soon. For me it's the best update of them all.

[@WesGPT]

Ahh I see. Yeah, my GPT-4 still lists all of the tools (Browse with Bing, Plugins, DALL-E 3) so I don't have that feature yet. But so excited for this update. I hope I get it soon too 🤞

[@WesGPT]

​@@SW-fh7he 100% agree! It's so funny - I tested the context window and then THAT MORNING we got the DevDay update that this is changing. Great timing lol I'll test the new one once I get access to it (still not updated for me)

[@WesGPT]

@@SW-fh7he I'm super curious too. Let's hope it's MUCH larger.

[@coffeblock]

That is so true, it also just simple not tell you the full code... It is really hard to let ChatGPT to tell you.

[@WesGPT]

It should tell you about anything you ask it!

[@coffeblock]

@@WesGPT It is really hard to let ChatGPT tell me the full code when it is long. I need to ask multiple times (maybe because it is 3.5?)

[@WesGPT]

@@coffeblock Yeah, exactly. This is the problem with the old context window. But I'm hearing that the new update has increased the context window to 32k! I'll test it out in a video once released :)

[@coffeblock]

@@WesGPTOk, I will make sure to watch that.

[@WesGPT]

@@coffeblock Just tested the context window of the new ChatGPT-4-Turbo model. It's LARGE. Watch here: kzbin.info/www/bejne/f53Una2gj7eSiqc

[@ShowierData9978]

i have 1 thing: MemGPT

[@WesGPT]

You should make this as a CustomGPT in the next update!

[@ManiSaintVictor]

Time to set up MemGPT. I just tried the test and mine forgot the code word at about 39k. How is MemGPT working for you?

[@WesGPT]

@@ManiSaintVictor What is MemGPT? Is it a Custom GPT that you made within ChatGPT?

[@JaredQueiroz]

yup, but the context was allways 8k.... 4k of yours, 4k of responses.... ( or whatever the proportion for this might be......) But I just got the new update and broh.... you would get tired doing this XD Tho I don't know if they are using the turbo 100k tokens..... not yet for the chat gpt..... But the 32K model that us bare mortals allways dreamed of is there for us to use, yaay But imagine 100 fucking K of context window...... Programers woudn't need to do nothing anymore XD

[@WesGPT]

Dude, I know. 100k context window would be absolutely INSANE. Any app or game you could ever dream of, you could code...