ChatGPT can do what? Goodbye Stack Overflow...

ChatGPT has shown to do some amazing things, including helping code. But can it replace stackoverflow? In this video we put it to the test and see if how it compares to stackoverflow answers to python coding questions.
Timeline:
00:00 Intro
01:21 Question 1
03:18 Question 2
05:18 Question 3
Follow me on twitch for live coding streams: / medallionstallion_
* KZbin: youtube.com/@robmulla?sub_con...
* Discord: / discord
* Twitch: / medallionstallion_
* Twitter: / rob_mulla
* Kaggle: www.kaggle.com/robikscube
My other videos:
Speed Up Your Pandas Code: • Make Your Pandas Code ...
Speed up Pandas Code: • Make Your Pandas Code ...
Intro to Pandas video: • A Gentle Introduction ...
Exploratory Data Analysis Video: • Exploratory Data Analy...
Working with Audio data in Python: • Audio Data Processing ...
#chatgpt #stackoverflow #coding #python

[@mosesnandi]

You forgot to mention that in ChatGPT you can hit "Try again" and it will generate another response. You can basically do unlimited "Try again" and each time you will get a variation of the original response which sometimes is what you're looking for. For one specific scenario I went up to 30 times hitting Try again.

[@robmulla]

This is a great point. You are able to refresh the result until you find something you are happy with, however if you are searching for something and you don't know the correct answer you might not know when to refresh.

[@mosesnandi]

@@robmulla Also it keeps a record of all those tries per session

[@seanzhang3873]

@@robmulla one note is that, if you get an error message, just copy the error message and ask GPT to solve it for you. Usually the second time it would make it work, and explain why it is giving that error message. I am literally writing a python code with the help of chatGPT, and yes it often give you code that just not work, but if you keep asking, it will eventually get it right.

[@bane2256]

Can’t imagine what this will be like 10 years from now. Interesting times

[@robmulla]

Absolutely! So many things have come out recently that I didn’t even believe would be possible a year ago. 10 years from now is going to be 🤯.

[@hussamcheema]

May be not this version but the future version of ChatGPT would definitely replace a lot of websites/technologies.

[@robmulla]

I agree. It's only going to get better with time.

[@gc2161]

The most annoying thing I encountered on stack overflow is when someone shows a solution much more complicated than it should be. Like showing off.

[@robmulla]

I can relate. But I think for the most part the best responses get more upvotes. What annoys me is that the most voted solution can be way far down in the list.

[@CaribouDataScience]

ChatGPT correctly answered my question on how to extract the date from a datetime field.

[@robmulla]

Focused questions like that it is amazing at answering well. But is it just using stackoverflow to find the answers? Would it work so well if we stop having human answered solutions like we currently do?

[@CaribouDataScience]

@@robmulla It also wrote code in Fortran and assembler to calculate median values.

[@robmulla]

@@CaribouDataScience very cool!

[@paulkiragu8120]

I've written some pretty sophisticated code with chatgpt. What I've realised is once you get wrong code, you can tell it to correct it and it does it perfectly.

[@robmulla]

Thats an excellent idea. I haven't told it explicitly to fix things but it's cool that it works!

[@paulkiragu8120]

@@robmulla I realised this when I replaced my code with the code it generated and didn't save. I ad to modify it until it worked 😂 and it worked lile a charm. I think chatgpt is better for writing and debugging code than stack will ever be. Though in some instances we would need stackoverflow for help

[@arda3420]

Hi Rob. Great video once again. Will you be able to stream this weekend or next week?

[@robmulla]

He Arda. Thanks for asking. It's been a busy couple of weeks for me but I hope to return to streaming this week. We shall see. Connect on discord for more updates!

[@arda3420]

@@robmulla can you link your discord?

[@robmulla]

@@arda3420 Discord link: discord.gg/KUuTvv3w8R

[@QuarktaschemitSenf]

Yesterday i asked ChatGPT3 to build a python program with a tkinter gui that can merge pdfs. Take a guess what i had 30 seconds later? A working pdf-merger :-). This shit is insane, although when you ask it for more complex stuff , you often run into network errors or the AI just crashing

[@robmulla]

It is pretty amazing, isn't it!

[@peeturpain9379]

thanks for another idea for chatgpt to build me for my github :D

[@antcastan]

Both are very good tools. I have been using Stack Overflow for many years and it is still very useful and now I am using ChatGPT and it very helpful too so I thing both will prevail and both are going to be very useful now and in the future.

[@robmulla]

Thanks for sharing. I think gpt bots will be good. But only if we continue to provide it good training data.

[@bastooopanooo2311]

The main issue is the admins themselves. That's why people prefer ChatGPT over Stack Overflow. Even before ChatGPT, every time you posted a question, there would be a moderator flagging to close it just to gain more reputation. I'm glad I don't have to rely on and beg for help on Stack Overflow anymore.

[@ekaterinavalinakova2643]

ChatGPT may not be perfect, but you can ask a question without worrying about toxicity. But... there are still major limits that need to be overcome. It's not bad for getting something that points in the right direction. But it keeps bungling my requests for help on procedural generation. It gets some things right but misunderstands other parts of my question. It's not great on complex questions. Maybe ChatGPT 4 or 5 might be different.

[@robmulla]

Totally agree. Thanks for watching!

[@AustinMark]

Its speed and breadth of knowledge is impressive but when you look at the details chatgpt is more like letting some overconfident stranger take over your nuanced thinking. Its great for getting ideas but a lot of its code doesn’t actually work , it just looks impressive because it spits it out so fast and interactively.

[@robmulla]

Yea, that's my take too at least at this point. I'd think it's only going to get better though. We shall see..

[@peeturpain9379]

True, Ive tried to make it train many neural network models and often it gets them wrong usually with the shapes of the tensors.

[@ibowman_UCLA_BRAIN]

Another problem with ChatGPT answers: no bass guitar in background.

[@robmulla]

That's my biggest criticism of most AI. Needs more bass.

[@ElliottBrun]

probably not goodbye, given chat gpt scrapes sites like stack overflow for coding responses

[@robmulla]

This is a great point. ChatGPT relies on sites with good text to train. If people stop writing on those sites then chatgpt will just get worse with time

[@jasonsykes8244]

I think it just killed google search also.

[@jasonsykes8244]

This is the difference though. If you can guide chatgpt with dialog. You can get great results. It doesn't do well with one offs. I actually used it, with guidance, to build a full stack web blog. That used django and nextjs. It even optimized it for performance. But you have to have some understanding of what your looking for.

[@robmulla]

Totally. If you know what you're doing and just want chatGPT to give you a quick solution or help you improve your existing code it's really great for that. It will just become better with time too!

[@gambaweb]

@@jasonsykes8244 could you share the app, is it public? can we use it?

[@jasonsykes8244]

@@gambaweb It isn't public it was just me having fun with chatgpt

[@moviemusicmash4899]

How long did it take for you to get those answers or find those answers

[@robmulla]

First try

[@swiatlowiekuiste]

How long before chatgpt becomes a paid subscription?

[@robmulla]

I think they've already created a paid version. But bing is going to have it soon too, so I'm not sure.

[@swiatlowiekuiste]

@@robmulla Normal greedy way of doing things is to wait for everybody to become dependent on the AI and then limit greatly the capabilities of the free version or remove it entirely, but that could not be the case if competition catches up.

[@bazoo513]

Yeah, while, in my experience, all kinds of ChatGPT answers are often incorrect (but sound reasonable), human answers on StackOverflow are usually correct, but very often useless, as users write answers to what they (think they) know, not what the question actually asked. User's discretion is advised in both cases, of course 😀 ChatGPT will give correct answers to textbook question (e.g. "Give me C code for Heapsort algorithm with explanation"), but we must remember that is is just a _language_ model; it does not "understand" the subject matter and is not "creative".

[@robmulla]

True. Also chatGPT is always confident sounding in its answers even when wrong. Leading to a false sense of certainty.

[@bazoo513]

@@robmulla Exactly, As OpenAI guys state that they appreciate feedback, I try to always provide it. but it is sometimes genuinely funny how ChatGPT "improvises" like a bright student in literature class who did not read assigned novel. For example, for a relationship within a series of novels, it will pluck out proper characters and put them into common, but incorrect relationships.

[@jeremiahsherrill]

Also ChatGPT is not rude, arrogant and condescending.

[@robmulla]

Unless you ask it to be.

[@raymondhill5099]

Stackoverflow should be worried, they could survive this by implementing the technology on their website so programmers still have a reason to use it. Else in the coming years, ChatGPT will be so good that websites like stackoverflow would be irrelevant.

[@robmulla]

You could be right. Although would chatGPT exist if it didn't have sites like stack overflow to scrape?

[@user-xedwsg]

Thats not the point, the point is that chatGPT does exist. and It exists now...STack is dead. @@robmulla

[@AFuller2020]

You don’t have the rude jerks like Stack.

[@masteronepiece6559]

It will be canceled like any great idea and used under the hood later.

[@robmulla]

Maybe. What do you mean by used under the hood?

[@arunachalpradesh399]

@@robmulla it means goverment or the programmer who made will only use it for their own benefits. they will create new business ideas, weapons, predict things, etc.

[@moviemusicmash4899]

I notice everyone complains about stack overflow toxicity and not the answers.

[@robmulla]

Truth

[@user-xedwsg]

but thats enough to not use it. GPT is a guide and pleasent one

[@AtticusDenzil]

A lot of Stackoverflow answers don't make any sense either.

[@robmulla]

True

[@gc2161]

Yes