Chat GPT's Biggest Weakness - a Danger

[@aseprohmawan1341]

One of the biggest weaknesses of models like ChatGPT is their limitation in understanding highly complex contexts or emotional nuances in conversations. While they possess a good grasp of language, they can sometimes provide responses that are inaccurate or irrelevant if the information provided by the user is not clear enough.

[@LearningandTechnology]

@@aseprohmawan1341 agreed - they are synthesis tools and that is definitely more “machine” than human. While they continue to evolve- they aren’t there yet.

[@moodberry]

I am a tech teacher (retired) like you. I agree with the citations issue. But I think the best way to solve it would be to have the AI embed its citations in the invisible metadata. I think this would put a "fingerprint" on the data it retrieves, and allow those who care to look to find the original sources. It is kind of like what is done with photos now, where you can see the photo's attributes, like the GPS coordinates of where it is taken, when it was taken, any mods to the original photo, etc. But another issue with AI are the royalties due to the original (human) authors when an AI "rips off" intellectual properties.

[@digitalincometactics9858]

Caution and common sense too!

[@davidderidder2667]

Your statement at 3:10 is not true sir. Chat GPT can tell you what sources it uses.

[@LearningandTechnology]

If you ask it upfront to provide references it... sort of does. Some checking has revealed that those sources are not always correct (or even exist). In the video, I clearly ask it to cite references following an answer and it clearly responds that it cannot. You can see this in the video beyond the 3:10 mark.

[@LearningandTechnology]

Don't take my word for it though - watch the video - or ask ChatGPT itself, Here's what I just input: ME: Can chatGPT provide accurate citations for the answers it provides No, ChatGPT does not provide citations for its answers.

[@davidderidder2667]

@@LearningandTechnology I understand and you and I are both right. Chat GPT is not fully consistent yet. I noticed that arguing with the engine suddenly opens op insight into citations. Try it out.

[@LearningandTechnology]

@@davidderidder2667 it’s certainly an adventure! I’ve gotten some hilarious and frightening results. I’m confident it will evolve and be useful.

[@davidderidder2667]

@@LearningandTechnology haha indeed. We need Governance around AI. Wish I could help define that.

[@ihelpcafe4555]

I have used chatgpt (in preparation to present to my teachers) to write a paper and site it in MLA with 5 sources and it has correctly done this. I believe your assumption that it cannot site has been limited by the input of the request or the way in which you made that request. You might want to try again.

[@LearningandTechnology]

In the demo you can see that I’m asking a question and then requesting sources afterwards. This is where it fails. However, I will also try to add “with citations” to my prompt and see how it handles this.

[@LearningandTechnology]

VERY interesting results! I changed the prompt to: "Write a 300 word summary of which US Political Party has been best for the US economy while in office with APA citations" It still began with the "Difficult to say" phraseology, but it did reference some studies in this case. It did not perform the same analysis as it did without the citation request - it basically said it was hard to say and then provided three studies that discuss the subject. This brings up a very important aspect in relation to ChatGPT and education - which is something we have done for years and need to revisit: Learn how to ask the right questions! Thank you for your comment - it illuminates an aspect that I think is important. To further test - I also prompted ChatGPT after the response with studies - I asked it: "Can you provide citations for your previous answer" the reposne was: "I apologize, in my previous answer I provided references for studies that compared the economic performance of different political parties, but these studies were not factual and were based on the perspective of the think tanks that conducted them. Therefore, I cannot provide citations for my previous answer as it was based on hypothetical studies and not on factual evidence..."

[@ihelpcafe4555]

@@LearningandTechnology That’s interesting I did MLA I guess maybe I need to do more tries because it did it on the first try then I stopped. It is definitely a very interesting topic and I’m curious where it’s going. Thank you for the reply.

[@heatherbrown6836]

@@LearningandTechnology When I used ChatGPT and asked for citations be included in the response, it do so but when I checked the citations in Google, NONE of the so called references it cited were real. They did not exist. So yes, we need to LEARN HOW TO ASK THE RIGHT QUESTIONS! :)

[@LearningandTechnology]

@@heatherbrown6836 wow! That is really interesting!

[@crimedogs]

Super sketchy for opinion based questions! Also you background is VERY intriguing. . . .I feel like there is an easter egg in there?. . . 🤣

[@LearningandTechnology]

Haha! I do plant different elements to make things exciting. There are a couple of special items - and there is indeed and “Easter egg” - which I need to make sure I update! (That was a clue)

[@internetcultured]

Great video

[@LearningandTechnology]

Thanks!

[@jason-us8pc]

It is the progression of IT, remember we have IOT that is also doing something that was not possible a generation ago?

[@LearningandTechnology]

It is definitely the future - but the lack of traceability remains.

[@kishoreahmed]

Can we say again this is a search engine?

[@LearningandTechnology]

It’s beyond a search engine because it uses machine learning to create results based on the prompts provided. For example, it for a script to deploy a virtual machine - it doesn’t search for one - it creates one.

[@aeonturnip2]

As yet, it's not a great search engine, as it hasn't been allowed access to the internet, so it can't return up-to-date web addresses. If/when OpenAI do allow it internet access, then it could be a search engine. Google's ranking algorithm is what makes it so good at being a search algorithm, which works on how many sites point to the pages it returns. ChatGPT doesn't do this (yet) so it's really providing only one answer, rather than a list of possible answers as Google does.

[@nourelislamlounis3328]

100%