I have a separate video that already goes into those details

I'm using whatever the defaults are. The point is to show that the average person that comes across AI and tries to get help might run into issues. It's especially troubling when the built-in version in Studio isn't accurate either.

i know this isn't your point but o1-preview and o1-mini get this wrong too

exactly what you wrote. If you have no clue what you're trying to do you're in for a ride... if you know what you're trying to do and mostly how to do it but want to do it faster you ask the AI exactly what you want and micro-fix it's mistakes yourself, improved my output by at least tenfolds times lol, instead of finishing a project in 2 weeks i can do it in a matter of hours nowadays. and it even handles the documentation part too, it just has to happen as you go otherwise you overwhelm it.

actually goated for math, you can ask it any question in raw format and it always answers correctly, it has only failed me like twice throughout a semester, it's way faster than reading the books themselves and it explains way better and more concise than any book out there even the most advanced concept. like i basically give it an example math formula and it tells me with accuracy what it actually is and how to solve it in the easiest way possible.

But that's the point! If people don't know how it works, they might just blindly trust the results of the AI. The original release of this feature went into detail about how it works.

@@sleitnick1I think people should already have common sense to double check sources online 😅 I understand you’re trying to educate people, it’s sad that you have to do that 😂

It's expected since there's not a lot of Lua and Luau code for it to train on anyway and it doesn't really know what Roblox is when compared to JS, C, Python, etc if you feed it the right data it'd be able to do a good job you should try Luau GPT, it's created specifically for Luau and Roblox

@@Kitsune_Dev The average person using AI looking for answers isn't going to know to do that. Also, this isn't a language issue, it's a documentation issue. It clearly has some sense of what "spawn" and "defer" do, but it interprets the documentation incorrectly. This is an AI issue, not a data issue.

@@sleitnick1 that's the "average person's" problem 😂AI is a tool, if the user is not using it correctly then that's their own fault. I don't think you're wrong but I also don't think you're 100% right either, to be fair Roblox Documentation has been pretty bad up until now

@@Kitsune_Dev yeah i agree with you, also javascript and its frameworks is also a good example of not having enough newest code to train on, no matter what you do you will get unusable trash code and it will switch in conventions inbetween answers lol.

@@Kitsune_Dev I agree that AI is a tool. But I gave these models a very simple prompt, and it gave a confident answer. People don't know what they don't know: They might not realize the limitations these models have on the info being asked, and yet the models act as if they're providing truthful data. This is hard to falsify as a user unless you already know the right answer. I think it's good for people to take AI results with a grain of salt, and not as absolute truth. That's the point of this video.