5 Steps to Build Your Own LLM Classification System

[@avidlearner8117]

Maaaaaan.... You have THE BEST content, HANDS DOWN, for Gen AI Development. Clear, concise, every step explained, context.... Context is key... Bravo! And thanks a lot for this, it's inspiring.

[@daveebbelaar]

Wow, thanks!

[@kenchang3456]

This timely for me and brilliant, just what I need. Thank you very much!

[@mksmurff]

Very clear and real-world example too. Thank you

[@farhanafridi8694]

Great! would love to see more of these.

[@HerroEverynyan]

So cool that you make such great content, with clear explanations, and are so transparent

[@daveebbelaar]

I appreciate that!

[@IdPreferNot1]

Such great content. I was going to gist this and then i see that's even how you're sharing it! I wanted to get a use case for Instructor library as looked interesting, but wasnt sure what it added beyond pydantic. ... and here it is. Thanks!

[@nexuslux]

Excellent video. Can you go into a bit more detail of how a database of this type of information might look and operate. Or any type of automation that would be involved? You mentioned sentiment or you mentioned doing analytics

[@mamadou-diandjalo6723]

This is exactly what i needed ! Thanks !!

[@jeromedupourque6067]

Congratulations this is just perfect!

[@volt8399]

You did an amazin job, thank you so much for sharing this.

[@MuhammadFaizanMumtaz3]

great yar bhoat zbrdst.

[@batigol_9]

I tried following your script and I downloaded pip install -U instructor but I keep getting no module found instructor, have you faced this kind of errors any thoughts?

[@lesptitsoiseaux]

You have 50 000 classes transcripts you need to do a recommendation engine. Best approach?

[@sumitbindra]

Loved the content. What are the advantages of using this instead of function calling?

[@daveebbelaar]

@@sumitbindra streamlines prompt engineering, less code, and auto retries.

[@sumitbindra]

@@daveebbelaar makes sense. thank you

[@synergyai]

How do you deal with the objections of sending this 'sensitive' data to OpenAI? We are doing a project now where we have to clean the data before sending it to openAI which is a big challenge. Curious to hear other people thoughts on this...

[@daveebbelaar]

We use Azure OpenAI. Clients are generally okay with that in our experience.

[@JasperPeters]

Azure OpenAI at least claims the data sent is not stored or used by Microsoft, OpenAI or any other third party. Claims is an important word if you really care, but it’s better than nothing.

[@guilhermeveiga9345]

Good tip thnkss

[@jppalmab]

Gold

[@erenyeager655]

combined it with fastapi to transform it to an endpoint and call in the frontend side ooooofff... faster development for machine learning web system

[@AbdulBasit-ff6tq]

Why don't you just just use the json response from openai directly?

[@daveebbelaar]

This unifies your data structures without relying on prompt engineering. You still have to provide a JSON schema when using the JSON response with OpenAI, and there is also no automated retry mechanism if it fails to load your Pydantic model afterwards. Overall, this streamlines the development experience, especially if you're working with multiple developers who might all have slightly different prompting styles for JSON. Instructor uses the JSON response and Function Calling under the hood.

[@AbdulBasit-ff6tq]

@@daveebbelaar How good or bad this solution is compared to other alternatives like langchain and llamaimdex output parsers?

[@avidlearner8117]

@@AbdulBasit-ff6tq I don't think it's related.