5 Steps to Build Your Own LLM Classification System

Want to get started with freelancing? Let me help: www.datalumina...
Need help with a project? Work with me: www.datalumina...
🔗 GitHub Gist
gist.github.co...
👋🏻 About Me
Hi there! I'm Dave, an AI Engineer and the founder of Datalumina. On this channel, I share practical coding tutorials to help you become better at building intelligent systems. If you're interested in that, consider subscribing!

[@avidlearner8117]

Maaaaaan.... You have THE BEST content, HANDS DOWN, for Gen AI Development. Clear, concise, every step explained, context.... Context is key... Bravo! And thanks a lot for this, it's inspiring.

[@daveebbelaar]

Wow, thanks!

[@IdPreferNot1]

Such great content. I was going to gist this and then i see that's even how you're sharing it! I wanted to get a use case for Instructor library as looked interesting, but wasnt sure what it added beyond pydantic. ... and here it is. Thanks!

[@HerroEverynyan]

So cool that you make such great content, with clear explanations, and are so transparent

[@daveebbelaar]

I appreciate that!

[@farhanafridi8694]

Great! would love to see more of these.

[@mamadou-diandjalo6723]

This is exactly what i needed ! Thanks !!

[@jeromedupourque6067]

Congratulations this is just perfect!

[@volt8399]

You did an amazin job, thank you so much for sharing this.

[@nexuslux]

Excellent video. Can you go into a bit more detail of how a database of this type of information might look and operate. Or any type of automation that would be involved? You mentioned sentiment or you mentioned doing analytics

[@lesptitsoiseaux]

You have 50 000 classes transcripts you need to do a recommendation engine. Best approach?

[@MuhammadFaizanMumtaz3]

great yar bhoat zbrdst.

[@guilhermeveiga9345]

Good tip thnkss

[@sumitbindra]

Loved the content. What are the advantages of using this instead of function calling?

[@daveebbelaar]

@@sumitbindra streamlines prompt engineering, less code, and auto retries.

[@sumitbindra]

@@daveebbelaar makes sense. thank you

[@synergyai]

How do you deal with the objections of sending this 'sensitive' data to OpenAI? We are doing a project now where we have to clean the data before sending it to openAI which is a big challenge. Curious to hear other people thoughts on this...

[@daveebbelaar]

We use Azure OpenAI. Clients are generally okay with that in our experience.

[@AbdulBasit-ff6tq]

Why don't you just just use the json response from openai directly?

[@daveebbelaar]

This unifies your data structures without relying on prompt engineering. You still have to provide a JSON schema when using the JSON response with OpenAI, and there is also no automated retry mechanism if it fails to load your Pydantic model afterwards. Overall, this streamlines the development experience, especially if you're working with multiple developers who might all have slightly different prompting styles for JSON. Instructor uses the JSON response and Function Calling under the hood.

[@AbdulBasit-ff6tq]

@@daveebbelaar How good or bad this solution is compared to other alternatives like langchain and llamaimdex output parsers?

[@avidlearner8117]

@@AbdulBasit-ff6tq I don't think it's related.

[@erenyeager655]

combined it with fastapi to transform it to an endpoint and call in the frontend side ooooofff... faster development for machine learning web system

[@jppalmab]

Gold