LangSmith Tutorial - LLM Evaluation for Beginners

[@daveebbelaar]

🔐 Copy my AI tools & workflows: bit.ly/data-alchemy

[@Breaking_Bold]

Excellent!!!! Good start …got me hooked and watched the complete video!!!

[@bextuychiyev7435]

It is clear that you have a very organized mind - the video is crisp and neat. Great to have as a creator! I am actually watching this to write a tutorial on LangSmith for DataCamp blog.

[@daveebbelaar]

That's an awesome compliment :)

[@PorTierraMaryAirepodcast]

A really nice job. It's really hard to be updated about all these development, but with each passing week, the gap between us and those who do not want to take advantage of these opportunities is widening

[@daveebbelaar]

Thanks! And I know. It's crazy and a little overwhelming ;)

[@arkosnatoneogy2366]

cool tutorial. something i am finding a little fishy is how they use an LLM to evaluate the output of an LLM. is this objective? what if both the generator and evaluator suffer from the same biases?

[@kevon217]

I was literally searching for LangSmith tutorials and got your notification of this vid. Such a godsend!

[@orlandocastellanos9263]

I saw your video about deploying a Slack assistant on Azure, I loved it, but how can we deploy a vector database to have an assistant and memory?

[@Lirim_K]

Nice beginner tutorial. So how do I set up LangSmith?

[@lagendijkict]

You need to make an account and login. After logging in you can generate an API Key and copy your project name. With those you can make the connection.

[@ahmedmusawir]

Thank you, my friend ... this is awesome!

[@pradyumagarwal3978]

can i use these langsmith tools for evaluating models from hugging face instead of openAI

[@TurtlesAllTheWAy]

yes I have the same question- im using ollama

[@AlonAvramson]

Thank you! very informative and clear, and just in time. Is there also a way to evaluate using QAEgn and QAEval chains in Langchain?

[@user-wr4yl7tx3w]

only thing i noticed is that the website doesn't update even after running the code multiple times to reflect the new traces. may be langsmith is still under beta.

[@Mike.G97]

Did you use any vscode extension to generate those code comments in your file or?

[@JJaitley]

How to get access to Langsmith? What about the data privacy of the client? Can we have this on-prem for data privacy and security purposes? Any response to questions will be highly appreciated.

[@daveebbelaar]

You can sign up for the beta waitlist. For data privacy, please refer to this section in the docs: docs.smith.langchain.com/organizations#my-team-deals-with-sensitive-data-that-cannot-be-logged-how-can-i-ensure-that-only-my-team-can-access-it

[@kanchansenlaskar4139]

@@daveebbelaar That is not the full answer. The question is about data privacy from Langchain. Is there a way to have this on-prem, so that langchain cannot see my data?

[@akbarjos-c5s]

amazing tutorial

[@sorin9597]

Fantastic guide, thank you

[@daveebbelaar]

Thank you! 🙏🏻

[@TurtlesAllTheWAy]

dang, there still isn't a way to connect Ollama instead of an openai key at time of writing. if someone has figured out before this has been made very available and you see this- please enlighten us!

[@vasioknow5638]

How can I integrate a pdf file to a chat gpt in python ( I want ai to use information from my pdf )

[@DANNYEL20122]

Learn langchain

[@TurtlesAllTheWAy]

I sucesffully followed this tutorial kzbin.info/www/bejne/fHWln6yAqsSBmsksi=lDSkJceNIqAkbGBe

[@ruslansultanov7646]

Great job. How you ran you code from .py in Jupyter? I can't find hot keys for this.

[@ruslansultanov7646]

kzbin.info/www/bejne/sKbPeICPnJWpbLc😀

[@Divy91311]

Hey Dave , really nice video! I was wondering if I could help you edit your videos and also make a highly engaging Thumbnail which will help your video to reach to a wider audience .

[@AmandeepSingh-bx9pj]

Hi, can I get an invite code for Langsmith?

[@masked00000]

The video is well presented but is not clear for someone who is totally new, As a beginner, I would want to see each step by step implementation and not a high level generic on Langsmith

[@rakeshkumar-pf6yu]

I m sorry to say..but you don't know how to teach bro...

[@daveebbelaar]

Why do you think so?

[@benzhu2438]

I wholeheartedly agree... skipped over so many basic steps so really isn't a "beginner tutorial." I wish I could get back the time I wasted listening to him

[@Ionex21]

Hey Dave , really nice video! I was wondering if I could help you edit your videos and also make a highly engaging Thumbnail which will help your video to reach to a wider audience .