Using ChatGPT with YOUR OWN Data. This is magical. (LangChain OpenAI API)

[@TechLead]

Source code: github.com/techleadhd/chatgpt-retrieval Ace your coding interviews with ex-Google/ex-Facebook training. techinterviewpro.com/

[@bobby9568]

microsoft is going to implement this or has implemented this in Windows

[@swooshdutch3021]

would of been nice if you also skimmed over costs, are there any costs if you only use it on your own data ?

[@santiagomartinez3417]

Finally, no more crypto, we want AI all the time!!!!

[@miknes12345]

the code in github is not the same as in the video. I would really like to see the syntax on line 19 at 9:53, but I can't read it. Can anyone please help and paste it in a response. Thank you so much.

[@AnuragKumar-mn7zu]

When are are going to sell AI course?

[@davidl.e5203]

This is rare. TechLead is actually uploading a useful coding tutorial instead of his opinions.

[@fateriddle14]

His opinions are also useful, when there's no agenda to promote one of his product.

[@paulcleary7437]

I find his opinions entertaining 😅

[@arkadiptabiswas2769]

He forgot "as a millionaire" in the title too ! 😢

[@miknes12345]

@@arkadiptabiswas2769 Yes, it seems it is very much something he builds his self worth on - and that he worked at Google and Facebook, since he finds the need to mention it all the time.

[@rogermoore3147]

There is no ex microsoft ex google ex facebook ex men here too

[@john.10347]

Glad to know I'm not the only one doing this. As a student I've been feeding ChatGPT all my previous course work, its able to answer essay prompts and other homework related tasks in my writing style and or in simmilar formats as if I was the one writing it. I'm able to save alot of time by doing this

[@MacroAnarchy]

Im studying law at the moment and I’m seriously scared about how this will change the legal industry. Honestly could see it replace 90% of lawyering.

[@chrsl3]

Everything that is language based. Many Doctors, programmers, lawyers, writers, ...could be replaced. But the top 5% can do cool stuff with it.

[@zzKirus]

Need the human element... verification, etc.. you're fine.

[@besllu8116]

@@chrsl3 I do not think so. It can replace some jobs like form fillings, data serialization etc. but nothin more. Every case is unique and AI can not know what someone did not teach it. It will always be late behind the needs of the time.

[@MacroAnarchy]

@@besllu8116 I honestly think the opposite is true! 98% of lawyering is knowing all the previous cases, the law & the literature. Only very few cases actually need new arguments, most of it happened before. No lawyer can know all of that simultaneously, but the AI can! I think it will be the better lawyer in the absolut majority of cases.

[@pepelapeux]

Chatgpt passed the cpa exam - it can replace accountants/ CPA too It can't wipe out all our jobs at the same time so keep going and study for the bar exam

[@TheRealTommyR]

This is exactly what I desired to do with my own data, but I haven’t spent any time yet to research and figure out a way to do it. I am glad there is a public way to do it.

[@saadshajy3849]

We created a number of GPT powered personal AI assistants for businesess like law, media industry and pretty much for corporate companies where they can integrate internal corporate resources and data securely to retrieve useful information and save 70% cost

[@RunningBugs]

So after digging into the code, I found that Langchain is actually doing the following things: 1. for all your data, store then in vector storage using embeddings; 2. when you query something, it first did a similarity search in the embeddings database, and find out the files that's related to your question; 3. After finding the related files, it takes all the text of that file, together with a context message: "Use the following pieces of context as the 1st system message to answer the user's question. If you don't know the answer, just say that you don't know, don't try to make up an answer. ---------------- {your text data}". This somehow tells us these points: 1. why it's sometimes not having outside world's information? If the question you asked is not in your document, or if it's not trained on the data for your question, it will return nothing valuable as instructed. 2. Is there a limit on the sizes of your data? Yes, you can't use it with super large files because it's doing a document filtering and it will send all text related to the API server, recently the gpt-3.5-turbo-16k might be the good model to use and it's best the total size of related docs is less than 16k tokens. Which means the best practice would be grouping your data into different topics and try to ensure any query, if responded with similarity search, the total size of returned document is not exceeding the token size limit of the model. I think16k is roughly the size of a 13-15 pages paper. 3. By removing/changing the system message, you might get better results for common sense questions. I really don't like the system messaged by default, since in a playground, asking gpt-3.5-turbo-16k "Who is George Washington?" will give you better answers comparing to the langchain solution with an empty system message. 4. The langchain is using unstructured library (it reports errors when I didn't install it), which means you can not only use txt files, but also pdf files, word files, etc. Haven't tested it out but highly likely support query of multiple pdf files using similar code in the video. So you can put multiple pdfs in a folder, using a directory index creator and ask questions for your papers, I think (haven't tested it out) 5. The langchain not only supports ChatGPT models, but also other models in the chat_models package. Google PALM2 chat is also supported as of Jul 10, 2023, if someone has the key, you can use other models too. While I don't think PALM2 has the common sense knowledge as good as ChatGPT, but I think it is a better language generating model comparing to at least gpt-3.5-turbo-16k , so PALM2 may produce better results on your data and OpenAI's models are better in answering common sense questions after changing the default system message. OpenAI said general access to gpt-4 is starting, and people with history of successful payment using OpenAI API will get the access immediately a few days ago. The access to new developers will be rolled out until end of July. Also I think it's quite cool to be able to use your own data, if you want to create something like an AI assistant, you can always use code to collect current time, user information and put those in a folder, so the assistant will be able to do much more than current ones. Another very cool thing is auto-gpt which works great using gpt-4, gpt-3.5 is not smart enough and behaves much worse than gpt-4. If you asked auto-gpt something, it will be able to google itself and replied with the real time information. Also the example of auto-gpt is cool telling you how it could create a recipe based on the next holiday. Hopefully the access to gpt-4 is coming sooner.

[@me_debankan4178]

I have stored a small pdf of 7 pages to a vector datastore FASS after the text splitting and I have also done embedding , but when I am asking questions outside of the pdf it giving me random wrong answers rather than giving a intelligent response like : "I don't know" or "out of scope" , can you tell me why this is happening?

[@inagrag]

God thanks for this. I hate the way langchain is structured to hide everything. I just want to know what's going on under the hood from documentation 😢

[@DunsDeeDowns]

@@me_debankan4178 no expert here but it sounds like it is 'hallucinating' which means it does not have enough data in its sources. Maybe you can make it also tell you the 'sources' it used for answers to check/debug.

[@EricofPhilly]

For the first question, I would use chat gpt to analyze documents with standards and guidelines. So, when getting an answer, I want to know whether or not it found the answer in the docs or with outside info. In this case, it’s useful to isolate the data it’s using.

[@avatarcybertronics2584]

I saw FractalGPT is the solution for most of these challenges. Unfortunately when u use prompt u randomly lose quality, because prompt affect length, structure and other crucial parts of answer

[@jayhu6075]

This is the way to explain LangChain in the style of TechLead. You nail it. Hopefully more this stuff in the future. Thanks.

[@saadshajy3849]

We created a number of GPT powered personal AI assistants for businesess like law, media industry and pretty much for corporate companies where they can integrate internal corporate resources and data securely to retrieve useful information and save 70% cost

[@sv-hermes]

This dude is not a human! I’ve been following this channel for a while now, and I’ve concluded this today. D’you see how he never expresses any emotions with his face? He’s just a very advanced robot, with an amazing integrated LLM and perfect mechanics (at least facial and torso, cause we never seen him walk). As crazy as it sounds… wow

[@karinakarina]

You think he is using an avatar and AI voice cloning or something, or that he is an actual robot? I am entertaining both theories. 😂

[@sv-hermes]

@@karinakarina i think he’s literally a Robot. But I don’t discard the Avatar thing, well thought! I’m gonna do some solid research and I will update you all, friends. Let’s uncover this!

[@mikescarborough9196]

Technically you are not correct, but you could easily replace him with a good deepfake CGI, and no one would notice the differrence.

[@staceyadams9954]

He feigns condescension really well - a hallmark of "advanced intelligence".

[@imho2278]

His sarcasm...congratulating the smartypants kiddies...is spot on. He's real.

[@e-matesecom]

hours and hours of chatgpt courses... i learned more by watching 5 minutes of your video. congratulations for the clarity and the practical approach👍

[@tacochub4353]

Dude why can't you jsut upload videos like this. This is the best overview of advanced ChatGPT usage compared to the other videos on youtube. Techlead is clearly very skilled with programming.. wish he'd just give in and give us what we want

[@sr9814]

Loved this. I am a Sales guy with zero coding exp. I listen to content like yours to glean some nuggets to better understand the impacts and have meaningful conversations with my customers. Truly helpful content.

[@mowburnt]

Same here. Looking to find ways to sort through the mountains of data to help us spend more time helping people and grow sales in that way

[@powermyapps]

It's not providing the right answers for me. I might need to adjust my data storage. Instead of showing the highest price, it displays the last product's price for "What is the highest price you can see in the data?"

[@adasi008]

By far one of the best ChatGPT video tutorials I've seen on KZbin. Great work

[@saadshajy3849]

We created a number of GPT powered personal AI assistants for businesess like law, media industry and pretty much for corporate companies where they can integrate internal corporate resources and data securely to retrieve useful information and save 70% cost

[@andygilet5538]

Great video. I'm a junior data scientist in Belgium and it's actually helping me for one of my projects. You're totally right when you say that everyone should learn Python. I only learned C and C# during my studies but now that I've learned python I'm using it almost everyday.

[@thetexassaint6571]

Real question: how could knowing Python, or any other language, help a person who has absolutely nothing to do with coding or computers ?

[@RPanda3S]

@@thetexassaint6571 Real question: how could a person have nothing to do with computers? That's insane.

[@snorttroll4379]

Well. Only thing is if you want to make software

[@Hugh_Jurrection]

I'm also in your neck of the woods, as a data analyst. ChatGPT is very useful for sorting data and finding trends, which we use to form hypotheses. As a data scientist (which I started off as), you could in theory use it for all of your data collation, sorting, duplicate removal etc etc.

[@m.h.6494]

Bij welk bedrijf werk je? Ik kom niet vaak mensen van België tegen onder programming tutorials! :D

[@kwabenakorantengasiedu5982]

Caution when trying this out: If your vector store is going to be very large, say it's created out of a 500+ page pdf, it can cause the model to produce responses that are hallucinatory in nature. Meaning, that if you searched your pdf for what the model produced, those responses will not be found within the pdf. I tried this, and that is what I noticed.

[@doyouthinkitsdead]

That sucks. I'm hoping to be able to treat my large pdf as a google search!

[@ZanesFacebook]

Make it use gpt3 instead of 4 and it will stop "reasoning"

[@HenningMoeller]

@@ZanesFacebook How do I do that? Changing from 3.5 to 4?

[@jsnmad]

This one video alone saves so much time. Instead of watching hours of some of the playlists out there. It's better to start here and then go straight to the Langchain docs to work out other use cases. Excellent TechLead.

[@bobbyfong1499]

👋 Hey everyone, if you're encountering the NameError: name 'partition_pdf' is not defined error while running the code, here's a solution that worked for me: This issue seems to be related to a specific version of the unstructured package. Downgrading to version 0.7.12 resolved the problem for me. You can do this by running the following command in your virtual environment: pip install unstructured==0.7.12 Make sure to restart your Python environment or terminal after making this change. Happy coding, and feel free to reach out if you have any questions! 🚀

[@katemariageorge7396]

error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [33 lines of output] Traceback (most recent call last): File "C:\Users\0011GP744\AppData\Roaming\Python\Python312\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in main() File "C:\Users\0011GP744\AppData\Roaming\Python\Python312\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main json_out['return_val'] = hook(**hook_input['kwargs']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\0011GP744\AppData\Roaming\Python\Python312\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 112, in get_requires_for_build_wheel backend = _build_backend() ^^^^^^^^^^^^^^^^ File "C:\Users\0011GP744\AppData\Roaming\Python\Python312\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 77, in _build_backend obj = import_module(mod_path) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python312\Lib\importlib\__init__.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 1381, in _gcd_import File "", line 1354, in _find_and_load File "", line 1304, in _find_and_load_unlocked File "", line 488, in _call_with_frames_removed File "", line 1381, in _gcd_import File "", line 1354, in _find_and_load File "", line 1325, in _find_and_load_unlocked File "", line 929, in _load_unlocked File "", line 994, in exec_module File "", line 488, in _call_with_frames_removed File "C:\Users\0011GP744\AppData\Local\Temp\pip-build-env-ekyeyqc_\overlay\Lib\site-packages\setuptools\__init__.py", line 16, in import setuptools.version File "C:\Users\0011GP744\AppData\Local\Temp\pip-build-env-ekyeyqc_\overlay\Lib\site-packages\setuptools\version.py", line 1, in import pkg_resources File "C:\Users\0011GP744\AppData\Local\Temp\pip-build-env-ekyeyqc_\overlay\Lib\site-packages\pkg_resources\__init__.py", line 2172, in register_finder(pkgutil.ImpImporter, find_on_path) ^^^^^^^^^^^^^^^^^^^ AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'? [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. Do you know how to resolve this ?

[@trenbolonewings]

@@katemariageorge7396 I'm getting the same issue.

[@newchaoz]

Either that, or you can turn pdf to text with 'from PyPDF2 import PdfReader'

[@williamfarley9013]

This is the kind of stuff I was hoping to do with chat GPT

[@jcollins519]

Semantra is a pretty cool tool to analyze your documents and be able to search them with natural language. It's probably more research-oriented since it links you to the different pages and snippets that match your query.

[@jsayubi]

So, we've switched from producing videos that were practically a recipe for depression to creating authentic coding tutorials now, have we? Oh, what a "remarkable" progression, truly. Thanks for that! :)

[@jsayubi]

Just Note: My Comment above was generated by GPT :D

[@chindianajones3742]

@@jsayubi oh lol actually? How did you prompt?

[@SwingingInTheHood]

😅I was thinking the EXACT same thing! Dude, where have you been the past 3 months! You have just demonstrated what these LLMs (large language models) are really good at: Language. Everybody's going on and on about coding, accounting, script writing (well, maybe), but just summarizing data is what it is really best at -- what, I think, it was designed to do in the first place.

[@neuronovost]

Зато у меня шортсы с классными нейросетями на канале ;))

[@CaptainSazzman]

What program is he using to type the instructions to the model?

[@hichamalaoui34]

May be 8 months late and Langchain has been updated since, but this is one of the best videos I watched. Thank you.

[@articvault4549]

Langchain and Llama index increases your token usage enormously, and tokens ain't free, u get charged for their usage,so a heads up for you, just track your token usage, it's just converts docs and prompt to embeddings and then compares it using vector similarity .the llm here is used for in context learning

[@inflationking1271]

So what is you architecture proposal to improve this?

[@faruqhasan5396]

What function exactly is the llm performing here ? Is it not possible to run this on a cloud gpu without paying for tokens from open-ai? Or to create a 100% offline KnowledgeBase ? Ty

[@articvault4549]

@@faruqhasan5396 so basically what happens is that when our docs are converterd to embeddings as well as our query, we use similarity search to get the embeddings similar to our query then those embeddings are passed to the LLM as a context along with query as a prompt to generate a response for us

[@articvault4549]

@@faruqhasan5396 u don't have to necessarily use openai, u can use other LLMs, more specifically ones that are on hugging face but then again openai chatgpt LLM is the best so far in response quality and context understanding and embeddings

[@articvault4549]

@@faruqhasan5396 also what do u mean by running on a GPU? Whether u run it on a GPU or something else,if you use openai gpt as LLM u will be charged for tokens , and point to be noted here we use openai for 2 main core purposes,generating embeddings and also LLM, again like I mentioned u can use any other open source embedding model and LLM that u can just run on your computer or whatever u want then definitely it will be offline since it won't require api calls to external services

[@danield.7359]

You made my day. I've been struggling with fine tuning a GPT 3 model with mediocre success and an enormous data collection and preparation effort. It would never even get close to the results achieved with langchain within 1 minute of coding and 9 minutes of data preparation.

[@hadihassan_]

Hey @danield.7359. Can you give me an idea of what you made using this video? I need some help with training my own model. Thanks

[@danield.7359]

@@hadihassan_ I don't know what you mean with "what you made". Using langchain I developed my first RAG application.

[@LeoUfimtsev]

Legitimate. I experimented with openai and started to wonder how to pass more data to it. Exactly what I was looking for. Tech lead does not disappoint.

[@faruqhasan5396]

What function exactly is the llm performing here ? Is it not possible to run this on a cloud gpu without paying for tokens from open-ai? Or a completely offline private KnowledgeBase ? Ty

[@madcatattack1]

nice idea! i just started recording my study notes down today actually, and i plan on feeding it to chat gpt to organize for me and, well who knows what else. feels like a cheat code for productivity, using this thing

[@aerocodes]

I'm doing something really similar as well! And also doing a series on it where we go over building autonomous agents using GPT4 that are programmable, context aware (whatever files from the vscode you have in your workspace) and ultimately autonomous it's awesomee!

[@aerocodes]

I will soon release it open source too!

[@dawidzurawski8870]

I'm waiting for it

[@stratusgeret3794]

Would be nice if you post something about it later on!

[@aerocodes]

@@stratusgeret3794 I got loads of updates coming soon!

[@rafograph4714]

​@@aerocodesinterested

[@Neellssoonn1]

That part you say about discovering something first and therefore you are smart, it makes a resume of every single civilization in the universe.

[@stevierayfrog2485]

I would love to see an updated video on this. Since this world is moving so fast, these steps have so many deprecated modules and requirements. I couldn't get past the need for chromadb. Trying to install it bombed because it was trying to install every version of it, and I wasn't sure which version was compatible with the other modules. Superfun overview though.

[@IdowuOlayiwola]

This thing is deprecated and I wonder why we do not have a new video yet

[@larryczerwonka5125]

First great video. Second I just had to comment on the "one language" you mentioned programmers claiming that's all they wanted to know. Last count i have coded in over 15 languages since i wrote my first line of code back in 1985. We have not deployed anything using LangChain yet (we have only been using LlamaIndex) but for the same reason that i know so many languages, we will be using LangChain soon to see what it can do. As for plugin, i will always be for building your own so you have full control and can do things that the plugin "left out." Things like ability to use your own data (and keep it on your servers). We have found that if you are deploying a Help feature for your application you do not want to allow the code to get information from "the outside world."

[@Kira073]

Building up chat gpt on your own custom data is amazing and interesting. This opens up a whole new use case of open AI.

[@saadshajy3849]

We created a number of GPT powered personal AI assistants for businesess like law, media industry and pretty much for corporate companies where they can integrate internal corporate resources and data securely to retrieve useful information and save 70% cost

[@Lufa-je6gi]

I watched this today and when it came to 2:34 I thought you recorded this today. How accurate.

[@janbielecki94]

TechLead have return to coding and the smile have returned on his face :)

[@red_onex--x808]

this is by far one of the best videos on custom LLm so far 💥💥

[@vladusa]

And then you could create a script that reads online data for you using Selenium or something, and saves the tag content into the .txt file. Magical work, TechLead.

[@kurohito7362]

Techlead, Wow have you considered being a teacher. you literally thought me how to injest my own data in 16 mins. I am 42 and don't really fully understand python syntal all i am following in REPL rules. Wow awesome. made my day really. Your a true master.

[@anjukrishna8102]

I am a big fan of your channel. Your humour is spot on. I built on the chatgpt code in your GitHub and won a competition. Thank you

[@AndreaDavidEdelman]

Very nice implementation. Simple yet powerful. It's clearly where the field is going.

[@CaptainSazzman]

What program is he using to type the instructions to the model?

[@estebancortes2848]

@@CaptainSazzman a terminal window, its not a specific program

[@Ruum]

FINALLY! Getting back to his roots! No more “hype train” videos please! You’re supposed to be an expert in your field! This is what I want to see!

[@atanasdoychinov6491]

The ChatGPT API has 2 ways how to add data. First is named embeddings using your own database where you have your privacy. The other one is fine tuning which means to retrain the GPT model by adding your data. There is a tool to convert your data from csv to jsonl format because the data need to be in such a format.

[@Ni7ram]

i think fine tuning is not that

[@maxdrut]

None of this is correct lol

[@treali]

You can't finetune chatGPT or GPT 4. I think chatgpt hallucinated when you prompted it.

[@faruqhasan5396]

What function exactly is the llm performing here ? Is it not possible to run this on a cloud gpu without paying for tokens from open-ai? Ty

[@gunreddy]

That's not exactly right. First of all, finetuning a LLM like ChatGPT isn't the best way to adapt it to your own data. Finetuning is best if you want it to perform a specific task or series of tasks, like if you want to have a pipeline where ChatGPT performs text generation then some specific analysis, etc. Finetuning isn't the best approach if you want to just give ChatGPT extra knowledge through documents (OpenAI say the same thing btw). Finetuning is a costlier approach in terms of price and resources, and doing that just to have ChatGPT know your calendar is overkill. If you're using embeddings, you're not exactly 'adding' data. You're still sending those vector embeddings along with the prompt. Right now you can't finetune GPT-4.

[@genemodified]

Fascinating … and as a non-coder I enjoy learning the vocabulary used in describing the tech and lots of useful tips. Thanks.

[@gibbeyii]

I don’t even know where to begin trying to explain what a bad idea putting every aspect of your life into a searchable database, not to mention the fact how accessible this database will be the outside entities… Good luck

[@chrsl3]

But thats the exact thing techlead shows here: how one can use it totally privately.

[@davadh]

As long as your data is offline, it should be okay. One it's online or in public domain, then it's over

[@kollegeturnschuh5181]

But ChatGPT NEEDS online? Or does he suggest that all of it he just have downloaded offline by 10 lines of code in a terminal? His .pdf documents may be not uploaded to a third party, however his requests are still send to OpenAI/ Microsoft

[@pepelapeux]

They already know everything about us - tracking our phones, cameras on computers, cookies, then cameras on TV etc.. Google has a lawsuit right now where we can claim $7 because they made money off our data without our knowledge/permission. I say to utilize this technology until you can't but use discernment on what you put in so hackers can't use it against you or your company..

[@davadh]

@@kollegeturnschuh5181 True. You either trust that Open AI encrypted your offline data when it sends the query or you don't.

[@LabEveryday]

One shot and few shot prompting is super cool. Thanks for the video!

[@ronaldb5245]

Also for a non techie who’s team is building a digital product to read, analyse and present data from 17th and 18th century handwritten documents from European archives, this a great video. Not sure on the Python learning though :-). Thanks again. Looking forward on the next one. Some advanced prompt engineering including do’s and don’t s with the system prompt in open ai playground? Best, Ronald

[@liondrone2954]

Transkribus?

[@CryptoBlockchainTechnologies]

You are the most magical out of any You Tuber that I have ever came across. ❤

[@dasaradhichenji2961]

I am not a programmer but I admired your teaching style

[@seize2581]

Thanks TechLead, it's nice to see this type of videos !

[@Ploglow]

Chatgpt is so amazing. I use it for so much stuff. Options are really endless

[@SpirusFilms]

Have a feeling Google is gonna build this into Bard to scrape personal data from Drive, Calendars, Gmail and the rest of the suite

[@PrismaDimensional]

If techlead is creating tutorials this means AI is already the state of the art and not tech leads nor humans :v

[@jirikrajnak9047]

this "proof of concept" demos what's going to be a standard feature on operating systems soon. think spotlight or whatever windows uses. and beyond. just needs to be integrated into the ui.

[@MrLocokrang]

I am going to seriously explore how this can be utilized, thank you sir

[@bra5081]

For me the added value would be in the AI that adds new content to my data. As retrieving it is quite an easy feat in itself. As it's not burdened by the thought that I can do it later and end up never do it. But I suppose they have stuff like Alexa for that.

[@cheyno237]

You can already give chatgpt a GIF or a powerpoint or whatever, and then tell it things like "Add such and such text", etc.

[@carrycat876]

classical tech lead video. reminds everyone who the boss is. love this.

[@juankiefer6493]

I'm doing this since ChatGTP4 came out. GTP is the non-biological version of the human brain with the power to learn the entire Internet and more. Treat GTP as a non-biological being and you'll be surprised. PS: I hope this thing doesn't turn into evil.

[@dwork9451]

It will.

[@juankiefer6493]

@@dwork9451 If the theory that humans are inherently evil is true. We have a huge problem.

[@dombicile4539]

I was hesitant to try LangChain but you showed me how easy it is to get going. I'm going to try it out tomorrow to automate my job for me! And no, I won't tell them it's doing the work for me!

[@karinakarina]

I am going to input information about all my exes so it can explain what I saw in them. Hopefully this will help me understand where my lack of judgment lies.

[@johnruby1363]

Wouldn't it be embarrassing if the problem lay with your own character flaws and unrealistic expectations. LOL.

[@albertoramos4312]

The old tech lead we all missed and love

[@remixisthis]

Apple can so easily push your iCloud data to an LLM and allow you to give prompt commands via Siri. They have to be working on this for a release next year at the latest

[@marc.roelofs]

I wouldn't bet on that

[@beckylieb2637]

glad you mentioned the hotez and Kennedy - there is a load of history there and if people would only make an effort to get to know it, their eyes will open

[@besllu8116]

Funny how everything again went to text-based interfaces.

[@hegdelabs]

This video so far is the best and relatable how we can use Chatgpt to the best. Many thanks , really appreciate it

[@jeffersonqiu7071]

Did anyone tried to run this script recently? I kept getting many error messages to install dependecies from langchain-community and even after following all the errors, the script still couldn't run.

[@kelvinchukwumaeze404]

me too

[@uplanddigitaldreamer]

I'm currently building a GPT for a lawyer. And he's blown away.

[@gunreddy]

I hope he isn't going to use it in trials lol or else I would hate to be his clients

[@uplanddigitaldreamer]

@@gunreddy naw…he’s using it for his internal documents uploaded from his workers. More for the way he runs his business not for investigation, although when the whole law library is upload into a vector database his paralegals can cross reference cases that may be similar to his case.

[@BogdanCondrat]

this is very new technology, the video is already deprecated, doesn't work with the current libraries.

[@chris407x]

6:24 "copy and paste from this tutorial into my production code" HAHAHA TechLead is the best deadpan comic.

[@ALIof93]

Have you guys tried out dmvnerds for google or aws certs? 🤔

[@riyaski91]

Eye opener! I am a tech student, and was researching whether we could make a custom GPT of our own. This was on point! Thanks @techlead!

[@tharlikar1]

ai is scary. you feed all the social media data, bank transaction, sms, telephone calls,googles data of a person and train ai with that data and ai know you more than you know yourself. it is scary as hell.

[@imho2278]

Actually it just shows you how similar hour life is to everyone else's. Chatgpt is not creative. It is merely an organiser.

[@questioneverythingalways820]

@@imho2278cool. It can be layered. Organised across datasets and outputs…

[@voodoochild420ai]

this is one of the most magical videos i have ever seen no cap

[@marconeves9018]

Don't forget that if you choose to implement OPENAI like this video suggests you will be sending chunks of your personal data to them-- just food for thought.

[@asdf8asdf8asdf8asdf]

​@Myadmin876👍👍☝️☝️☝️☝️☝️☝️

[@theawebster1505]

He literally informed you that they don't train the AI on the data provided via API and that they delete it within 30 days, mate.

[@Omega9935]

​@@theawebster1505perhaps

[@gunreddy]

@Myadmin876 Stop spamming this annoying comment

[@gunreddy]

@@theawebster1505 Because no tech company ever lied to consumers about how they use their data, right? :P

[@saadshajy3849]

We created a number of GPT powered personal AI assistants for businesess like law, media industry and pretty much for corporate companies where they can integrate internal corporate resources and data securely to retrieve useful information and save 70% cost

[@ripern]

Awesome tutorial! Simply explained and so many good examples!

[@fenchelteefee]

Great vid, especially the in end with MS’s case study of customer reviews for cars. For those, who actually struggling to find real world applications for the new AI stuff. Thank you!

[@HarryGPT]

It feels like the channel is back on track. Re-subscribed

[@shaggyfeng9110]

So you still get his video in your feed even after you unsubed him? How many teachlead video did you watch, lol

[@HarryGPT]

@@shaggyfeng9110 Ha, ha. You caught me. I'm a longtime fan

[@otroleonarbe]

Great demo. What about data privacy?. Will your personal data go into the web?

[@RTSDad]

Beware, OpenAI will leverage the data you send and they have already suffered a data leak. Fine for data that is not sensitive, but otherwise requires a more custom solution.

[@visualantidote9878]

I thought they did not do that if you're on the paid version?

[@RTSDad]

I have not heard of that, but even so it would still be vulnerable to a data leak. Safer to have a custom solution in your own environment.

[@oeaoo]

TeacLead doing his job.

[@bernadofelix]

AI Stocks are pretty unstable at the moment, but if you do the right math, you should be just fine. Bloomberg and other finance media have been recording cases of folks gaining over 250k just in a matter of weeks/couple months, so I think there are a lot of wealth transfer in this downtime if you know where to look.

[@nicolasbenson009]

I've been in touch with a financial advisor ever since I started my business. Knowing today's culture The challenge is knowing when to purchase or sell when investing in trending stocks, which is pretty simple. On my portfolio, which has grown over $900k in a little over a year, my adviser chooses entry and exit orders.

[@nicolasbenson009]

My advisor is Margaret Johnson Arndt , a renowned figure in her line of work. I recommend researching her credentials further. She has many years of experience and is a valuable resource for anyone looking to navigate the financial market

[@niharikadeokar8934]

The simplest explanation for the implementation of LangChain, Loved it! tysm :)

[@candikmen6078]

watch my monitors shaking due to unstable cheap desk (as a millionare)

[@jfletchbeats5882]

fantastic video. love love love using gpt for stuff like this. would love to see more content of this!

[@X19-x5f]

Great video! Thanks for sharing this info with us. btw, I really like these commentary/instructional videos, but I do like the commentary/introspectional videos as well. I'd just like to see the instructional ones a little more.

[@MarcoFre167]

Congratulations on the video. I am not an expert and I am not a professional in the field. Thank you for the tutorial. I wanted to ask you a question... I noticed that running the script still incurs charges (depending on the tokens used). Did I do something wrong or is it normal for it to be this way?

[@SiddharthGoel-f4u]

It looks like code and methods used in his video has been deprecated and no longer working.

[@gj1234567899999]

I like when you add useful stuff for people. Thanks!

[@tech-daddy]

We need to run this without the API dependency, hence having the entire LLM offline.

[@ManuRC]

Langchain has support for open source models, like the ones from gpt4all, so you can totally do it. The only issue is the speed of the responses, because they run entirely on the CPU, so it's not very practical yet from my experience...

[@chileflake1656]

@@ManuRC which one(s) would be the fastest LLM's ??? to avoid any legal/privacy/security issues of using OpenAI.

[@ManuRC]

@@chileflake1656 I don't know, haven't tried many tbh, just a few from gpt4all, but had almost the same results with all of them :(

[@bobby9568]

"This code was written by ChatGPT" LOL

[@christian-schubert]

Gotta admit, for a moment there, I thought he'd pull off a good old Tech Lead aka "Well, I know how to do it but I'm not gonna tell you, you dumbf****, go and research it yourselves!" Gotta say though, he really got a knack for explaining stuff, seems he legitimately is a good teacher (for those who know what a variable is and just want to get to know new concepts)

[@imho2278]

He was pretty glib about learning Python though.

[@kasratabrizi2839]

Ow man this is exactly what I was looking for. For a long time I was busy thinking about creating an app with a database of all my stuff and objects in my house. The point is to create a prompt where I can ask the app where for example ObjectA is in my house and it would tell me it is in the attic, on the left, in the box 3 for example, based on what is available in the database. For a developer this is not a difficult task. But I don't need to do this anymore. I can just have an excel spreadsheet with my stuff and feed it to my personal chatGPT lol. I wonder if we can also connect this to let's Alexa or Siri and do it via voice command and get the chatGPT answer again with voice.

[@samhblackmore]

But how do you keep the database up to date when objects in your house move?

[@kasratabrizi2839]

@@samhblackmore Well you have to update the database as well. Which of course can be time consuming if you move a lot of your stuff all the time. I am aware that this might cause other problems. It was just an idea. I would probably create something like this for objects in my attic or basement. Things you don't touch that much.

[@sucalaminka]

how is adding langchain better then having a searchable spreadsheet for this use case? you can just have a spreadsheet with object and location

[@nevilleachi6888]

@@kasratabrizi2839 if you have home security cctvs you can write a code to integrate the app with, but then you will have to also train the ai on vision learning

[@JaeyeokYoon]

Thank you, I'm sure that many people was waiting for it!

[@KrzysztofC-1]

So you are paying them to send them your data.

[@edes6168]

That means for debugging a problem / error on your pc / server that could be very useful. For example putting the directory of the logs and config files of an application

[@tylerpond1229]

That’s a lot of personal info to hand over to OpenAI for fun

[@lamrof]

It is also the best code learning site i know. I just got started with Python, it is like having a practical teacher. Quick, really quick to learn.

[@perrylam]

this video actually sounded sincere…

[@andrespineda7620]

Wow, this was awesome. All this information in one place. Also, I appreciate your fast dialog and sticking to the important points. I subscribed and will recommend this site to others.

[@leopham3615]

Awesome , thanks so much. I spent the whole long weekend to test a whole bunch of crap for local data including Gpt4All, Ollama… They are so slowww and their responses based on a single text file are crap. Grad that I found this video. Too bad that I can only click like once 😊

[@muhammadowais8609]

Really enjoyed the video, that 16min video was big pool of answers for me to solve a problem which i wanted too. Amazing video

[@turarqazaq017]

We need mor practical videos like this one. No need for more “depression is my profession” videos.

[@oryxchannel]

Timely video for me. Thank you. By the way. You're cutting edge. Why hasn't anyone done an example video about the actual cost of building an AI tool? Why hasn't anyone done an example video about the actual cost of building an AI tool considering "parrallel innovation" meaning...if I build this novel AI tool, what are the chances that when finished I browse my KZbin algorithm and someone's done a video about it? No AI influencer is doing a video on efficacy with regard to econometrics. Most people shop by price. They have to ultimately buy it. No one has done a video on what a _useful_ _new_ AI tool will cost you in processing. If you converge five small AIs into one....why do you think you should stay with everyone else's tool because you haven't a clue as to costs?

[@gunreddy]

If you want to build an AI tool on the scale of ChatGPT, you would need potentially millions of dollars of investment, if you count R&D too. Even training LLMs on small bits of data is a costly and timely process. I had a project where I had to finetune existing models on .TSV files of language data. I had to do the finetuning on cheaper cloud GPUs. If I had tried to run it on more powerful hardware, it would have cost potentially hundreds just for what is seen as a 'simple' process. That's not even factoring server costs. It is really really not as simple as just "Ah I'm gonna use some Python libraries, run the code on text data, then boom I have a new AI tool". It is much more complicated and tiring. That's not even getting into the legal ramifications of training on data.

[@samusaw]

one of the best videos I`ve seen in 2023. Great job!