Langchain: PDF Chat App (GUI) | ChatGPT for Your PDF FILES | Step-by-Step Tutorial

"Build a ChatGPT-Powered PDF Assistant with Langchain and Streamlit | Step-by-Step Tutorial"
In this comprehensive tutorial, you'll embark on a project-based journey where we leverage Langchain and Streamlit to develop an interactive ChatGPT for your PDF documents. With the power of an LLM (Large Language Model) such as OpenAI's ChatGPT, we'll create an application that enables you to ask questions about PDFs and receive accurate answers.
🦾 Discord: / discord
☕ Buy me a Coffee: ko-fi.com/prom...
|🔴 Patreon: / promptengineering
💼Consulting: calendly.com/e...
📧 Business Contact: [e-mail]
Become Member: tinyurl.com/y5h...
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
Link to the code: pastebin.com/m...
Learn how to harness the power of Langchain, an open-source Python (and Javascript) framework, to create intelligent applications. Discover Langchain's capabilities in training GPT models on your data and generating personalized LLMs. Explore text embeddings and their integration with Langchain using OpenAI's API.
In this tutorial, we'll guide you through building a fully functional Streamlit application. Train GPT on PDF documents and fine-tune it to your specific use case. Experience the seamless user interface as you upload PDFs, ask questions, and receive prompt answers from the LLM.
Unleash Langchain's versatility in chatbots, document analysis, and more. Automate tasks and improve efficiency using Langchain with Streamlit.
Take your natural language processing skills to the next level. Start building powerful applications with Langchain today!
All Interesting Videos:
Everything LangChain: • LangChain
Everything LLM: • Large Language Models
Everything Midjourney: • MidJourney Tutorials
AI Image Generation: • AI Image Generation Tu...

[@engineerprompt]

If you are interested in learning more about how to build robust RAG applications, check out this course: prompt-s-site.thinkific.com/courses/rag

[@JunWenSoh-f9w]

Great stuff for explaining the flow of the architecture so well. I like the pace and also how details regarding each part of the architecture are explained with just enough details not to overwhelm the viewer.

[@engineerprompt]

Glad you enjoyed it!

[@ianabrahams5434]

Learnt a lot from just this one video. Appreciate all the hard work that went into making these fantastic tutorials. Thanks very much.

[@engineerprompt]

Thank you :)

[@huilingxie4829]

Same up there! Please teach us more end to end project, i really learned things here@@engineerprompt

[@TheCopernicus1]

Wow amazing! Now this retro fitted with privateGPT would be gold!

[@RamkumarL-o9z]

Tried the whole videos, really functional and you have a great insight in different concepts. Thanks a lot for this detailed video. Once of the best videos watched in recent times.

[@engineerprompt]

glad you found it useful.

[@fishandcat4281]

It is my first time to know streamlit....That's amazing!!! Thanks for the sharing. Your step by step video is ultra clear... Thanks a lot.

[@engineerprompt]

Glad it was helpful!

[@bobhoward4530]

Thank you for this clear, concise explanation. It’s definitely the best I’ve found so far. New to Langchain and quite excited. Thanks for your help.

[@engineerprompt]

You're very welcome!

[@jorgerios4091]

What would change if we decide to use an open source LLM, what lines should be changed and how? Would be a good idea for a future video

[@brian2590]

Also a good idea for the wallet 😎

[@luizaugusto8154]

I agree too

[@thunderwh]

This, plus I want to load in directories with PDFs as entire topical collections to query

[@engineerprompt]

For Open source options: Check this out for embeddings: kzbin.info/www/bejne/pZiokp-Ggrp2ibs Check this out for LLMs: kzbin.info/www/bejne/raOnXpmQq7lpi6s

[@ismailcenik8892]

Thanks!

[@engineerprompt]

Thank you, appreciate the support 🙏

[@baz813]

Thanks

[@engineerprompt]

Thank you!

[@DouglasHeyen]

Thank you for these in depth videos. Learning so much. Thanks again!!

[@shivamroy1775]

Great content, very well explained. Really appreciate the long videos with elaborate explanations.

[@engineerprompt]

Thank you 😊

[@nazihfattal974]

The pace, contents and explanation are all great. Thank you for a great video. Always checking your channel for great content.

[@engineerprompt]

Thank you for your kind words 🙏

[@ReviewSmartTech]

Am halfway to the video and I am so excited, how easy you are making me to learn… kudos to you

[@engineerprompt]

Glad you are finding this useful

[@legendsanimexy8217]

Does it requires to buy chatgpt API to build this project ? ​@@engineerprompt

[@Pubuditha]

Great Video And you explained it really well too. Earlier I was confused about why langchain is used but your video helped me to understand ! Thank you !

[@terradyn]

Would love an open source version of this that we can swap in different embedding and llm models as the space evolves.

[@engineerprompt]

Coming soon :)

[@efexzium]

Its to slow for a book

[@timmymanamperi]

Thank you for a beautiful step-by-step learning walkthrough. I like how you articulate each area clearly and precisely. Good on you, and keen to see more videos, and well done.

[@engineerprompt]

Glad it was helpful!

[@MrReesh]

Thank you for this video. Just signed up as a patron. Keep up the great work and all the best to you.

[@engineerprompt]

Thank you for your support!

[@devyanshrastogi]

It was one of the coolest video on LLMs thanks for sharing such knowledge, I learnt alot from this video.

[@gbemi9408]

Can we use a pdf thsg has images..?? Will the image also come shownin the questions?

[@MichaelLass]

Keep up the great work. I love your detailed videos.

[@goforit5]

Best videos! Instruction is so clear. I learn so much from you. Thanks

[@engineerprompt]

Thank you!

[@epictetus__]

Extremely useful. Thanks for making this awesome useful project

[@neelsoni13062]

One day you will get million pls make this amazingt videoes with new technologies daily for enhance our knowledge thank you so much brother !!!

[@georgetuges4821]

Thank you so much, Ive been self taught on AI and this video has really helped me on AI... God Bless

[@GaganThakur]

Loved this, learned so much today. Thank you

[@NehaJShetty]

The same thing I implemented and had many questions thrown at me as Chatgpt will also do the same work what is the difference??

[@NexTechNuggets]

Can you make it go through "somename" folder and use all pdf's there then ask it question from those files?

[@abinash01]

Great work! Thanks for sharing. Keep it up :)

[@996hunter4]

and you my friend are a true hero!

[@Dummy-f2l]

Thank you so much man this was of great help cheers!

[@ajaykumarporeddiwar9226]

AWESON. 🎉 Keep up the good - > great work. 😊

[@engineerprompt]

Thank you 🙏

[@ohp47]

Thanks for this wonderful video.

[@gapigorsek7878]

I get this error (when i load a pdf): AttributeError: module 'openai' has no attribute 'error' can you please help i have been debugging for 2 hours?

[@MateMatricks5119]

I was facing the same error, it means you are facing error in api calls and fetch, try to use api first in normal way if its working its good,else use some other llm like gemini or cohere

[@aj-tt9qh]

I am also facing this error..any luck??

[@aj-tt9qh]

@@MateMatricks5119 I am also facing this error..any luck??

[@rajithkumar3424]

Very Informative tutorial .Thanks for educating us

[@engineerprompt]

Glad it was helpful!

[@AnsulSingh-nu1xd]

@rajithkumar3424 can u explain me ..... waiting for your reply

[@sudarshanrajagopalan8552]

I am having a problem. Where I always get a response saying cannot answer questions based on the context provided. How do I fix this ??

[@engineerprompt]

change the system prompt. that will help.

[@ticelsoful]

Hello teacher. Your videos are excellent. I'm getting an error when trying to insert the OPENAI_API_KEY char, and I'm not sure where to place it. Could you help me?

[@engineerprompt]

This specific version uses a .env file to store the OpenAI key. So create a file called ".env", make sure it's not a text file and the extension of the file is env. Then put your openai api key in there like this: OPENAI_API_KEY=YOUR_KEY Then run the above code, hope this helps. Alternatively, you can put your api key in the file itself if you are not sharing this with anyone. In this case, after your import all the packages add this line to your code: OPENAI_API_KEY="YOUR_KEY"

[@mohideenabdulkadhar4280]

very good explanation

[@anasputhawala8677]

Based on your workflow, if you ask a question it will end up re-uploading the document and re-processing the pdf document, text splitter, and all that stuff. Is there a way to prevent that from happening? It happens because streamlit reads python code, top-down every time a change is made on the page.

[@AfrivisionMediake]

Hey, thank you for this. Can it work with a lot of document? Like if I upload about 1000 documents?

[@engineerprompt]

Yes, that will work.

[@AfrivisionMediake]

@@engineerprompt It will work as long as the pdf documents don't exceed 200mb? Or can I increase the limit?

[@engineerprompt]

@@AfrivisionMediake In that case, you want to read files from a directory rather than uploading them. Streamlit has a limitation of 200MB.

[@alaaharb5987]

I'm not able to store the vectorStrore using pickle. Any one get this error ?! TypeError: cannot pickle '_thread.RLock' object

[@ronitvirwani4920]

yes me too

[@AbdulBasit-jp9dz]

Did u fix the error?

[@evgeni_logic]

Instead of pickle, use "vectorstore = FAISS.load_local(store_name,embeddings)" to load, and "vectorstore.save_local(store_name)" to store the embeddings.

[@kavin9313]

​@@evgeni_logicwhere to give chunk??

[@mrmoffett7034]

Well done, this is just what im looking for. now i just need to find out how to clean old scanned PDF files so i can chat with them. 👍

[@keertiattem4262]

Every time I use faiss, I am getting deserialization error. Please advise

[@rahulmadala928]

Could you please tell me how to deploy the application as well?

[@priyanksrivastava834]

how can we restrict the output if it is not present in the document we provided have you made any tutorial on that

[@domasstepas967]

Great video, any advice on integrating images in the pdf and not just text when splitting them into chunks?

[@AbdulBasit-jp9dz]

Can u share ur code with me I m getting error

[@arpansangwan9293]

Sir I’am facing an error EOFError: Ran out of input can you please help me out to solve this error , i have followed the same approach that you have done but still I’am facing thi error please help me out

[@MsOrganique]

Hello. Thank you for the tutorial! The code doesn't seem to be available anymore?

[@indrajitshah5357]

Great work and learned new things, I have tried along with this video, but at the below code block, started getting error, also I am unable to find input_documents when replicating the code, I have update the langchain package too, but its same error, any solution to fix it? AttributeError: module 'langchain' has no attribute 'verbose' langchain.verbose = False llm = OpenAI(temperature=0) chain = load_qa_chain(llm=llm, chain_type="stuff") with get_openai_callback() as cb: response = chain.run(input_documents= docs, question=query) print(cb) st.write(response)

[@engineerprompt]

Oh, yeah the langchain keeps making changes and seems like they have removed it. Will create an updated video on it.

[@riprap007]

excellent, thanks

[@shashankshash59]

Great video man!! Can you help me on the changes that needs to be made if I don’t want to use historical data or documents please?

[@Zoronoa01]

Thank you so much!

[@ivanwaves]

Thank you very much for the video!!! How can I implement an azure openai key with its respective uri?

[@QHawk7]

*Can you do the same with Falcon 7B or 40B ?*

[@Officer-kd6]

Really an amazing video, glad you shared this with us!

[@asaibybike]

Great tutorial!! I was unable to get past typeerror: cannot pickle _thread.rlock object error so I removed the if and else statements and ran the model without pickling the VectorStore. Thanks again, keep up the good work!

[@kdbarchives]

Hey, can you please share the code? I need it for a project

[@artarioo]

@@kdbarchives # # embeddings store_name = pdf.name[:-4] st.write(f'{store_name}') embeddings = OpenAIEmbeddings() VectorStore = FAISS.from_texts(chunks, embedding=embeddings) essentially just get rid of if/else and the with statement

[@evgeni_logic]

@@kdbarchives , I created GitHub repo with the code: langchain_pdf_chat_app . Cannot post full link - apparently it's not allowed.

[@maxgadd]

thank sm bro your the best fr

[@owmygawd12]

Thank you for this! How about a tutorial on making my own chat bot, with only the information I have provided it, then use it in my own app ?

[@ylluminate]

How would you integrate image processing for technical diagrams, drawings, circuits, etc?

[@paulp6752]

Great stuff, thank you for spending time recording this video! Question - if I would like to do the embeddings calculation and semantic search on my server, which model would you recommend?

[@engineerprompt]

Check out my localgpt project, there I am using llama2 for the llm part along with instructor embedding

[@paulp6752]

@@engineerprompt thanks! And you have earned yourself a subscriber!

[@rjayanth]

Would like to try to implement this on my laptop.. i am new to GCP or Azure.. Does this need Google Platform to implement?

[@yth2011]

can you share the excalidraw link? very cool

[@ThisAbhinavL]

I'm getting this error TypeError: cannot pickle '_queue.SimpleQueue' object someone help

[@lokendrayadav-f3g]

Great video, can we do same using llama2 with open source embeddings(sentence-transformers)?

[@kingarthur0407]

I've written a prompt for GPT-4 that I use with chatGPT to transform it into a legal assistant, and the results have been stellar. Is it possible to encode this prompt into the system you describe so that the bot operates with it in mind? Sorry for the duplicate comment

[@ericcuellar9549]

What’s the prompt?

[@intellect5124]

Grt video from a genius man. Hats off. can you pls record a short video using google palm LLM and instructor embedding and also hosting of this applicaiton on VPS?

[@miladmirmoghtadaei5038]

Thanks a lot man. What version of Python are you using? I got this error as soon as I ran the `pickle` function, and after some looking around I found out that the latest version of langchain as of now doesn't match Python 3.11. So I should downgrade my Python and see what happens. The specific package it has an issue with in langchain is called `sqlalchemy`. Here is the error: "TypeError: Parameters to Protocol[...] must all be type variables or parameter specification variables." Thanks for your great videos again. Your videos are just so distinguished from the other channels talking about AL stuff. Keep it going.

[@engineerprompt]

I am running this on Python 3.10. Probably should pin all package versions in the requirements.txt file as these packages are updated regularly.

[@miladmirmoghtadaei5038]

@@engineerprompt downgraded to 3.9 and it worked. Thanks.

[@vivekmehta4862]

that is a very beautiful walkthrough. Just one question, Can you pls tell how to change the language of conversation to some other language like hindi?

[@EswaraVegi-n2l]

I tried this and it works really well, while testing the feature, i find that if i ask questions that require knowledge outside the pdf, the ai is still able to answer the question. This is suprising becuase the only knowledge source should be the pdf and nothing else right?

[@Raphael-vq9oc]

very nice video ! thank you very much but i have a problem : -sometimes answers are very long so they are cut off, -and how to do a chat like chatgpt, where we use the previous queries and responses, so there is a context thank you !!

[@tanmaysalwe1352]

Thankyou buddy.

[@Drmedquizz]

Thank You !

[@abdulrehmanbaber2104]

can you please tell me how to get page numbers reference of the output

[@FRANKWHITE1996]

thanks for sharing

[@aieducators]

thanks buddy🥺❤❤❤❤

[@saifuddinsaifee8161]

Please make more videos of chain_type, as well as explore more configuration for OpenAI and other LLMs. Thanks❤

[@joeg3117]

can we make it with another llm model?

[@seasaga]

How to pay for openAI API? Any tips for a safe way to do it?

[@trivenianand4169]

Real nice explaination, Could u help me out with the open ai api key? It only works if you have a paid openai account , any other alternative?

[@jameswilliamhanzell3292]

I was wondering actually and I know it's a dumb question but how do you make the file or folder that you've shown in the video in vscode?

[@joannezhu101]

i actually have another question - how to set vsc to point to the environment interpreter, it is now using global python, i want to use the localgpt python?

[@underground314]

Can you add multiple PDFs? And search and talk to multiple PDFs at once?

[@muhammadmustafa3611]

TypeError: cannot pickle '_thread.RLock' object

[@RahulBhapkar-c7i]

How to create questions that mentioned in chatpdf when file is loaded?

[@n-frame7688]

Thank you sir

[@Nitinsaisrinivas]

Will this work on Chatgpt basic free plan

[@RK1985]

What should I do to show tables and figures and formulas from PDF?

[@bennguyen1313]

I have some pdf scans, that I'd like to try Chat-GPT4 Vision on to see if it can OCR the tables and export to a csv. Do you think the ChatGPT4's Assistant API pricing is better ( "Code interpreter $0.03 / session Retrieval $0.20 / GB / assistant / day (free until 03/01/2024) ) than PDFChat? Perplexity Pro (Also $20/mo)? Or perhaps free AIs tools that might work with API and image analysis? For example, Google's CopyFish or Gemini Pro Vision? Also doesn't Bing's CoPilot use ChatGPT4?

[@roalves1234]

Hi teacher, what if the context needed for chunk of text x, for example, is in block y? Can RAG resolve this?

[@mochammadrevaldi1790]

hello, can you explain how to use model from hugging face? without openAI token. Thankss

[@stanTrX]

Does it also extract a table from pdf? Thanks

[@denb1568]

How can you make sure the open source model does not hallucinate or make numbers up in its answer? Is there a video where you show how to improve the answers of open source models using prompt engineering?

[@engineerprompt]

will be making one soon on the topic.

[@محمودجلیلی-ش1م]

I want to translate the above 5mb pdf file at once with this library, so that all the pictures and the order of the paragraphs are preserved, does this library have this capability?

[@ravitejavoleti784]

Superb video

[@engineerprompt]

Thank you so much 😀

[@os-td9cr]

Thank you very much! well explained! is there a way to print out the cost of the embeddings step, the same way you did on the query? It would be great to know how much it cost to load the files without opening the account on their site

[@engineerprompt]

I haven't looked at it. Let me check.

[@Jaybearno]

What if you have a semi-structured markdown document that contains it's own semantic structure (like H1 headings), and want to chunk a document based on them? The langchain docs for the MarkdownTextSplitter method mention splitting into chunks for sentences and recombining.. but how?

[@GauravParmar-u5m]

Hey, I have doubt. In vector store you are storing embeddings, but When you upload another file and ask question on that document it will also use embeddings of previous one pdf because you are not deleting those data. So how to resolve that problem?

[@xianggao445]

in the video, the constitution.pdf is uploaded. there were only 13 states back then. why 50 is returned as the answer? is the PDF really used as the data source when we do the query?

[@vishnuprabhaviswanathan546]

Is this rag? What is the difference between rag and this kind of retrieval? Are they same?

[@engineerprompt]

Yes, this is RAG.

[@woo__ooow]

Thank you so much! :) Is it possible to build the same thing using privateGPT instead of openAI?

[@engineerprompt]

Yes, coming soon 🙂

[@woo__ooow]

@@engineerprompt You're the best! Thank you! :)

[@choosemaderp3148]

hi! appreciate the video but do you think that there is a way to add chat history to this?

[@engineerprompt]

Check the latest video :)