Chatbot Answering from Your Own Knowledge Base: Langchain, ChatGPT, Pinecone, and Streamlit: | Code

  Рет қаралды 81,686

Pradip Nichite

Pradip Nichite

Күн бұрын

In this video, we take you through the process of creating a chatbot that leverages the power of Langchain, OpenAI's ChatGPT, Pinecone, and Streamlit Chat. This chatbot not only responds to user queries but also refines queries and pulls information from its own document index, making it incredibly efficient and capable of answering in-depth questions.
Code and explanation: blog.futuresma...
AI Demos: www.aidemos.com/
AIDemos.com is your go-to directory for video demos of the latest AI tools. AI Demos's goal is to educate and inform about the possibilities of AI.
Building a Document-based Question Answering System with LangChain, Pinecone, and LLMs like GPT-4.
• Building a Document-ba...
Revolutionizing Search: How to Combine Semantic Search with GPT-3 Q&A
• Revolutionizing Search...
GPT-4 API Tutorial: • GPT-4 API: Real-World ...
ChatGPT API Tutorial: • Using OpenAI's ChatGPT...
Building a GPT-4 Chatbot using ChatGPT API and Streamlit Chat
• Building a GPT-4 Chatb...
🚀 Top Rated Plus Data Science Freelancer with 8+ years of experience, specializing in NLP and Back-End Development. Founder of FutureSmart AI, helping clients build custom AI NLP applications using cutting-edge models and techniques. Former Lead Data Scientist at Oracle, primarily working on NLP and MLOps.
💡 As a Freelancer on Upwork, I have earned over $60K with a 100% Job Success rate, creating custom NLP solutions using GPT-3, ChatGPT, GPT-4, and Hugging Face Transformers. Expert in building applications involving semantic search, sentence transformers, vector databases, and more.

Пікірлер: 168
@AndyHOTlife
@AndyHOTlife 9 ай бұрын
For people to believe your chatbot solution works, you need to provide the data!
@tzengyueng
@tzengyueng Жыл бұрын
🎯 Key Takeaways for quick navigation: 00:00 🤖 The video discusses building a chatbot using Langchain, OpenAI's ChatGPT, Pinecone, and Streamlit for answering questions from your own documents or knowledge base. 01:09 📄 The chatbot answers questions from documents stored in Pinecone, demonstrating the ability to retrieve information from custom knowledge bases. 02:08 🔍 Refining queries is essential for accurate semantic search, helping the chatbot find relevant information based on user questions. 04:14 📊 The video covers indexing documents using Pinecone and the importance of choosing the right dimension for the index. 05:49 🧩 Langchain facilitates document processing and chunking for indexing in Pinecone, supporting various document formats. 11:57 📈 Demonstrates how to push document embeddings into a Pinecone index, enabling semantic search capabilities. 13:08 💬 The video utilizes Streamlit Chat for the user interface, displaying responses and user queries. 16:36 🧠 Explains the different types of memory (buffer, summary, etc.) used in Langchain to maintain chatbot conversation history and context. 18:14 📝 Discusses the use of prompt templates for instructing the chatbot's behavior and structuring conversation prompts. 20:01 🧩 Langchain is used to create chat prompt templates, message placeholders, and maintain conversation history. 20:30 🔗 A "chain" in Langchain combines memory, template, and language model components for chat interactions, such as question answering. 21:38 📝 Users input queries, which are refined for semantic search using Pinecone indexing. 22:49 🔄 Langchain's line chain handles queries and responses, utilizing ChatGPT for generating responses. 25:21 💬 The "conversation string" combines past conversations and the current query, allowing for refining queries to improve semantic search. 28:21 🪶 Refined queries are sent to Pinecone for context searching, enabling more accurate answers based on the conversation context. Made with HARPA AI
@Slimshady68356
@Slimshady68356 11 ай бұрын
Thanks
@SamraShaikh-wu8im
@SamraShaikh-wu8im 3 ай бұрын
How can we make a chatbot retrieving the data through custom website
@youssefaserrar2001
@youssefaserrar2001 Жыл бұрын
Great video. First time I hear about the Refined Query 👍
@JainilShah-z8o
@JainilShah-z8o Жыл бұрын
Are all platforms used free ? Also the api keys , are they free ? please answer i have a upcoming hackathon soon need your assistance
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Open AI and Pinecone are paid services. You can have pinecone free altervative Chroma DB
@deepak_kori
@deepak_kori 6 ай бұрын
Please mention the version in requiremnts.txt file
@SaiMadhaviYalla
@SaiMadhaviYalla Жыл бұрын
Can you please mention versions to install as well, as i am getting error " installed packages version mismatch " while running the code
@delphiDHS
@delphiDHS 10 ай бұрын
Great video. But can you please help me resolve this error: ValueError: variable history should be a list of base messages, got I have search everywhere nothing useful. My code same as yours btw.
@sonikaarora-e1q
@sonikaarora-e1q Жыл бұрын
I am getting error in "conversation.predict" method. Did anyone faced this issue?
@IshitaJoshi-v9i
@IshitaJoshi-v9i 8 ай бұрын
This is giving a lot of errors. Pinecode's documentation has changed and all the functions have been replaced. what to do as a beginner?
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
let me see if I can update code
@AbcXyz-lk6sh
@AbcXyz-lk6sh 6 ай бұрын
@@FutureSmartAI yeah please do! init function seems to be not working and i cant import Pinecone either
@sumangupta871
@sumangupta871 8 ай бұрын
Hi most of the langchain and pinecode codes are not working as of now. Can you please one more video on same topic based on present langchain and pinecode framework. It will really helpful. Thanks.
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Noted
@sravantipris3544
@sravantipris3544 4 ай бұрын
can u share git hub link please??
@PorterIke
@PorterIke 7 ай бұрын
i am getting AttributeError: type object 'Pinecone' has no attribute 'from_documents' any remedies?
@FutureSmartAI
@FutureSmartAI 7 ай бұрын
I think I need to update code, those libaries keep changing
@gabrielmartinphilot980
@gabrielmartinphilot980 6 ай бұрын
Yep alot of parts arent working anymore. And please your video code its alot diferent from your repo, that confuse the hell off persons that are learning!@@FutureSmartAI
@Tiger-Tippu
@Tiger-Tippu 10 ай бұрын
How to fine tune the model when we use langchain for chat application
@FutureSmartAI
@FutureSmartAI 10 ай бұрын
Hi finetuning model is independent of langchain and you should be bale to use fientune model id in langchain
@Tiger-Tippu
@Tiger-Tippu 10 ай бұрын
@@FutureSmartAI thank you
@018jumanamuneeram2
@018jumanamuneeram2 6 ай бұрын
Is the API key paid or free
@narendrakd
@narendrakd 8 ай бұрын
You are superb bro,i have some technical documets locally stored into my laptop,i want free chatbot locally for my laptop so that i can query my documents....if u can explain me bro...waiting for tour reply
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Hi you can try small LLM Eg medium.com/@kagglepro.llc/how-to-setup-mistral-7b-language-model-locally-without-code-lm-studio-30a8e71c9a61
@zunairakhalid7358
@zunairakhalid7358 3 ай бұрын
can we add an image and ask qs
@shashankalva9844
@shashankalva9844 Жыл бұрын
What if my database is in the form of knowledge graph. What changes do I need to make?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Hi, I havent tried with knowledge graph. Check This: python.langchain.com/docs/use_cases/graph/graph_cypher_qa
@DadCooks4Us
@DadCooks4Us 4 ай бұрын
very poorly made content.. you seem to be in a rush barely explaining the steps in the notebook.
@FutureSmartAI
@FutureSmartAI 3 ай бұрын
Hi , Thanks for feedback, Most of the code in that notebook was already covered in erlier video and dont wanted to spend more time on ti. will imporve next time
@pranitingole5562
@pranitingole5562 8 ай бұрын
Hi Pradip, sir, I am working on a user-base chat bot. It's a medical base chat bot. What I am doing is extracting user data from the database and then storing that data in a text file. that user text data is providing to the Langchain and GPT models for conservation with that data. I am able to chat with user data, but I am facing one issue, which is that if I try to search, some think it is different and not present in the document, but it provides an answer from the outside. Like, who is the PM of India like this? I want to restrict GPT from providing unwanted responses. Can you help me with this? I also tried prompt, which worked sometimes.
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Hi you need to update prompt and add "If you don't know the answer, just say that you don't know. Don't try to make up an answer." from langchain.prompts.prompt import PromptTemplate from langchain.chains.question_answering import QaChain # Create a new prompt template template = """Use the following pieces of context to answer the question at the end. If you don't know the answer, just say that you don't know, don't try to make up an answer. Use three sentences maximum and keep the answer as concise as possible. Always say "thanks for asking!" at the end of the answer. {context} Question: {question} Helpful Answer:"" # Create a new Q&A Chain with the modified prompt PROMPT = PromptTemplate(template=template) qa_chain = QaChain(prompt=PROMPT, retriever=retriever, llm=llm) # Use the modified prompt qa_chain.invoke(question="What is the capital of France?")
@ShankarMutkekar
@ShankarMutkekar Жыл бұрын
It refines even the very first query, which is not useful for me. What am I supposed to do so that it takes first query as it is, and then it may refine the query based on memory ?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
We are storing all user queries in session state request if request has no query it means this is going to be first query , so you can add condition that if session sttate request is empty then refine query is same as user query.
@ShankarMutkekar
@ShankarMutkekar Жыл бұрын
@@FutureSmartAI Yeah, that was easy. If- Else statements worked for me. Thank You
@mohammednaseefp4681
@mohammednaseefp4681 5 ай бұрын
UnidentifiedImageError i encountered with this error while uploading documents even there is no images or image file. Please explain🙏
@apurvavhatkar8520
@apurvavhatkar8520 5 ай бұрын
Can we build chatbot for Indian laws using constitution book
@FutureSmartAI
@FutureSmartAI 5 ай бұрын
yes
@TheDigitalSight
@TheDigitalSight 5 ай бұрын
If I'm creating custom facing chatbot and I've to upload pdf of multiple customers how should I store it in pinecone? Can you please explain more on pinecone usage and how its used in wild? Thanks for your easy to understand explanation 😇
@cryptokingdom2038
@cryptokingdom2038 5 ай бұрын
Brother thanks for the tutorial and i have a doubt What is the maximum capacity of Sentence Transformer Embedding - all-MiniLLM-L6-v2 ? Is possible to convert 50k words into an embedding format with sentence transformet embedding model or any other model available to achieve this?
@Slimshady68356
@Slimshady68356 11 ай бұрын
20:21
@ngalenal1004
@ngalenal1004 10 ай бұрын
You are my hero. I have a academic project in NLP and your tutorial is clearly explained. Thank you for your work. 🙏🙏
@FutureSmartAI
@FutureSmartAI 9 ай бұрын
Wow, thank you!
@MushtaqPatel-up1fb
@MushtaqPatel-up1fb 7 ай бұрын
How to get the page number of the file from which the answer generated?
@FutureSmartAI
@FutureSmartAI 7 ай бұрын
you can get sources info, but syntax has changed now python.langchain.com/docs/use_cases/question_answering/sources
@ggg9gg
@ggg9gg 8 ай бұрын
Hi, how do I deploy this application. Right now it is in local machine
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Hi I have few videos on deployment Deploy FastAPI & Open AI ChatGPT on AWS EC2 kzbin.info/www/bejne/bXe5gaFoatKge7Msi=iGwaCdZv21ZZcohB Deploy GPT Streamlit App on AWS EC2 kzbin.info/www/bejne/b2GXlIpvoa9qgrMsi=noGaNcPdzEMC4GI_
@bloodstream426
@bloodstream426 5 ай бұрын
i have a pdf but it is not recognizing it. why is that ??
@jayrn4596
@jayrn4596 Жыл бұрын
Hi sir. Can you please share the documents in data content section?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
use any text or pdf file. save some text in txt and use.
@AndyHOTlife
@AndyHOTlife 9 ай бұрын
@@FutureSmartAI That is a lazy answer. Having the data would have really helped here. I've done another experiment with a PDF I found in another tutorial, and the LLM keeps on hallucinating on it. It seems you had a good PoC with your current PDF data, and I wanted to benchmark my approach against this. Saying "save some text in txt and use" is rather stupid and pointless imo, making me move to following other tutorials that do make the data available too. Dislike, hope you make better content in the future.
@robertovillegas2220
@robertovillegas2220 3 ай бұрын
have a use case with a haven't seen anywhere: I create a private GPT that has documents as contexts. This documents has criteria for a specific subject I give it system instructions so its function is to evaluate a user document that it's attached as a part of the prompt, to see if the document complies with the criteria in the context documents, and give detail response on the result of evaluation and the justification that includes, the content of the user document and the criteria in the context documents. I want to do that in LangChain but I don't know hot to add a user document as a part of the prompt for the RAG.. It would be great if you can you explain how to approach this implementation. Thanks you for the content!! Keep the good work.
@hernandocastroarana6206
@hernandocastroarana6206 Жыл бұрын
Thanks for the video. Do you know what components I can make the Chatbot throw citations at the end? something similar to pihind or perplexity. I want it to extract the information from websites or documents, but I want it to tell me where it extracted the information (citations) from. I would really appreciate the help
@fakerandom2836
@fakerandom2836 Жыл бұрын
hi Pradip, i'd also appreciate if you can add any color to this question. thank you in advance.
@FutureSmartAI
@FutureSmartAI Жыл бұрын
when we chunk to documents for embeding we can store document url or any other information in that chunk metatdata. When you get those chunks back from semantic search you will also get metadata that you can show at the end of answer as source.
@RohitK-z1y7e
@RohitK-z1y7e Жыл бұрын
how to deploy this code on cloud?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
This will help kzbin.info/www/bejne/b2GXlIpvoa9qgrM
@tasneem2586
@tasneem2586 6 ай бұрын
Is it possible to change the icon image of the bot and user? How do I do that?
@Priyanshukumar-zu5ei
@Priyanshukumar-zu5ei Жыл бұрын
Hi sir , I'm getting n authentication eroor that says you didn't provide an api key whereas I have given api key the error is ,AuthenticationError: You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password.
@sanjanaepari9173
@sanjanaepari9173 Жыл бұрын
Sir do the same thing with csv or excel file
@jayrn4596
@jayrn4596 Жыл бұрын
Hi sir. Hope you are doing great. I just want to know instead of pdf, text can we give a database (CSV) as an input?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Yes we can. use langchain sql agent
@outlanderz8
@outlanderz8 Жыл бұрын
​@@FutureSmartAI it is not taking the context in case of csv, can u create chat bot video for csv separately, it looks like completely different use case
@DonjiKong
@DonjiKong Жыл бұрын
Great video, could you go over the process of publishing the site with streamlit, I keep getting errors. As for uploading the side, it seems the requirements you posted are lacking some things, but I am not sure what to put in it to make it work. Everything I tried throws errors.
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Where are you publishing? Check this kzbin.info/www/bejne/b2GXlIpvoa9qgrM
@chinnuabcd
@chinnuabcd 6 ай бұрын
Hi, instead of a single PDF, can we use multiple pdfs to build the chatbot?
@FutureSmartAI
@FutureSmartAI 6 ай бұрын
Hi Yes, we just need to add more pdfs to vector database
@chinnuabcd
@chinnuabcd 6 ай бұрын
thank you@@FutureSmartAI ... can we make an android app with this framework to get the same functionality?
@chinnuabcd
@chinnuabcd 6 ай бұрын
thank you so much for making these videos
@AbhinavKumar-jj6kr
@AbhinavKumar-jj6kr Жыл бұрын
can anyone help me to complete this project
@gabyfacio9701
@gabyfacio9701 7 ай бұрын
Is there any recommendation to solve the ""Vector dimension 384 does not match the dimension of the index 1536" problem? the 384 comes from the SentenceTransformer model and the 1536 from Pinecone. I tried to change the Pinecone dimension but is not working. Maybe anothe recommended SentenceTransformer model?
@FutureSmartAI
@FutureSmartAI 7 ай бұрын
When you create index you can sepcify dimention of index
@manalchavhan441
@manalchavhan441 Жыл бұрын
What changes we should have to do if only want data from.csv file i.e data source only be.csv file?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
You can use natural language to SQL. kzbin.info/www/bejne/jHicfIx5iJVgbqcsi=zKcXOmbhxYecvv6q
@outlanderz8
@outlanderz8 Жыл бұрын
@@Pradip I want to take directory as user input in streamlit app, not able to.. can u pl help.. i dont want to hardcode the directory, but streamlit has provision only to give filepath not dir path.. pl help Pradip
@boopalanm5206
@boopalanm5206 Жыл бұрын
How can we create the Chatbot for the data using the LocalDatabses like SQL ,Postgres
@FutureSmartAI
@FutureSmartAI Жыл бұрын
you can check my Langchain SQL agent video
@kenzabaffoun5563
@kenzabaffoun5563 8 ай бұрын
hey, I really appreciate your work, and I really find myself learning with you, so I sincerely thank you for that. I also wanted to ask you, I'm in the process of creating a recruitment bot for my company, I wanted to know if it was possible to reverse the bot's process, i.e. have it initiate the conversation and ask questions, not the other way around, but still keep its intelligent aspect? While indexing the company's own database in case the candidate had any questions to ask?
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Hi Yes bot can intialise conversations or show user possible topic or questions they would like to know more
@sinchana.nmakam3633
@sinchana.nmakam3633 8 ай бұрын
i a getting an Attributeerror wen i try to add vectors to pincone by usin pincone.init...can anyone help me solve this problem?
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
Hi can you share detailed error?
@arora.ishant
@arora.ishant Жыл бұрын
@Pradip- Thanks for video. However, I am getting SSL authentication error when running streamlit code on local machine. Did you do anything specifically to take care of that? How to resolve that?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
No I didnt face this issue.
@Vijayaadithyan
@Vijayaadithyan Жыл бұрын
I wanted to access data from PostgreSQL, and i referred your lanchain and sqlagent. What should I do next after connecting the db?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Just find postgreSql connection string and see connection is successful. You should check my other videos of natural languagee to sql
@MsHalpinFrayser
@MsHalpinFrayser 10 ай бұрын
will this work with a .csv ?
@FutureSmartAI
@FutureSmartAI 9 ай бұрын
Its betteer to use csv langchain agent
@livewithsoumyajit173
@livewithsoumyajit173 Жыл бұрын
getting this error , please help , NameError: name 'context' is not defined
@FutureSmartAI
@FutureSmartAI 11 ай бұрын
Can you check once again ? Code should work fine
@ahmedazeem3804
@ahmedazeem3804 Жыл бұрын
Hello, re-create this project with chainlit or any new chat ui, and also it'll be great if you replaced OpenAI with Open source alternative
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Sure
@AKHILRAJEEVPBCE
@AKHILRAJEEVPBCE Жыл бұрын
@@FutureSmartAI Sir can you help me with an error?
@AKHILRAJEEVPBCE
@AKHILRAJEEVPBCE Жыл бұрын
2023-07-30 12:17:58.956 Uncaught exception Traceback (most recent call last): File "C:\Users\Asus\anaconda\lib\site-packages\tornado\http1connection.py", line 276, in _read_message delegate.finish() File "C:\Users\Asus\anaconda\lib\site-packages\tornado outing.py", line 268, in finish self.delegate.finish() File "C:\Users\Asus\anaconda\lib\site-packages\tornado\web.py", line 2395, in finish self.execute() File "C:\Users\Asus\anaconda\lib\site-packages\tornado\web.py", line 2417, in execute self.handler = self.handler_class( File "C:\Users\Asus\anaconda\lib\site-packages\tornado\websocket.py", line 219, in _init super()._init_(application, request, **kwargs) File "C:\Users\Asus\anaconda\lib\site-packages\tornado\web.py", line 214, in init super()._init_() File "C:\Users\Asus\anaconda\lib\typing.py", line 1083, in _no_init raise TypeError('Protocols cannot be instantiated') TypeError: Protocols cannot be instantiated Stopping.. i am getting this error when i run main.py
@AKHILRAJEEVPBCE
@AKHILRAJEEVPBCE Жыл бұрын
@@FutureSmartAI 2023-08-01 08:56:12.942 INFO sentence_transformers.SentenceTransformer: Load pretrained SentenceTransformer: all-MiniLM-L6-v2 2023-08-01 08:56:13.591 INFO sentence_transformers.SentenceTransformer: Use pytorch device: cpu 2023-08-01 08:56:14.606 Warning: to view this Streamlit app on a browser, run it with the following command: streamlit run d:\java files\main.py [ARGUMENTS] 2023-08-01 08:56:14.606 Session state does not function when running a script without `streamlit run` and this is the output
@FutureSmartAI
@FutureSmartAI Жыл бұрын
@@AKHILRAJEEVPBCE what error?
@vigneshm-zh5po
@vigneshm-zh5po 7 ай бұрын
what if its a csv file with like 50k records
@FutureSmartAI
@FutureSmartAI 7 ай бұрын
you should use natural language to SQL or CSV agents
@vigneshm-zh5po
@vigneshm-zh5po 6 ай бұрын
@@FutureSmartAI can you do a video using a large csv file or something like that. because most of our dataset is of csv type. sir
@ABHISHEKSHARMA-fo4tf
@ABHISHEKSHARMA-fo4tf Жыл бұрын
Can you explain how we can make in jupyter without using streamlit
@FutureSmartAI
@FutureSmartAI Жыл бұрын
I have another tutorial in jupyter notebook
@manikantasurapathi92
@manikantasurapathi92 Жыл бұрын
Hey, how to erase the user query after we generate a response to the user query. That’s one flaw I’m not able to sort.
@ankan54
@ankan54 11 ай бұрын
How can I show the sources from the metadata in the UI??
@FutureSmartAI
@FutureSmartAI 10 ай бұрын
Yes you should be able to show easily. are you aable to access doc source ?
@ysf00yldz
@ysf00yldz Жыл бұрын
i need a separate memory for each user if so how do i do this i use phpmyadmin but i can also use mongodb please help me
@FutureSmartAI
@FutureSmartAI 9 ай бұрын
hey sorry for delayed response. To maintain conversation as per user we need to create backend for chabot. when any conversation start we generate unque id for that session and then insert session id , user id , and user query , gpt respose in db.
@Lyricverse116
@Lyricverse116 8 ай бұрын
Hii pradip you are using text-davincii 003 model but that has been deprecated by openai are there any alternatives for this now?
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
you can use text-embedding-ada-002
@Lyricverse116
@Lyricverse116 8 ай бұрын
@@FutureSmartAI okay thank you
@Cawow123456
@Cawow123456 Жыл бұрын
If the language of PDF not english still working? for example japanese, chinese.
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Semantic similarity still works for non english better choose embeding model wich is multilingual
@AyushBagwari
@AyushBagwari 8 ай бұрын
do your conversational buffer memory support managing multiple user history simultaneously?
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
yes on streamlit it will be different session for different user. If you are uisng other front ends then we maintain conversation (or session id) in db and keep track of all message in that sessions. If we use latest assistant api , it maintains conversation as thread
@justlutfi2890
@justlutfi2890 8 ай бұрын
I have used it for my WA bots, referring chatID as Id, and you'll have contexr related to chatID
@rudrachand6643
@rudrachand6643 Жыл бұрын
How to insert data in pinecone? Only you mentioned .ipython notebook using google colab,but actual app it is not mentioned. Can you please also mention formal way of updating data to pinecone?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
its the same code we are using in app. I shown it notebook so that we can see each step
@keshavchander5570
@keshavchander5570 Жыл бұрын
Can i use this to ask questions to the code base ,for example : Find the repeated lines or clone lines in the repo .Will it answer
@farhanafridi8694
@farhanafridi8694 Жыл бұрын
Can we integrate it to a specific website and also deploy it?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Yes. you should expose it as api and then use it any website chatbot widget
@thomasferreira306
@thomasferreira306 8 ай бұрын
Hi last month everything was working but pinecone has migrate to a new version now "init" is no longer a top-level attribute of the pinecone package. I've made lot of reasearch but i don't find any solution to make it working again.
@FutureSmartAI
@FutureSmartAI 8 ай бұрын
I think I need to update code
@thomasferreira306
@thomasferreira306 8 ай бұрын
@@FutureSmartAI Thank you for your response and your investment! In the meantime, which of your videos do you recommend to recreate a chatbot from txt files?
@harishankarmandavi1131
@harishankarmandavi1131 Жыл бұрын
Can we get answer from hindi knowledge base?
@FutureSmartAI
@FutureSmartAI 9 ай бұрын
Yes. But make sure to use multiligual embeding model
@SaiMadhaviYalla
@SaiMadhaviYalla Жыл бұрын
Hi Pradip, this is awesome. I am trying to get the data source as well ( i mean the name of the document/ pdf) while getting the answers from the pdf. Can you help me woith this?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Yes when you chunk docs and index them you can store doc name , url as metatdata that you can retrive during semantic search
@rohith646
@rohith646 Жыл бұрын
hi pradip as gpt 3.5 and api_keys have limitations so why cant we train model on open source like huggingface platforms and link it to our UI
@FutureSmartAI
@FutureSmartAI Жыл бұрын
You can use open source LLM. People are ready to pay Open AI for good results
@SMCGPRA
@SMCGPRA Жыл бұрын
Great video! Can we have detail video with open source LLMs and embeddedings with fune tuning using our own data with prerequisite system config needed, pls 🙏🙏🙏🙏
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Sure. I havent much explored open source llms
@shashankbarai1809
@shashankbarai1809 4 ай бұрын
Confused
@FutureSmartAI
@FutureSmartAI 3 ай бұрын
Hi can you specify what was confusion? may be I can clarify or suggest some prerequisit material
@hispritez2x0
@hispritez2x0 Жыл бұрын
Your clip is very helpful. May I ask more? Can we use documents in Thai language?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
You should use embeding which is multilingual
@livewithsoumyajit173
@livewithsoumyajit173 11 ай бұрын
hi Pradip, Can you please create a similar video but replacing pinecone with elastic search ( basically storing the vector embeddings using python in Elasticsearch ) and rest as same.
@FutureSmartAI
@FutureSmartAI 10 ай бұрын
Hi I dont have any experience with Elasticsearch
@Lyricverse116
@Lyricverse116 11 ай бұрын
Is it llm
@FutureSmartAI
@FutureSmartAI 11 ай бұрын
yes
@vashistnarayansingh5995
@vashistnarayansingh5995 Жыл бұрын
So behind the scene what we are doing, is doing the similarity may be using cosine similarity of the input query and all the 30 doc embedding present into the ventor db and returning the one with highest similarity
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Yes thats what semantic search does
@AaronAsherRandall
@AaronAsherRandall Жыл бұрын
What framework are you using to build out the actual UI in the browser that the user interacts with?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Streamlit
@justinechternach7817
@justinechternach7817 Жыл бұрын
any recommendations for preparing your own code (in my case c#) to put into pinecone and provide as question context to chatgpt? Specifically the chunking part.
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Both Pinecone and Open AI provide rest API, so should be able to do it in c#. But I dont think langchain has support for c#. You can build semantic serach without langchain
@justinechternach7817
@justinechternach7817 Жыл бұрын
@@FutureSmartAI Hi. I meant for vectorizing my c# code and chunking it so I can ask ChatGPT questions about it. I’m using Python for this.
@ShankarMutkekar
@ShankarMutkekar Жыл бұрын
Currently, it takes approx 8-10 secs on an average to get a response, which cant be reduced, I guess(Correct me if I am wrong). But if streaming is implemented, perceived latency gets reduced. Could you please help me with how to implement streaming in langchain ?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
But if streaming is implemented, perceived latency gets reduced. Yes True
@shivamgupta-fb4em
@shivamgupta-fb4em 7 ай бұрын
I find your content very useful, I am pretty new to this area. I have requirement of designing a Q&A system for my company where we have data available in SQL that’s in oracle DB, but problem in tables are not straightforward, it’s like we heavily utilize foreign keys for associations. So, my guess is like we can represent this data to utilize a graph database and then serve it to LLM using cypher query. Do you think it’s the right way or we can go with SQL only
@kunal4557
@kunal4557 Жыл бұрын
Love your videos Pradip. Is it possible to define the query refiner function using an open source model like the latest MPT-30B-Chat, if yes how? I am finding it difficult to define the query refiner function
@FutureSmartAI
@FutureSmartAI Жыл бұрын
Yes you should be able to define, check prompt for that particular model. Personally I havent used open source models for generative NLP
@Mostafa_Sharaf_4_9
@Mostafa_Sharaf_4_9 9 ай бұрын
great but I have a question about refined query function... GPT has limitation of the input tokens what if the conversation is too long with the user then the input for the refined query function will be bigger than the limit ..?
@FutureSmartAI
@FutureSmartAI 9 ай бұрын
Yes right in Lnagchain you have different kinds of memory . check this blog.futuresmart.ai/langchain-memory-with-llms-for-advanced-conversational-ai-and-chatbots
@shankarmutkekar6104
@shankarmutkekar6104 Жыл бұрын
Hello Sir, I am getting AttributeError: st.session_state has no attribute buffer_memory. Could you please help me in this regard.
@FutureSmartAI
@FutureSmartAI Жыл бұрын
It means you are not storing buffer_memory in session and directly accesing it
@shankarmutkekar6104
@shankarmutkekar6104 Жыл бұрын
Yes, I got it solved. This was the exact thing I was searching for. Was very delighted to see this. Thank you❤️
@nishkarve
@nishkarve Жыл бұрын
@@shankarmutkekar6104 How did you get it solved? I am unable to proceed due to the same error
@nishkarve
@nishkarve Жыл бұрын
@@FutureSmartAI I get this error AttributeError: st.session_state has no attribute "buffer_memory". Did you forget to initialize it?
@AbhinavKumar-jj6kr
@AbhinavKumar-jj6kr Жыл бұрын
brother can you help me, to complete this project.
@tiger21823
@tiger21823 Жыл бұрын
Bro so we always need open ai api?
@FutureSmartAI
@FutureSmartAI Жыл бұрын
To generate answer yes. you could always use other open source model and see if they works for you.
Electric Flying Bird with Hanging Wire Automatic for Ceiling Parrot
00:15
Поветкин заставил себя уважать!
01:00
МИНУС БАЛЛ
Рет қаралды 7 МЛН
The selfish The Joker was taught a lesson by Officer Rabbit. #funny #supersiblings
00:12
RAG + Langchain Python Project: Easy AI/Chat For Your Docs
16:42
Beginner's Guide to FastAPI & OpenAI ChatGPT API Integration | Code
30:36
Code your online Multimodal ChatGPT App in Python (chat with Images and Audio)
37:51
Enric Domingo - AI Engineering
Рет қаралды 5 М.
How ChatGPT Built My App in Minutes 🤯
8:28
Website Learners
Рет қаралды 2,5 МЛН
Earn $1,350/Day with ChatGPT & Google Drive for FREE
17:03
Chad Kimball
Рет қаралды 586 М.
CHATGPT For WEBSITES: Custom ChatBOT: LangChain Tutorial
23:13
Prompt Engineering
Рет қаралды 102 М.
Electric Flying Bird with Hanging Wire Automatic for Ceiling Parrot
00:15