How to Build an AI Document Chatbot in 10 Minutes

[@daveebbelaar]

👉🏻Join my FREE community if you want to learn more about AI: bit.ly/data-alchemy

[@Taskade]

Awesome stuff, Dave! Loved how you delved into Flowise and LangchainJS. Hoping to see some comparisons on AI Agents, especially long-running and autonomous ones in Langchain. Keep it up! 🚀

[@SmartWizzard]

Can I integrate this into Flutter APP as a chat FAQ?

[@Taskade]

Feel free to reach out any time! @@SmartWizzard

[@srh1034]

Any solution to build a CPU-based AI Document Chatbot which utilizes CPU and does not need API ?

[@f1l4nn1m]

Hi Dave, thanks for sharing. Flowise is pretty cool as a rapid-prototyping tool, you can visually chain complex objects in just a matter of minutes. I found some cons though, which I think the devs should address. - Debugging is tough. Each API-based component should have a test button (does the key work? is the deployment name correct?). Those aren't things you want to guess from pieces of text in the chat box. - Coding. It's nice to have a visual interface, but at the end of the day this is just chaining function calls. It would be nice to have the Python code corresponding to a specific saved flow. So that one can customize it. I wonder if they are interested in getting precise feedback from users to improve and prioritize features. I'd be really kin to help them build a great product.

[@ZachHyman_SIA]

Agreed. "Error: Request failed with status code 401" in the chatbox dialog isn't particularly revealing...

[@Hisma01]

great content. Reminds me of the same concept as node-red, but specifically built for AI apps. I think this can go a lot further than just a prototyping tool, seeing as how far node-red has come from where it started. Really neat.

[@TF-qt3jh]

❤ I love all of your videos, and especially this one. As a no coder entrepreneur, I really appreciate this kind of step by step tutorials. Many KZbinrs are making similar ones, but yours exceeds. Only two points. To your surprise, one of the hardest part of this kind of tutorials is, setting up the apps. The process is no brainer for coders and data scientist, but not for no coders. Two. I always wanted to see a tutorial covering end to end process, meaning designing GUI to (e.g., Figma) to connecting to algo (e.g., Flowise) so that I can build a completely functioning app or MVP. I’d appreciate if you could do this type of video. 🎉

[@abagatelle]

Yes! setting it all up for we beginners is tricky. It takes a while to get familiar with Git etc

[@GraceyGarret]

Yes, I agree. I also looking on it

[@jozonas]

+1 For many videos I can't even go pass the point of the setup because they go so fast over it thinking we know about it, but we don't. Guess what, the people who get that, are not here trying to watch the video tutorial. Come on guys.

[@nvwls]

For anyone setting this up now and experiencing a "TypeError" when they send messages in the chatbot- removing the document module and adding it again worked for me.

[@MattGadi]

Hi, many thanks for the video. How did you prepare the txt input file? Do you have a video or link to understand the contend and how to prepare it? Thanks

[@abagatelle]

Really good video. For beginners a video on how to use Git etc would help just to get grounded in the concepts of how to use VS code, download repositories and so forth would really help. Thanks for all your efforts, much appreciated.

[@Jake_McAllister]

Hi Dave, my problem is most companies won’t be happy uploading internal documents to a external server. Do you think you could make a video where a chat bot is created but the company can keep there internal documents on their end 🔥 🙏

[@airo_robot]

I already made that before chatgpt even existed

[@Jake_McAllister]

@@airo_robot what’s it called?

[@jeremiahwolf783]

Yes please, this!!! Jake and I have the same problem.

[@houndogism]

Hey, there are ways to do this using the stack explained in this video. For example, you could use the Confluence API document loader to query documents stored in your Confluence site

[@blender_wiki]

Hire an app architect if you don't know how to solve this basic problem.

[@schlussmitschiss]

As a non-coder, I am flabbergasted. This looks so easy! Thanks for sharing this. How can I turn this into a function Q&A widget on my webpage? 😳

[@sanderschat]

ask ChatGPT

[@lancerkind]

Copy/pasting the "connect credential"s is different now than how the video shows. In the Flowise UI, you can no longer copy/paste the credentials. You need to click on the Connect Credential field and select "create new" which opens a popup window. In that window, put in your username and then finally you can copy/paste the API key.

[@Bangs_Theory]

This is the best review about Flowise on KZbin!

[@DeclanKirk]

LOVED this tutorial- thanks for sharing!!

[@tecion]

Great video! I couldn't find the video you mentioned at 6:07, would be nice if you could link to it.

[@ivanperez4878]

I'm also on the Pinecone waiting list. Do we have any other options other than Pinecone? Thanks

[@samus4799]

I would like to train a large language model to evaluate scientific publications, specifically regarding research, based on its adherence to the scientific method.

[@SicilianDream]

Hi, you are very clear, but you use and refer to so many things I have never heard of. Where can I learn what I need to understand your tutorial? Lars, Norway 😊

[@gabrieljauregui654]

I was looking for this in your channel yesterday. Todays youtube algorithm rewarded me with this suggestion haha. Thanks for this valuable content. Greetings from Argentina! New suscriber =)

[@daveebbelaar]

That's awesome haha - thanks!

[@jayrodathome]

damn flowiseal put me on a waiting list.

[@cyber1619]

I'm getting the error TypeError: Cannot read properties of undefined (reading 'startsWith'), anyone knows a fix.

[@camilocampos5900]

You are a great friend, I really like the information and knowledge you give us.

[@erosr45]

This is the hardest tutorial I've ever seen. It's not a step by step.

[@betenu1]

I clicked on the docker folder and ran 'npx flowise start' in the terminal and it worked fine. Already made a chatbot

[@givingswag897]

What are the costs to use it?

[@Esehe]

Thanks for the videos Dave! Keep them comming. Also noticed you doubled your subscribers since you made the video, congrats. Your conversational agent snitched :)

[@DanielWamara]

Can one link this to a local LLM like Ollama to reduce the costs?

[@m.ehtizan]

Hey Dave, I just watched your video and I must say that it was really informative, very useful and well-made. I loved your videos. I was wondering if I could help you edit your videos and also make highly engaging shorts for you?

[@nilsbuer]

Very cool video. Content and video quality

[@vishalnangare31]

Great information, here from Nash's channel 🙌🙏

[@daveebbelaar]

Thanks man!! 🙏🏻

[@OtherTNSEE]

Issue I'm having with these document loaders and vector stores is they get soooo slowwwww once you start loading actual data into them. At around 500 MB of pdfs and vectors, these vector stores take so long to query the whole app breaks down. Not to mention cost issues if you go down the openai api / pinecone route.

[@Earthvssuna]

Is it safe in terms of the companies data or will another model use the data to train? For exmaple over the open ai API?

[@vadimzubakhin1589]

This is so impressive. Thank you.

[@iGuide_net]

How much do you have to pay per search to the GPT provider? One metric i saw had chatgpt-4 at 30 cents per search.

[@overrideguilarte]

Hello, how are you?, very good video. I ask you a question, how did you create the embedded chat, what did you use to generate it?

[@dsgeyer]

Love it. Thanks for making these videos. This seems great to slap some components together then go in and have a lot of the code roughed in so it could be worked on from there. Is that an accurate assumption?

[@daveebbelaar]

Excatly

[@ryanbrown8387]

Are you able to change the language that the chatbot speaks in on flowise?

[@peterkable7007]

Dave, this was great. Thanks. I now have my own flowise agent that can read the thousands of pages of planning regulations and make sense of them. Would you have any guidance on best practice for document managment, e.g. how to ensure the bot has the latest version of a document, how to audit the currency of the docs in a document store or even be reminded when a document is out of date.

[@gr8tbigtreehugger]

Very cool! Many thanks!

[@Gra55H0pper]

Like your videos! Subscribed! Just wish you'd ditch the background music.

[@techitint.9100]

Hi Dave, thanks so much for this very good video. One question. just wondering about privacy and if information written in our documents are passing to OpenAI while using its APIs. Good part of data are also going to a third party on cloud service such as Pinecone. How can we ensure the privacy of our personal data, while using Flowise or similar services that make use of external API?

[@AdrianGiurgiu-jt3tl]

Curious too

[@stoianandreimircea1509]

Hey there. Love the content. One comment if I may. Maybe show us in the begining a glimpse of 10 sec how the end looks like. then continue with the video😊

[@daveebbelaar]

Thanks for the tip!

[@liorzioni]

hi tnx for the guide , i tried to bulid the doucument chatbot , i uplade txt file , when i asked "what this document about " he answer "i dont know "why its happened?

[@hgwvandam]

Good video Dave, thanks!

[@daveebbelaar]

Thanks Hans!

[@khushpatel7060]

Hello Dave, I am asking here as this is your latest video, I have seen your videos regarding Langchain, I am curious how to optimize inference while using LLMs in Langchain using TensorRT or Onnx Runtime... As in Industries, It's very obvious, to save the time as well as computation cost... In TensorRT while using open source models, we have techniques like quantization and a few more more for that... So In Langchain is there any way to do this?

[@kennethochiabuto8516]

Great video thanks. As a no coder myself I have been looking at the best ways to utilise chatbots for my clients. flowise still requires a number of steps and some low code know how, but now we are seeing chatbot solutions requiring no technical ability ie no code become available, Orimon, chatbase to name but a few. Maybe not a flexible as flowise in terms of functionality. Your thoughts?? BTW Subscribed.

[@MultiMam12345]

Its actual 16 minutes. For starters probably 45 min. Still amazing.

[@WeirdoRocks]

Great video :) Keep up the great work.

[@daveebbelaar]

Thanks 🙏🏻

[@ivanmayoral3813]

🎯 Key Takeaways for quick navigation: 00:00 🔥 La pregunta clave es cómo integrar ChatGPT con datos de la compañía en 10 minutos. 02:28 🧩 Flowwise: Constructor visual para aplicaciones de modelos de lenguaje. 05:17 ⚙️ Clonar repositorio Flowwise y usar Docker o npm para iniciar. 08:26 💬 Crear chatbot de recuperación conversacional QA con acceso a datos propios. 11:48 🌐 Explorar otras opciones en el constructor visual de Flowwise. 12:56 🐍 Usar el código generado en Python para interactuar con el chatbot. 14:44 📈 Probar la memoria del chatbot y aplicar en prototipos rápidos. 15:51 🚀 Flowwise: Ideal para prototipos ágiles de modelos de lenguaje. Made with HARPA AI

[@RichMiller-k3g]

An addition to the setup if (a) you are running on Apple silicon (i.e. M1 or M2) and (b) you want to use Docker compose. When I first went to the docker setup and issued the command $ docker-compose up -d It the docker container for flowise failed to start because the platform was not specified. The solution is to add the platform specification line to `docker-compose.yml` immediately after the line `image: flowiseai/flowise` My file now looks like this: ``` version: '3.1' services: flowise: image: flowiseai/flowise platform: linux/amd64 … ```

[@youtube_account_1]

i had to comment it out to work on my m2 machine

[@Syedhussainipage]

Thank you for this amazing video. Would you be kind to build an app that would refer to a given website and reply based on that site's data?

[@dekumus]

Thank you!

[@henrytabimagiraldo7116]

Thanks, this is amaizing!! do you know if there is an alternative to Pinecone since it has the waitlist in place?

[@ivanperez4878]

I'm also on the Pinecone waiting list. Do we have any other options other than Pinecone? Thanks

[@asafnb]

Thanks for the great content! If I have big pdf files isn't it will get pricy?

What would you recommend using: Stack-AI, Flowise or Langflow?

[@peroforrr7663]

Hello, 🎉 great content! I would like to request a video on a solution for chatting on PDFs using an open-source model from Hugging Face that utilizes GPU and ensures data privacy.

[@roberto048]

Hi Dave, thanks for this amazing video. I have a few question, is it possible to teach to our chat bot to ask some specific questions to make a 2 way conversation? I want to use this chatbot as a sales rep in our website, talking with our clients. Also is it possible to teach the chatbot to not saying some specific things. For example I am afraid it recommend our competitors to our clients :)) I guess this chatbot is linked to Chatgpt and uses the same dataset, so it can use its own dataset to say something and offering our clients to the competitors

[@nickrobinson7096]

How does it deal with the structure of a PDF? For example, if I have a Table with CAS numbers in the format 1234-56-7. Usually, I can use Regex to extract these patterns however what if the text is contained in a table column and broken by a carriage return or just generally by the structure of the document? e.g. 123- 45 -6 In a single column. It seems that the text file generated will not keep this text together. This is a frequent issue I run into when extracting data.

[@Insipidityy]

What VSCode theme are you using? Looks great!

[@daveebbelaar]

Atom One Dark 🔥

[@DeepakVijaykumar-v9i]

Hi, Can you please advise how to use the Folder Path in "Folder with Files" document loader. I've deployed the Flowise app on GCP as docker image. Thanks

[@JohnnyLeuthard]

Are you uploading your data to the cloud or into the docket container?

[@pathmonkofficial]

Great content!

[@kobvel]

What about the data privacy? Where does your document go?

[@almahdibakkali8007]

Can you add custom prompts? What happens when you ask unrelated questions ?

[@poshsims4016]

THANK YOU!!

[@daveebbelaar]

You're welcome ;)

[@marcuskirsch4128]

You know your stuff. But I am struggling to follow this to replicate its a lot of detail.

[@str2254]

This is way too good wtf

[@daveebbelaar]

🙏🏻

[@trackerprince6773]

Awesome video. After watching I'm trying to go a step further and use pinecone with ConversationalRetrievalQA with langchan Js directly. I'm getting a response for the query, however for some reason the buffer only always stores the latest messages. The history of messages is never stored so I cant build on prev messages. Do you have any example for successful implementation?

[@aisimp]

I build with flowise and I believe it was aware of the whole conversation. Maybe something to do with the setup

[@davedumas0]

i have an idea for a video series for you "gpt-4-code interpreter vs gpt-4 with combo of plugins"

[@kakanisantosh]

We have so many videos like this Can't you try showing how to get both video and text as answer for questions based on pdf document

[@thejordankeyes]

This is pretty cool. How could we use this to chat with whole databases full of records instead of just a single file at a time?

[@safetime100]

Thanks ❤

[@naturallydope247]

Thanks for showing this. Can you videos on how to deploy using other things besides Azure?

[@daveebbelaar]

Maybe in future videos, but I am an Azure guy ;)

[@diegosandoval7462]

Great work! Do you know whether there is a limit to how big the PDF file can be? ie. could it be a pdf book? thanks for your help

[@markryan2475]

I tried a PDF book that is over 2M, about 300 pages, and it worked fine.

[@diegosandoval7462]

@@markryan2475 wow, thanks. i'm trying to understand how that affects costs. the bigger the pdf, the more the OpenAI api would charge me? or does the OpenAi only charge by the size of the response? 'appreciate the insight

[@daveebbelaar]

The PDFs are split up into chunks of for example, 1000 tokens. So it does not affect your OpenAI API costs. This video gives a more in-depth explanation of how this all works under the hood: kzbin.info/www/bejne/hIq2iKFnntWVnck

[@diegosandoval7462]

@@daveebbelaar /thanks so much

[@diegosandoval7462]

@@daveebbelaar Thanks a lot!

[@stephensuprios1896]

Nice and extremely useful video Dave… how can I use a website as the source? This allows for updates to immediately be available and we don’t have multiple locations of our data items.

[@stephensuprios1896]

I have particular websites Not wanting the whole web. It will use these particular websites as it’s data source for conversion with memory. Help? And thanks again.

[@johan_vd_meer]

Hi Dave, question. A lot of documents I want to upload have images meaningful to the subject. Is there already a way for AI to take these into account when chatting to a document?

[@aisimp]

I think that ability is coming with a new iteration of GPT4, right now this functionality is in testing

[@mrdman094081]

After watching several times it looks like I might need to be a developer or software writer to complete this. Are any others in this thread totally new to A.I. and have made a complete chat bot ? Does The material loaded become public ?

[@oluwaseunakinropo6318]

Hii Great video! Please I have an issue using flowise to chain with my notion database ( I embedded Google sheet in my notion) but my bot can’t answer questions about info in my google sheet, please what am I doing wrong ?

[@ew3995]

i wonder if you could get flowwise to show its generated python code

[@ricochetism]

any way to get around the Azure OpenAI key requirement

[@레이지비]

multiple pdf learning also available?

[@xugefu]

Thanks!

[@daveebbelaar]

Appreciate that!! 🙏🏻

[@daviddahl8562]

I just bought the AI writing assistant chat bot. I can not do folders. II can not do that stuff on the left siide. I'm paying $14.99 a month. Which cat bot should I be using for this.

[@Che_Se]

once ive made my bot, how can i get the bot online so its not just accessible from my laptop using the embed function to connect it to my site but then it only works on my laptop

[@laythqureshi5917]

Do Flowise have any intellectual property over your data if you make a chatbot with them and train the model yourself?

[@AbdelrahmanEmad-mm2xs]

thanks for this great tutorial, am frontend developer so how can i build SAAS on this?

[@matteodeamicis]

Thanks for the video, it's very useful. Is it possible to integrate a voice assistant that receives a question as input and answers via voice, using the information in the pdfs? It would be very useful. What do you think about it?

[@daveebbelaar]

Yep, that's possible. Look into the speech services from Google or Microsoft.

[@dozieweon]

Nob question: How is this different from building it on Botpress?

[@TechResearch05]

I am getting an error while using flowise - ErrorWithoutStackTrace: PineconeClient: Error getting project name: SyntaxError: Unexpected token A in JSON at position 0. Tried to cross check but not sure what is going wrong. Could yo please help?

[@youssefzaim7163]

ty

[@girrajjangid4681]

Impressive ♥

[@daveebbelaar]

Thanks!

[@10points56]

can we add system message in query

[@Yakuza13329]

Can you use this without OpenAI and use something free like HugginFace or LLMa? Also, how much GPU power do I need to run this locally?

[@somethingmystical567]

it keeps saying this for me: * error decoding 'ports': No port specified: : how do i fix that?

[@mohsenghafari7652]

hi. please help me. how to create custom model from many pdfs in Persian language? tank you.

[@BikiniDesignClub]

I really like the video, and I would love to replicate this to experiment with a project I have. However, I'm very new to all the IT language and I gt stuck in the process. I was able to create the GitHub account, I have the API keys for CHAT and Pinecode.. But then it's too much for an ignorant like myself. I would love to have a tutorial like this but step by step like I'm 5! LOL Thank's anyway!

[@daveebbelaar]

Then I have good news! Check out my free group for a step-by-step course on how to get started with this: bit.ly/data-alchemy

[@BikiniDesignClub]

@@daveebbelaar Thanks! I've just enrolled, pending approval. (Sara)

[@Armin_Hemati]

tnx for info.... can u help me understand the differencebetween there two Artificial Intelligence & artificial intelligence solution !!?? cuz i want to choose a university bachelor's degree??? and what do you think i should learn?? ML /// deep learning/// python //data analyst //data science...... ???? TNX

[@heromiIes]

I followed all the steps to the end. I uploaded the text file, ran to the chat, and asked it questions. All I received back were error messages such as "Error: Request failed with status code 429"

[@lancerkind]

Me too. It's coming from Open AI and it says I'm exceeding my current request quota. I'm on the OpenAI free tier which allows you only 3 requests a minute. So I'm wondering if that's the problem. But when I look at the analytics for my account it doesn't show any requests. @bwp2bruce did you figure out what the problem is?

[@lancerkind]

@Curious.Gamer. Did you figure out what the problem is?

[@heromiIes]

@@lancerkind Eventually yes, but I'm not going back to that to recall the steps.

[@gabriel-gr]

Very cool, thanks! I tried to do the same with some (large-ish) PDF's but I'm getting `InsufficientQuotaError: 429` from OpenAI ;-(

[@senorchavo5572]

I need troubleshooting assistance. I csn get everything connected...independently openai will respond. When i link pinecone...it will receive the vectors from the pdf when connected...but he dumb ass assistant when asked about the document says hmmm i dont know! 😅 is ir the splitter overlap...its a larger pdf...i do legal work so its case law in trying to load and ask questions

[@AIEntusiast_]

multiple pdf, docs at same time ?

[@cycla]

This is like selling the tools to make the shovels in a gold rush

[@explodingstardust]

Can show it with chromadb as its local and free for most people? Thanks for great work.