Integrating OpenAI Assistants with Websites using FlowiseAI

[@leonvanzyl]

This video took some time to create and I hope you guys enjoy it! This is useful for those of you who want to make money with these solutions, or for those who simply want to enhance their own businesses with AI Assistants. Feel free to share your implementations in the comments and I will check them out!

[@bwilliams060]

So good! Knowledge leap - thanks Leon!

[@brianmorin5547]

I could watch your tutorial videos all day. I think the best I have run into. I can't believe you compressed that to under 30 minutes yet made it very easy to understand. Your tutorials are expanding my mind of what is possible today and easy it can be. The traditional way of getting this experience prior to GPT would have been hours upon hours of professional services from developers and designers

[@leonvanzyl]

Thank you for this amazing comment 🙏. You're right, this was unthinkable a year ago.

[@Lyriks_]

There are a lot of self claimed AI Experts out there, here is a guy who do not claim anything, and yet output one of the most structured video on the subject I've seen, Sir thank you !

[@leonvanzyl]

Thank you Anthony! This means a lot. I'm over listening to posers myself.

[@johnhamfirst]

Thank you for creating this tutorial. I appreciate how much time and research has gone into growing the knowledge that you have shared. Your delivery is ALL business and NO fluff - and it is brilliant. Thank you again.

[@leonvanzyl]

Thank you! This means a lot.

[@VCFocus]

@leonvanzyl THANK YOU SO MUCH. I watched 25 videos to find what I needed. Your video is incredibly helpful. Thank you for your time and effort.

[@leonvanzyl]

Thank you very much for the feedback 🙏

[@VCFocus]

@@leonvanzyl Any tips on how I might push an entire summary of a chat to a CRM?

[@juansaloom]

Dude, all your videos are very helpful, thank you very much for all the effort

[@leonvanzyl]

You're welcome 🤗

[@ilyanemihin6029]

Thanks! Very useful demo about integration FlowiseAI with OpenAI Assistants (custom knowledge base)! And great bonus about functions call

[@leonvanzyl]

Glad you enjoyed it 😁👍

[@waynenunn7319]

As usual, this is an excellent video with precisely the information I needed. Thank you, Wayne

[@leonvanzyl]

Glad it was helpful!

[@RonAdames]

Thank you for sharing this Leon! I replicated it as the video, but using n8n intead of make. I also tested a get_lead function data info from the data base and it works pefect. Thank you so much!

[@myandrobox3427]

love n8n, self hosted it??

[@leonvanzyl]

That is awesome! Thank you for sharing.

[@RonAdames]

yes, self hosted@@myandrobox3427

[@irlonterblanche1639]

Nice work Leon. Thanks for taking the time to make this video!!

[@leonvanzyl]

You're welcome 🤗

[@RussianBritish]

This video is amazing. It's exactly what I wanted to achieve. Thank you very much Leon for the clear, step-by-step guide.

[@leonvanzyl]

You're welcome 🤗

[@myandrobox3427]

As always, to the point and excellent example to get started!!! You and Flowise are simply great!! ❤

[@leonvanzyl]

Thank you!

[@wenjensung2177]

Can demonstrate how to use Flowise AI to connect to the internal PostgreSQL database and reference OpenAI's assistant API to analyze the company's internal data? Thank you!

[@dhirajkahol]

This is brilliant, exactly what I was looking for, thank you so much!! More power to you bro 👍

[@leonvanzyl]

Thank you!

[@jlfguthrie]

Another excellent video and perfect timing. I'm using n8n instead of Make, and was wanting to get Flowise up and running this weekend to do something similar. Your video will help a lot.

[@leonvanzyl]

Seems you and I are usually in sync 😁. Glad this could help in some way

[@musumo1908]

Awesome! Thanks for this. Can ditch those over promoted chatbot designersat last yay!

[@leonvanzyl]

Agreed

[@Francotujk]

Hi Leon! The content you provide is extremely helpful! I really appreciate it. I would like to ask you something, if you can help me (I'm a little confused with all the features). I'm building a Conversational Retrieval QA Chain. Inside the node -Additional Parameters- I defined a prompt of the task I ask the LLM to perform. I'm not focusing in allowing users to chat with the pdf; instead I want the user to provide a pdf, and based on that pdf the LLM generates some key definitions. I want to get these "key definitions" and then show then in my web app (using a different UI, not a chat). How can I "capture" the outputs that the node generates; and the post that outputs directly in my web app. So this is the flow in my web app: User uploads PDF > The app autogenerates some key definitions > The key definitions are showed in the web app (with a special UI style -like cards- and also interactive. If the user clicks in the "card" a larger explanation is showed I hope I've been clear in my doubt. Thanks for all you are doing!

[@leonvanzyl]

Hi Franco, Excellent question. Unfortunately Flowise Embed (the chat bubble) won't be able to hand over information to your website. It's basically a seperate app that is simply layered on top of your web app, with no real way of interacting with the UI. I would solve your requirement in a different way. Perhaps your website could call the Flowise API instead, and then populate the form based on the API response.

[@Francotujk]

​@@leonvanzyl Thanks for your answer Leon. Yes, I thought I wouldn't be able use the embedding. However while interacting with the api, I'm quite confused in how to "capture" the responses in a structured way. I mean, how to control the responses from the LLM in a standard format; and the "paste" the responses to another service

[@damian_w]

Many thanks for you job! Helps to understand all non code tool. It’s any chance to show how can be integrated gpts with ms teams as help channel in company?

[@leonvanzyl]

You're welcome 🤗. Will look into this.

[@iokinpardoitxaso8836]

​@leonvanzyl also interested in how to enable this Flowise chatflow under MS Teams too.🎉

[@NS_Miata]

Ms teams would indeed be awesome. This man is the best in explaining flowise on the Internet. Probs man!

[@leonvanzyl]

@@NS_Miata thank you!

[@KimTornqvist-tl3zv]

Amazingly pedagogic, just perfect!!!

[@leonvanzyl]

I had to look up the word pedagogic! Thank you 😊

[@WilsonEugenio]

Very good. You were able to send the data via webhook. But let's imagine the following scenario. You send an order code, the system searches the ecommerce database and returns the order data. How would you return the result to the bot?

[@Mesenqe]

Thank you, Leon! As always, your content is incredibly helpful, and I really appreciate the great videos. I have a couple of questions. We have several different setups, for example, one for flight and hotel booking, another for doctor appointments, and another for searching nearby bars. These tools could functions or classes which perform well on their own. If we want to connect these independent tools via FlowiseAI, how could we go about that? For instance, if a user asks about nearby bars, the chatbot should forward the request to the relevant tool and return the results. Is it possible to connect FlowiseAI with our custom tools in this way? I'd appreciate any suggestions you might have.

[@SuricataLabs]

I think there has been an update in the platform that leaves a big question about the process. now you can not upload the document / file, for file search it asks to add vector store, how do you do that? or should you upload the document in cod interpreter files?

[@leonvanzyl]

Thanks for bringing this to my attention. I'll look into this and release an updated video if things have changed. This space moves fast.

[@SuricataLabs]

@@leonvanzyl Thanks Leon for the quick reply. I know, thinks change very quickly. Looking forward for you update.

[@omarbromar]

Is it able to send and receive images with the code interpreter?

[@leonvanzyl]

I would say yes. Although not relevant to this video, it's definitely possible for code interpreter to load images and use Apis to generate images.

[@RejectAnticipatoryObedience]

Fantastic! Any idea for spam protection or to avoid brute force attacks?

[@leonvanzyl]

Yes, use the rate limiting settings as I've explained in the video 😊

[@GefersonMozzer]

Hi Lyon, I create the agent exactly like your example, but when I test it, it returns invalid input syntax for type uuid: "thread_YNsS6ZMR0iX3W3Suu83YLhCt" How do I fix this? In the openAi playground it works very well, but in flowise it doesn't.

[@Trashpanda_404]

Use Odoo for my B2B ERP, where the shop is hidden unless logged in. Want to create a Conversational QnA but define a rule to only access that customers data. Where/how would you recommend the rules to be implemented for the postgresql request? Haven’t found any documentation regarding and hopped maybe you had a source document you could recommend, or a video I missed.

[@leonvanzyl]

Please send my agency an email. It's a bit too much for a comment, but definitely achievable 👍

[@barrieroche1106]

Thanks Leon - amazing - for some reason im getting a flowise error when I test the assistant. It works ok on the open ai side but has an error of chat flow not found when testing on flowise ? Any ideas ?

[@leonvanzyl]

What's the error?

[@barrieroche1106]

@@leonvanzyl thanks for the lightening fast response the error related to a chat flow and upon checking there was no chat flow only an assistant :-) Are you open for a call ?

[@ki001]

Hi Leon, thanks so much for a brilliant video, the way you teach is excellent. I do have a quick question, I built an app that lets users create their own assistants in Open AI, is it possible to use the already created assistants in Open AI in Flowise rather than create them in Flowise? Thanks much in advance.

[@brianhauk8136]

Thank you so much for sharing your knowledge! Is it true that the chatbot code your Flowise chatbots use is for development only? Or can it be used for production after error handling is added? Also, might you do a video on production code error handling for Flowise chatbots?

[@leonvanzyl]

You're welcome 🤗. You can definitely use these solutions in production. You should always consider exception handling in your solutions.

[@sanava_ai]

Whats the best way to connect this with Rag?

[@leonvanzyl]

Hi there. OpenAI Assistant provides RAG solutions out of the box. You can upload files to it's knowledge base, or provide tools (like API integration). The best way to use these would depend on your application. If you simply need a customer chatbot that is trained on your business information, then you can just upload files to the knowledge base using the OpenAI dashboard.

[@karstenbusch3918]

Hi Leon. I am following your series. Awesome. What makes this way (integrating OpenAI Assistants) different to the methods you showed earlier in this "KZbin Flowise AI"-Series? Why should I use this method and not the one you tought earlier? Is it only that I don't need the other services like Pinecone? So I am a bit confused where and how to start. Cheers, Karsten

[@leonvanzyl]

You've hit the nail on the head. With the Assistant API you don't have to pay for seperate services (vector database and memory). There are disadvantages as well. Since all the services are with OpenAI, you are locked into their ecosystem.

[@gastonlombardistudio]

Thank you Leon !! Do you know if its possible to embeed the chat to a Canva Website?...

[@jamesyoungerdds7901]

Great video, thank you! I followed the steps and have the widget on my WP site, but every message says "failed to fetch". I have it hosted on a digital ocean droplet, and it does work on the cloud instance of flowise, but the embed isn't working. I didn't incorporate the lead gen, just the OpenAI assistant with a file retrieval. Any quick thoughts/fixes maybe?

[@Bangs_Theory]

@leonvanzyl Was it necessary to use Make in order to store the lead into Zoho? Couldn't you have sent the information directly to Zoho? Excellent illustration by the. way.

[@leonvanzyl]

The issue is ZOHO OAuth authentication process. You wouldn't be able to manage ZOHO access tokens in Flowise.

[@Bangs_Theory]

@@leonvanzyl Thanks for the explanation. If you have time, will you do a video doing the same using Airtable?

[@darwingli1772]

Thanks for the video! I have a question. May I know the difference between extracting information from PineCone database using index and extracting information from the knowledge files in the OpenAI assistant? I think previously without OpenAI assistant I can also extract data and add custom options to the chatbot?

[@leonvanzyl]

You're welcome. The difference is that with OpenAI Assistants, you do not need to use 3rd party services, like Pinecone, to store your knowledge base. It's built into the Assistant API platform.

[@darwingli1772]

@@leonvanzyl I tried this with the open ai assistant. If multiple files are loaded, I find that it will only focus on one document and ignore the remaining documents. In other words, it won’t search through all uploaded files in the knowledge files. But using pinecone, all files contents are indexed for search.Do you encounter this problem?

[@OfficiallyArtificiallyInformed]

you deserve more subs and views

[@leonvanzyl]

Wow, thank you! Appreciate it. Please like my videos. It helps the algorithm to show my videos to more people 🙏

[@BDCPT-TruongThiXuanTuoi]

thank you for your video, but I don't know why I make step by step like you do, but at 11:00 when I chat Hello, it show an errror Message like this: "Error: Error processing thread: failed, Thread ID: thread_mdI12dqWexCGUXv6d1ZXTHVB, Run ID: run_fmjL58EGTobM06y6IGbE0orB, Status: failed". Can you help me to resolve the problem. Thank you so much !!!

[@leonvanzyl]

You're welcome 🤗. Clear the chat and try again. Also upgrade Flowise and try again.

[@ritaverissimo1720]

Hi Leon, I've followed your instructions for the OpenAI Assistant, but the models you mention are not available anymore so I've chosen 4o mini (tried others too). When I say "hi" in the chatbot then I have a weird message: "Error: 404 No thread found with id 'defab' [+ series of numbers]." What should I do to fix this? Thanks!

[@leonvanzyl]

Maybe it's time for me to create an update to this video. The Assistance API had changed a lot since then. Try using GPT 4o instead. Mini might not be intelligent enough.

[@khalidkifayat]

Hi leon, very informative question was that how much we should charge client for this same chatbot (excluding make/crm/open-api-key expenses) ??

[@leonvanzyl]

That's always a good question 😁. My advice is to not underestimate the amount of effort needed for things outside of the chatbot itself. I have just finished work for a client on implementing exactly this type of assistant on their website, and had to spend a lot of time setting things up on THEIR hosting servers and website.. which took an unforseen amount of time. I would not think it's unreasonable to ask anything between $500 - $1000.

[@khalidkifayat]

@@leonvanzyl thank u for being open 👍👍

[@makiprodan]

Obrigado Leon! Acho que é isso que todos estavamos esperando.

[@leonvanzyl]

You're welcome 🤗

[@AlexanderYossifov]

Hello and nice video as always. A question comes to my mind about the prompts: In general, what is the practical purpose of telling the AI what it is (i.e. "You are a gym coach ....")? Does this mean that the AI has some algorithms and will somehow focus only on that part of its "brain" (data/knowledge) that is related to the defined role?

[@leonvanzyl]

Defining the role changes the persona of the bot slightly. You don't have to specify it, but you might get some neutral and boring responses from the bot 😁

[@Bill-ai]

Hi Leon, how do I get streaming responses using Flowise and OpenAI assistants, is that possible?

[@bigdaddy-mz]

Hello @leonvanzyl, How would I save the chat history in flowise? I mean after deploying the model on a website (as shown in your previous videos), I am interested in keeping a record of all the conversations a client has made with the bot and emailed to me along with the lead notification. Is that possible ?

[@leonvanzyl]

Hey there, you can view the transcripts in Flowise. I believe I did cover it in this video 👍

[@tas5247]

@leon I have a question. When creating the custom function, can you also do the same within open ai’s assistant page?

[@leonvanzyl]

No, you have to "code" the function outside of that interface

[@tas5247]

@@leonvanzylwhat if you are not using flowise? Can that code still work if added to the assistants interface in functions directly?

[@leonvanzyl]

The OpenAI interface does not provide any way to enter the code there. It's a complex and technical process actually. Hence me making this video 😊

[@tas5247]

Meaning could this still work if you created a json version of it?

[@iokinpardoitxaso8836]

Doesn't exist the Actions functionality inside OAI Assistants that could replace the Custom Tool used on Flowise Node? Probably the code will not be same JS based as the example too.

[@misheltal692]

Thanks Leon, your video explanation was excellent. Could you consider creating a video on how to develop multiple digital assistants? Alternatively, a tutorial on integrating an assistant with WhatsApp or other social media platforms would be greatly appreciated. Your insights and guidance would be incredibly valuable in these areas.

[@leonvanzyl]

Thank you for the feedback 🙏

[@dhirajkahol]

Totally agree, a tutorial on integrating an assistant with WhatsApp, Instagram or other social media platforms would be just great.

[@tgauss]

Thanks for the wonderful tutorial. Can we use this tool to also capture documents and pass them to the OpenAI assistant? We are looking to analyze files that a user would submit.

[@leonvanzyl]

You're welcome 🤗. I don't believe it's currently possible in Flowise, but I'll definitely cover this scenario in a video once it is 👍

[@AscendClub]

I specified when assistant should use the function but it uses is it in wrong situations, e.g., when I ask for the name of the owner of the business.

[@claudi7009]

Perfect!!! Just only an input. When I create the under make the zoho crm It is created correctly but the windows where you mach the fields doesn´t appear, so strange.

[@leonvanzyl]

I think you need to call the webhook from something like Postman first, otherwise Make will have no idea what the possible values looks like

[@claudi7009]

@@leonvanzyl Thanks for answer, I don´t know exactly what you mean and how to do that but thanks.

[@makeaiua]

Leon, what's the difference between a Conversational RAG QA and an Assitant?

[@leonvanzyl]

Same thing. A Conversational Retrieval Agent is also known as an AI assistant. The Assistant in this video is referring to the Assistant API provided by OpenAI. It's an Agent that is fully hosted by OpenAI. It's still nothing more than a Conversational Agent in the backend.

[@JoseManuel-fp7bn]

Amazing video Leon. You're a legend. Great explanation on all your videos. May I ask you something? I have tried to set up the assistant with Claude Haiku, but when it comes to send the lead, it does not do it (I am using Open AI Tool Agent). It answers everything and does everything needed. But when it has to send the information to the lead, it doesn't. Is it just ChatGPT that does it? Thanks!

[@leonvanzyl]

Thank you! Only OpenAI and Mistral supports function calling. However, Claude also supports it now but I think the Flowise team is busy implementing that functionality.

[@JoseManuel-fp7bn]

@@leonvanzyl Hopefully soon. Thanks!

[@milesbarn]

@leonvanzyl I'd really like to learn how to add Speech to text (for user input) and Text to speech (to talk back to the user) to make interaction with the tool way easier. I guess this is custom tooling, do you happen to have a tutorial on this? With openai's whisper and openai's audio speech endpoints this should be possible, however I'm to much of a "no-code" guy to understand how to do it without instructions.

[@leonvanzyl]

Hi Miles, this sounds like a great idea for an end to end tutorial. Will see what I can do.

[@fourhouraiweek]

I don't see OpenAI Assistants option in the flowise console, what could be the issue? Thanks.

[@leonvanzyl]

You need to update your Flowise version. Assistants is a new feature.

[@iokinpardoitxaso8836]

Amazing Video Leon. Super illustrative. I have a question regarding the Assistants responses passed in this case to Flowise. Do those allow Dalle-3 images same as GPTs do? Many thanks in advance.

[@leonvanzyl]

Thank you for the compliment. Assistant API solutions are seperate to GPTs. I think certain KZbinrs are confusing the market by calling Assistant API solutions custom GPTs.

[@endo9000]

would be nice if flowise would expose endpoints for each created agent so we could use them otherwise. just came around this nice tool. would make agent creation for external use much easier.

[@leonvanzyl]

What do you mean? Flowise provides API endpoints for each Chatflow.

[@musumo1908]

hello again. I love this even more in testing! Running into a slight challenge when calling the FW API inside another bot builder - ive set the api call to raw to capture last user question but as soon as the FW api responds it stops the chatflow - any thoughts on how to keep the FW chatflow "alive" so I can keep just using the FW chatwindow...thanks!!

[@leonvanzyl]

Glad you like it! You'll have to get creative with the sessionId when using the API endpoint. If you don't pass a sessionId, then you're effectively creating a new thread / conversation with each API call.

[@Avirodit]

After uploading flowise to render do we have to open flowise locally to access the cloud version because mine url of render is not working without opening flowise locally

[@memba-digital]

I'm trying to connect Hubspot with a "conversational REtrieval QA Chain" but I can't figured out. I'm seeing the only way is with "OpenAI Assistant"? Thank you

[@leonvanzyl]

What's the error / issue that you're experiencing? I wouldn't think it would make a difference, since the agent and OpenAI Assistant make use of the same tools and document loaders.

[@memba-digital]

@@leonvanzyl I'm investigating trying to undestand the different types of those chats.

[@free_thinker4958]

Thank you a lot man, could we use that with n8n instead of flowise and make knowing that n8n added the option of AI nodes with langchain??

[@leonvanzyl]

I'm actually looking into creating a completely separate video / series on n8n.

[@free_thinker4958]

​@@leonvanzylthank you man, I think n8n will facilitate more the workflow especially with the recent updates about AI nodes

[@tora4all]

is it possible to stream a openai assistant? also can i connect a exisistng assitant?

[@WayneBruton]

Great tutorial Leon, just discovered these this weekend. A quick question, I installed flowise on my MacBook and it works great. When I embed it onto a web page, also on my localhost, it works perfectly but there are no avatars / icons. They are there inside flowise but not on the webpage after embedding it. Any suggestions?

[@leonvanzyl]

Hey, you're welcome 🤗. Are you referring to the Assistant Avatar? I also noticed that it's not actually used anywhere. I'll ask the Flowise team about this.

[@WayneBruton]

Never mind Leon, found it in one of your videos, thank you and a great series

[@Peshak2008]

Very helpful video Leo. Amazing tool. I have two questions. I build on react, is there a good case, where it is ok to embed in client directly, I see that the flowise playground link is exposed? This leads to my second question, when I host the flowise online, should I not protect the playground from access, or anyone can open the deployed link and make changes?

[@leonvanzyl]

You're welcome 🤗. Check out my video on deploying Flowise to Render. In that video I show you how to protect your Flowise instance with credentials.

[@Peshak2008]

@@leonvanzylthank you. Will do.

[@RobertoFabrizi]

Is it possible to use an Agent that can call tools just like in this example but also perform lookups on a vector database? Kinda like a mix of Conversational Retrieval QA Chain and OpenAI Assistant.

[@leonvanzyl]

Yes, that is exactly what the assistant does. Simply upload document to its knowledge base and the agent will automatically figure out when to use the knowledge base (a vector store) or call tools.

[@RobertoFabrizi]

@@leonvanzyl But that's quite limiting compared to a classic rag with a vector database where I can store vector representations of any kind (and amount) of data, be it code or text split in the way that I'd consider best suitable for it (chunk sizes and so on).

[@leonvanzyl]

@@RobertoFabrizi yeah, that's one of the disadvantages of OpenAI Assistants. Building your own solution gives you way more control and you are not locked into the vendor. Trade-offs 😁.

[@RobertoFabrizi]

@@leonvanzyl If I may ask one last question on the matter (thank you so much for your time!!) how would you suggest that such use case be implemented? Leveraging the ReAct agent to invoke che custom tool?

[@leonvanzyl]

@@RobertoFabrizi I am working on an updated series on Flowise where I cover exactly this. Stay tuned 😁. It's way too complex to explain in a comment.

[@linkcv2469]

Nice work, video helped me a lot compared to other videos I have seen! Is it possible to change the opening sentence of the chat bot? It's too much generic the sentence - Hi there! How can I help?

[@leonvanzyl]

Thank you! Glad I could help. Check out my Web Embed video. You can change the welcome message using the configuration object.

[@linkcv2469]

@@leonvanzyl Web Embed video? sand a url

[@estudanterafael8600]

Great video, is there any possibility of this storage being in Bubble?

[@leonvanzyl]

Thank you! Assistants API is a service offered by OpenAI and comes with a built-in memory solution using Threads, so unfortunately you cannot swap out the memory and vector solutions. In that instance you are better off just building your own agents - I have a series on Flowise that shows you how to do this.

[@liammartin5554]

when i try the webhook part testing flowise i get a reply from my agent saying Error: Error executing tool. Tool: add_trial. Thread ID: thread_k3NsSqn9FNpLM2xPvjmRDFcl. Run ID: run_LfC7g8p2lIy3l76NIUAPmIh8 what does this mean? it isnt linking to the webhook so i am stuck currently. any help please?

[@decomagency]

Do you have a complete paid course where you can learn all the tools that flowise has because they talk about very few and I know that there are many more that are not found on KZbin

[@leonvanzyl]

I'm working on a 2024 Flowise series. What should I include?

[@barrieroche1106]

Hi Leon - ive have the chatflow disappear now several times after updating in make. Are there any known issues with flowise ? The assistant still exists in open ai

[@leonvanzyl]

Did you deploy it to Render? The free plan deleted the flows. Check out my video on deploying Flowise. It shows how you can add persistent storage.

[@AITransformers]

Awesome tutorial. Just wanted to ask since its uses Assistants API which is paid, what if the user chats about other stuff like hey buy my rayban glasses etc. How do we keep it limited so that it doesnt waste credits?

[@leonvanzyl]

You could instruct it in the prompt to only answer questions from the knowledge base, and nothing else.

[@leotechnews]

o meu sempre retorna esse erro Error: Error executing tool. Tool: add_lead. Thread ID: thread_9VvZoXrggIAa31jsCgqcByjw. Run ID: run_5VI61i5hsaPRZ2fGaFv3H6mY

[@GilbertMizrahi]

I'm using the endpoint provided by Flowise to integrate the workflow with my own chatbot. Is it possible to pass a parameter in the body that contains a URL for a doc to upload and to be able to ask it questions?

[@stevewarby12]

Hi. Is it possible to use this on a Shopify website ?

[@leonvanzyl]

Yes! You just need to be able to add script tags to the theme. This might be a good tutorial idea.

[@RussianBritish]

I noticed when the information is retreived it contains its source, like 【9†source】. How do you clean them up from the output?

[@leonvanzyl]

Noticed that too sometimes. I've reached out to Flowise so they can hopefully address it. The Assistants API natively returns the citations on the responses, and it's up to the consumer (Flowise in this instance) to remove the citations. Hopefully OpenAI will parameterize that functionality soon.

[@RussianBritish]

@leonvanzyl I've noticed that Flowise has some output parsers, but none of them allow me to run custom JavaScript code to clear those entities out. If you receive feedback from them, please let me know. I appreciate it! ;)

[@leonvanzyl]

@@RussianBritish just got feedback from Flowise. Their pushing an update SOON to remove citations.

[@RussianBritish]

@@leonvanzyl incredible news Leon. Can't wait to see it! Then I will move away my chatbot from Voiceflow to Flowise

[@ricardofernandez2286]

Hi Leon, Ihope you are doing great! This tutorial is the closest to a masterpiece so far! Thank you!! If I wanted to move the file loading out from openai, and doing it in flowise to make it dynamic via an API call, will it work if I create a separate RAG flow and then add it as a second tool in this flow? Thank you!!

[@leonvanzyl]

Hey Ricardo! I don't think there is a way to upload files to Assistant API via Flowise. I might be wrong though. You might be better off just creating your own tool agent. kzbin.info/www/bejne/eprRq5qVmayZp7c You can use the Flowise API to update the vector store. As another technical alternative, you can call the Assistant API directly to upload / manage files. You'll need to reference the OpenAI docs for this one.

[@ricardofernandez2286]

I understand. Better not to mix things. If I want to manage from Flowise I should better go Flowise all the way and create my own agent with similar functionallity. Thank you!!

[@YoNingLiu]

Thank you for sharing. I encountered an issue during testing where the add_lead function doesn't record Chinese characters when the user's dialog text is in Chinese. Is there a solution to this?

[@kevdevyou]

When I embed it, I can not scroll in the desktop version of the chatbot. Is there a fix?

[@leonvanzyl]

For interest sake, what do you mean by "desktop version"? Are you referring to the full screen embed on a website?

[@kevdevyou]

@@leonvanzyl No, I mean the Pop-up chatbot on my wordpress website. The problem is that in the mobile version I can scroll through the messages with my finger but in the desktop version I have no way to scroll up or down in the chatbot. Even if i hover over the chatbot with the mouse pointer, the entire website scrolls but not the chatbot

[@traxtibidox5775]

WoW really nice video thank you so much Leon 🙏🙏🙏💚💚💚👏👏👏

[@leonvanzyl]

Thanks Trax, glad you enjoyed it 😊

[@jbhearing6392]

This guy is a legend! So, so good!

[@leonvanzyl]

Thank you! This made my day 😄. Just glad I could help

[@jbhearing6392]

@@leonvanzyl no worries! Keep up the great work 😁

[@naveennoelj]

Leon, excellent video. Exactly what I was looking for. This is actually useful in real-world scenarios. Thanks. Use Case: I had a specific use case: Instead of Zoho, I want to connect to my custom Field Service business Application and say create tickets, check work order statutes etc. I have total access to this application [APIs and DB] and there are about 100 operations I want to perform on my application using LLM capabilities. Had a few questions. 1. What would be the best way to achieve the above integration. I guess we would need to use OpenA's function calling using Assistants. Will I need to add code/customize for each API? 2. I have heard about NL2SQL and Lanchain's SQL Chains. How do these all play together?

[@leonvanzyl]

Thank you for the feedback, glad you found this helpful 😊. Your use case is definitely achievable by adding a few more custom tools. It's a bit too much for a comment, so please reach out if you need assistance. My agency's details are in the description.

[@krissihoffmann5155]

How is it possible, that I don't have the node openai assistant?

[@leonvanzyl]

Update your version of Flowise

[@johnarnott1591]

@@leonvanzyl We are using 1.4.3 and do not see the Open AI Assistant under agents. Is there some trick to get this working? Thank you for your amazing videos. They have been so helpful.

[@musumo1908]

Would love you to make a FW calendly embed option….!!!will see if n8n does this

[@leonvanzyl]

It's the EXACT same process described in this video. Instead of ZOHO CRM, connect Calendly instead. Adjust the custom tool and prompt accordingly. In fact, you could add a second custom tools for getting available dates / times as well.

[@musumo1908]

@@leonvanzyl aha yes makes sense thanks! Will see how calendly looks inside this…Yes I want 2 custom tools…one to check times then send to CRM…this totally rocks…you’ve saved me a ton of time as was on my list for the week!! 👏👏👏👍👍👍

[@hansvanwyk5740]

VERY good content. BUT I do get an error "error clearing chat messages" is there any way I can pay for support from you directly?

[@leonvanzyl]

Try updating Flowise perhaps. Might be a bug.

[@ano0810]

Thanks for the video. This is really helpful. A couple of questions - 1. Is there a way to customize the generic greeting message that the bot presents? 2. Is there a way to get user feedback on whether they liked the bot answer? Thumbs up/ Thumbs down. I could possibly have asked these questions on Discord but the link is not working for me.

[@leonvanzyl]

You can customise the welcome message using the config object. Check out my embedding video 👍. No.2 not possible at this stage. Would be cool.

[@ano0810]

Thank you for the quick response@@leonvanzyl. Will look up the other video. In the absence of user signals - Is there any other way to figure out how Assistant is doing? How do we know where and when to finetune?

[@Nursultan_karazhigit]

I have two questions. Is there any difference between assistent and custom gpts ? and How can i integrate them in instagram or whatsapp ?

[@leonvanzyl]

Custom GPTs are accessed by the ChatGPT website and are basically custom versions of chatGPT. The Assistants API is not related to Custom GPTs and does not have the same behaviour or functionality. Instead, it a framework that developers can use to build advanced agents / chatbots. As for WhatsApp/ Intragram integration, it's way too complex to answer in a comment. In a nutshell, you need to familiarise yourself with each of those platforms' developer tools and how their webhooks work.

[@Nursultan_karazhigit]

@@leonvanzyl but is it possible to integrate whatsapp instagramm ?

[@MisterOcean5]

Hi Leon, thx for this cool Video. I really like the way you describe the entire process making this chatbot with Make and Zoho CRM. But I couldn't make Zoho CRM working, because I do not get a list of Values (connection is valid and verified!) to map the values from the Webhook. If I try with Hubspot, it works. Any Idea, why I do not get the list of possible values for the mapping in the Zoho CRM Module?

[@leonvanzyl]

You're welcome 🤗. It's a bit hard to say given the informations, but the ZOHO CRM module should automatically provide all available fields. Perhaps your ZOHO connection isn't set up correctly.

[@MisterOcean5]

@@leonvanzyl I did setup a second Account on Zoho CRM and also I used a Windows 11 Environment and Edge instead of MacOS Monterey and Safari to test it. I got the same bad result - can't se any fields like Company, Last Name, etc. Not before nor after I established the connection to Zoho CRM as shown in your Video. Are there any API values that one has to setup after creating a Zoho CRM account?

[@bobbysting]

I have the same problem. It only shows me the basic fields, and is missing many of the other ones. The one I need is "Description". If you find a solution or have any alternatives, let me know :D @@MisterOcean5

[@ziayounasch]

Hi leon! thanks for sharing such an amazing content with us... I was trying to integrate a flowise powered chatbot on my worpress website and followed all the steps mentioned in the video but getting error... the error is about rule 941110 - reason XSS Filter... can you please help in resolving it, I ll really appreciate it...

[@leonvanzyl]

Haven't seen that error before. Reach out to me via email and we can schedule a call.

[@ziayounasch]

@@leonvanzyl ok thanks

[@Matsch1503]

The template works wonderfully. However, my bot disappears in the chat flow of Flowise after about 2 hours and is not permanently saved. What could be the reason for this?

[@leonvanzyl]

The free account does not have permanent storage. Check out my deployment video to see how to set up a paid account with storage. If you're using this for business or clients, the $7 p/m is well worth it.

[@Matsch1503]

@@leonvanzyl Thank you! That explains the problem.

[@zainzahid3290]

Sir is there any free way to achieve this functionality I mean without using open AI api?

[@leonvanzyl]

You can use Open source models to achieve some of this functionality, but OpenAI is the leader when it comes to function calling at this stage. Check my videos on calling Open Source models 😁

[@makeaiua]

I can combine RAG chat bot and Assistant into one chat flow?

[@leonvanzyl]

Keep in mind that the Assistant is a RAG chatbot. I assume you're asking if you can add more than one agent to the same chatflows. I suppose it is possible, but it will involve calling different chatflows using they're APIs.

[@makeaiua]

@@leonvanzyl i make a chat bot which speak on my own information (like in u RAG tutorial) And now i want to add booking function into this bot. And i have second question, how i can make the text bold in my bots response (like on u website)

[@jonathanposselt3560]

Hey Leo, I love your videos. Is it possible to use AzureGPT as OpenAI Chat Model instat of ChatOpenAi? And how many Assitants can I add maximum to the Flow?

[@leonvanzyl]

Thanks for the feedback 🙏. This is a service from OpenAI, so unfortunately you can only use their models. I think you can only have one agent per Chatflow, but you can get Chatflows to call other Chatflows using custom tools and Flowise APIs.

[@sikander3146]

Thanks Leon for another useful video. Can we deploy these assistants to whatsapp, facebook messenger and insta?

[@leonvanzyl]

Thank you! I probably wouldn't use Flowise for those integrations at the moment. These apps have incredibly tight timeouts unfortunately, and the assistants API is quite slow on the responses at the moment. Once this improves, I'll definitely create a tutorial on it.

[@sikander3146]

@@leonvanzyl thank for the reply. What cost effective options do we have to use these assistants on whatsapp, insta and facebook? Voiceflow will be expensive I think

[@nitzantal5365]

Great video, I was trying to run it lately but I noticed the Assistants API's latency is pretty bad - sometimes it takes up to a minute for a response to get back. Do you know if there's a way to improve it or is it going to scale up soon? Thanks

[@leonvanzyl]

Thank you! Which model are you using? I think OpenAI have been battling with the load.

[@nitzantal5365]

Same one you mentioned over the video

[@leonvanzyl]

@@nitzantal5365 GPT-4 is definitely a bit slow.

[@nitzantal5365]

But if I'd like to use assistant functions I must use gpt4, isn't it?

[@pivotresearchfoundation]

@@nitzantal5365 3.5 Turbo should be able to do it as well and should be a bit faster. Try that

[@eugenbabics3614]

Don't you just hate it? Following tutorial step by step and when it gets to testing it's not working. Set up the assistant, uploaded the file with company info and when asking questions (which are included in the document) it tells me that it couldn't`t find the answer in the document provided. Checking with Open AI looks like the document is uploaded and tokens getting added like it is working but I get only negative answers.

[@leonvanzyl]

What happens when you test it in die OpenAI playground? Same issue?

[@eugenbabics3614]

@@leonvanzyl In playground mode looks like it's working.

[@eugenbabics3614]

I'm struggling with this for 3 days now> I redone the assistant 4 or 5 times, deleting all previous and starting from scratch

[@eugenbabics3614]

@@leonvanzyl In Open Ai/Assistant at the bottom of the page is a field called API Version with an option to switch to v1. If we switch to v1 will it have an effect?

[@eugenbabics3614]

@@leonvanzyl This is useless man. I deleted everything and started from scratch 7 times. Watched your video 20 times just in case I missed something. It is not working. In Playground I get the right answers but in Flowise tells me it can not find the specific information in the document provided and I asked the same question. Is there any other way to do this?

[@marpertube]

Thanks Leon, great tutorial!

[@leonvanzyl]

Thank you!

[@youwang9156]

thank you so much , this just literarily save my life

[@leonvanzyl]

You're welcome 🤗

[@youwang9156]

just wonder, after crating the assistant on Flowise, can I add functions through the Openai website? or stll have to add through flowise? it would be absolutely great if we could do modification later directly on their openai page

[@omarbromar]

add_lead didn't work

[@leonvanzyl]

What's wrong? Any errors? I had to restart the server after changing the tool.

[@myandrobox3427]

​@@leonvanzylhow do we restart it, I deployed Flowise to Railway, please guide.

[@mikew2883]

Excellent video tutorial! 👏

[@leonvanzyl]

Excellent comment! Thank you

[@udzndz4331]

I keep getting this error no matter what I ask the bot : Error: Error processing thread: failed, Thread ID: thread_b83qRVZREcWuqvW0IAwxCPWE, Run ID: run_KZe4nMKa83A6MCVbYP8yHOsz, Status: failed I did every step like you, it fails locally and in render

[@leonvanzyl]

Try clearing the chat history and try again. The Assistant API is still in Beta and can be buggy.

[@zakaria20062]

how to add memory ?

[@leonvanzyl]

No need, it's included with the Assistant.

[@zakaria20062]

@@leonvanzyl thanks for replay .. thanks for replay :) , did flowise have session retriever ? let say you put bot in telegram and have lot of users so how can remember each one ?

[@zoltanabonyi3307]

Brilliant. Thanks Leon

[@leonvanzyl]

You're welcome 🤗

[@LuisGonzales-q8m]

Thank you for this video!

[@leonvanzyl]

You're welcome!