How To Use the NEW Streaming Feature in OpenAI Assistants API

⚡️ Discover how streaming transforms AI agent interactions, making them faster and more intuitive than ever before-unlock the full potential of OpenAI's Assistants API! 🚀
📝 Collab notebook:
colab.research.google.com/dri...
🤖 AI Agents for Your Business:
agents.vrsen.ai/
🔋 OAI-Widget (My SaaS)👇
www.oai-widget.com/
🚀 Custom AI Projects:
www.vrsen.ai/
🤝 Consulting/coaching:
calendly.com/vrsen/ai-project...
🐦 Twitter:
/ __vrsen__
💬 Discord:
/ discord
00:00 - Intro
00:45- What is Streaming?
03:30 - Assistants API Streaming Tutorial
08:47 - Agency Swarm with Streaming
10:30 - Production Tips
About: Uncover the pivotal role of streaming in optimizing AI agents within OpenAI's Assistants API in this insightful video. Streaming isn't just about real-time data; it's a game-changer for AI interactions, significantly reducing latency to enhance user experiences. Discover how streaming benefits both users and AI agents, like ChatGPT, by facilitating immediate and engaging communication. This guide offers a step-by-step tutorial on integrating streaming into your AI applications, using the Assistants API and the Agency Swarm framework. Whether you're developing front-end applications or curious about backend integrations, learn how to leverage streaming for better responsiveness and satisfaction. Dive into the essentials of streaming for AI agents today and ensure your business stays ahead in the AI revolution. Subscribe for more expert advice on AI advancements.

[@vrsen]

Hey everyone👋, we are currently looking for AI Agent Developers to join our team. Please apply in our discord in job-posts channel if you are interested. (link in description) Thanks!

[@ailxes]

Im interested in creating an AI agent for a small project with a finite amount of knowledge database with use for RAG purely for context with fixed API costs. How do I contact you?

[@AIPlayGrounds]

Bro you are a gem, other creators didn’t understand the streaming that’s why they didn’t talk about it. Great value 👏

[@vrsen]

🙌

[@ronsijm]

Streaming is sick. I made an internal slack bot for people to chat with. First I wasn't using steaming, and whenever people were chatting with it, I needed to wait for the entire request, and everyone was complaining the bot was shit and slow. Then I build in a streaming function, now the bot is creating a slack message almost instantly, and then editting the message as the words are coming in from OpenAI. Now the bot is preferred over using the ChatGPT web-interface, because people don't have to context-switch from slack to the browser

[@alexanderholmefjord-sarabi3402]

thanks for the videos, i think you're one of the very few whose ideas have change the way i approach these tools

[@IdPreferNot1]

Love the details.

[@7polletes]

By the way i’d love to learn about your saas development process. It would be incredible.

[@amandamate9117]

did you tried to use your agency swarm with some Claude 3 model like the cheap Haiku that is beating gpt-4?

[@raymondwienand8177]

Great info! I would like your opinion on Devin.

[@MushtaqPatel-up1fb]

Hello Arsenni, Thanks for the all informative nad great value videos. Could you please create the playlist so it we will easy to follow and watch? Currently, there is no order in video which one to go first.

[@vrsen]

Right, will do. Thanks

[@NiklasOtto]

Hello @vrsen, what are the advantages/disadvantages of Agency Swarm compared to Crew AI?

[@AiDevHamza]

Hey nice video! I would really love to know the development process of your saas platform, I want to Launch my own AI SAAS but I have a lot questions and confusions in my head.

[@itaitevet]

Hi, how could you add a knowledge base to agency swarm? For example, how would you train the AI based on your previous Facebook posts to create new ones with a similar style? Thanks!

[@7polletes]

Go go go!!

[@sendmepackets]

Such a brilliant approach

[@selftaughtDevv]

hi VRSEN can you create a video based on perplexity online llms and can I use their API endpoint which offers vast LLMs for creating agents

[@jakobdango170]

Hey just curious have u stuided cs or gathered team of devs and u mostly run ideas and business and sales

[@vrsen]

Yes, I studied CS, but dropped out of college after my first year. After that I read a ton of books on AI and worked as a freelance ML engineer for 3 years. I am still quite involved in coding, however I am trying to focus more and more on design work, rather than on implementation.

[@ytvids.io123]

@@vrsen Hey do you have a way to account the tokens in my loved framework Agency Swarm.. Appreciate your efforts!

[@djilalifaycal2191]

hi ,i have app use twilio to get a vioce query from user than take that query to gpt model to get a response than sand this response to twilio to respod to user my probleme is whene user speak its take so long to respond any idea

[@vrsen]

I don’t think you can use gpt streaming, because if you are sending back a text, you need to have a complete response anyway. The only way to reduce latency in this case is use a smaller model. However, if you are sending back voice on a call, you could probably use streaming when generating voice from TTS model.

[@kazmi401]

This man is nice. But why is so underrated on youtube. Keep it up man.❣

[@____2080_____]

Definitely would like to hear a video but is that something that someone can call you and consult about?

[@vrsen]

Yes, of course. You can use a link in the description. I reveal any secrets and insights for my consulting clients

[@cesargaray5809]

​@@vrsen The website does not work in the creation part of openai

[@cesargaray5809]

The website does not work in the creation part of openai

[@zackmartin00]

Do you work with smb?

[@vrsen]

Yes, checkout agents.vrsen.ai/

[@cesargaray5809]

@@vrsen kzbin.info/www/bejne/n3m5gWqJoNWIfqc

[@2008tmp]

The big problem is that assistants API costs are uncontrollable. Until they fix the back-end and billing model, they are useless for anything but a demo.

[@vrsen]

Yes you are right. They definitely need a way to control amount of tokens that goes into the model. I am sure they will add it soon. In the meantime, I recommend just creating new threads as needed

[@technologyforyou7621]

All talks n no practice step by step funct

[@cesargaray5809]

The website does not work in the creation part of openai