How to Stream OpenAI API Responses in a Flask App

[@heronfree7374]

Thanks!

[@heronfree7374]

You are a life saver with this video. Was looking for how to stream like this forever. Thanks so much!

[@WayneBruton]

Great video, would love to see one using the new streaming with the assistants api

[@prettyprinted]

I'll look into that and I'll see what I can do. My next video should also be an OpenAI API video.

[@enriquebruzual1702]

What an opportunity for HTMX

[@prettyprinted]

Yup, HTMX would work well with this. Thanks for watching!

[@jamiewise2489]

Very helpful video! I have found that when I stream output, the translation from markdown to HTML is sometimes applied incorrectly on list items (especially nested and ordered ones). I think that this could be due to some chunks lacking the full context needed for the HTML tags to be applied correctly. Do you have any ideas/ways to approach handling this?

[@henkmassink6713]

Great video. Question : How can the stream also cope with latex (formulas). I tried mathjax, but did not get it working

[@yasminesmida2585]

can we specify the max_tokens with stream parameter?

[@josklijnhout1660]

Hi Great video, do already have it working for the assistent api, because my heads exploding. maybe you know. I have it in react, but want it in flask java

[@tushaar9027]

Thanks bro,.....it really helped .....I was looking for implementation with flask..pls make another video on how to use these streaming api in python backend code with request module as well

[@andreialuculesei1842]

May you make a video where we can do an api using async ?

[@prettyprinted]

Do you mean this library with async? I don't think the streaming would well with an async approach (assuming your goal is to call the API multiple times)

[@-ankit198]

I love your videos !! Can you make the same tutorial in node.js through I work in both flask and node.js but would really love to learn it in node !!

[@prettyprinted]

If I made more videos, I'd definitely do a Node version, but given my output these days, it's more likely to be either Django or FastAPI. Thanks for watching though!

[@ashishkingdom]

Cool!! I couldn't get this working in FastAPI

[@prettyprinted]

Thanks for watching!

[@pythonantole9892]

Good example for an HTMX use case.

[@prettyprinted]

I'll consider using HTMX for this in a video. Thanks for watching!

[@abdulnafihkt4245]

Can you do how to set up rabitmq on flask

[@prettyprinted]

I'll consider that as a video. Thanks for watching!

[@AliMughrabi]

❤

[@prettyprinted]

Thanks for watching!

[@rangabharath4253]

Awesome

[@prettyprinted]

Thanks for watching!