Production-Ready Optimization Strategies for RAG

[@AI-Makerspace]

Repo: github.com/AI-Maker-Space/Chainlit-Event-AIM/tree/main Event Slides: www.canva.com/design/DAGRHbLsvx8/EVQN5H1yJtzutJBqHbTBrw/view?DAGRHbLsvx8&

[@seanbergman8927]

Great topics! Sounds like lots of people must be in the phase of moving from demo to prod. Exciting times! I’m in the midst of this now after pitching my RAG POC to corporate execs. I found that streaming the LLM outputs with pipeline that involves functions with multiple query tools is not easy! Need to get asynchronous streaming working next. Another topic for prod is going to be switching to FastAPI and a React widget for the web team, moving to AWS or Azure and integrating with their tracing and guardrail tools. Also on the agenda is red teaming on dev website before launch. Also need admin panel and a scraping & indexing pipeline if context is from your company website content (mine is starting with blogs, etc.)

[@AI-Makerspace]

WTG Sean awesome stuff, man! These are great additional topics for us to consider events on in the future - thanks!

[@MegaClockworkDoc]

I like the wiz's new look

[@AI-Makerspace]

We do too. Fresh 😎

[@lucindalinde4198]

OMG such a helpful sesh. I had heard these terms before but never understood how they work together and what they mean. Love the care you put into explaining important concepts and illustrating them with real examples.

[@AI-Makerspace]

Thank you Lucinda! We're looking forward to keep building slowly upward further into production from here!

[@andresrubio2015]

Top as always