Building Customized Text-To-SQL Pipelines in Open WebUI

[@EricWang-u4x]

Thx for sharing and it's really interesting to learn more about the pipeline projects related to open webui.

[@johnkintree763]

Lovely demo of the synergy between language models and databases.

[@orafaelgf]

great video. hoping to see more as soon. congrats.

[@jordannanos]

hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: kzbin.info/www/bejne/n325qnidrayVnZY

[@arjuntrivedi4622]

can we have the link of the Script ? also would love to know the which DB you used, MySQL or what are the other DB you can recomand ?

[@jordannanos]

@@arjuntrivedi4622 code is demo’d here kzbin.info/www/bejne/n325qnidrayVnZYsi=G0D6jOv6UzCd793k Also link to the pipelines in that video description

[@jordannanos]

@@arjuntrivedi4622 it’s tested with Postgres originally and that’s the code I review. Would work with any DB you can connect to with python

[@hasaniqbal3180]

Thank you for this. Can you share more info on the RAG pipeline along with code examples.

[@jordannanos]

working on getting it to run on both vLLM + ollama endpoints with llama3.1 + mistral. prompt uses llamaindex for text-to-sql.

[@jordannanos]

similar to this guide: docs.llamaindex.ai/en/stable/examples/index_structs/struct_indices/SQLIndexDemo/

[@jvannoyx4]

Great job can't wait to see more

[@jordannanos]

@@jvannoyx4 hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: kzbin.info/www/bejne/n325qnidrayVnZY

[@dj_hexa_official]

Jordan , Super good job. I'm trying to integrate openwebui into my CRM system. That I would like to query the database for any of our product price or everything through the chat for my employees. This rag pipeline can make it in this way for example ? Thanks you for your answer

[@jordannanos]

hi, I think if you've got a db you should be able to query it. especially if you already know how using python. I posted another video. code is here: github.com/JordanNanos/example-pipelines video reviewing the code: kzbin.info/www/bejne/n325qnidrayVnZY

[@dj_hexa_official]

@@jordannanos Thanks a lot Jordan . Super cool

[@JJaitley]

First of all great job Jordan. It would be really helpful if you could share the code on git.

[@jordannanos]

hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: kzbin.info/www/bejne/n325qnidrayVnZY

[@RickySupriyadi]

minds to share your code please?

[@jordannanos]

@@RickySupriyadi hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: kzbin.info/www/bejne/n325qnidrayVnZY

[@RickySupriyadi]

@@jordannanos wow cool, thank you.

[@Ke_Mis]

"Just 2 A100 GPUs"....That humble flex😂. Well at least my 1070 GTX can also run the llmaa3.1 8b model.🥲