Discover LlamaIndex: Joint Text to SQL and Semantic Search

In this tutorial, we show users how to make use of a feature within LlamaIndex that allows them to join the results from a SQL database with that of a vector database, with the help of LLMs.
This combines two stacks: text-to-SQL for structured data as well as semantic search for unstructured data (both of which LlamaIndex has).

[@starmorph]

excited for this whole channel!

[@oaga74]

What if the information is distributed in multiple tables within the SQL database? Would LlamaIndex be able to join the relevant tables without the user explicitly citing them? This question is essential, especially if the tables are not labeled more intuitively e.g. a table having cities labelled/named as Lctin!

[@zeppelin2105]

hi~could u share more about the selector realization? whether i can use the llm itself to realize?

[@ravigurram9884]

is it basically a NL2SQL method?

[@renaudgg]

why we use pinecone exactly? i know with llama_index there is alresdy some VectorStorrIndex etc is it because pinecone does it better? i dont understand that part

[@Jason-o5s]

Cheer~~~add (comments or supplementary information) at the end of a speech or text.😊

[@garyjo3229]

And ollama2 is posible language natural to sql ?

[@elruinnou]

Is there any JS version of this? At least for the structure ones, cz I think it’d still be better if the unstructred ones can just use python

[@vishnuajoshy1588]

Instead of using open AI..Can we do this using Llama or mistral model?

[@vgtgoat]

Yes you can run your own server with something like Oobabooga textgen webui

[@MrSawaiz]

Can we implement the same thing in Langchain?

[@vgtgoat]

Very little reason to implement it yourself with langchain when llamaindex exists here. You could recreate all this with raw langchain if you want technically though.

[@MrSawaiz]

@@vgtgoat I understand that but I am having some issues while using this query engine. I asked on their discord channel and they said that they won't be fixing the bug any time soon. I thought maybe I'll implement my version

[@thestereokid6073]

There's other examples of combining langchain and llamaindex, I'm working on figuring that out right now. glhf.

[@ravigurram9884]

@@vgtgoat llamaindex is not opensource and is a commercial product right?

[@deeplearning7097]

Thank you very much, very nice work. Could you please share your notebook? Thanks again.

[@DenisBougrimov]

Can something similar be done with SparQL instead of SQL?

[@SanjayRoy-vz5ih]

Yess, if it is pretty trained with SparkQL and has a solid understanding developed over time

[@jcachat]

🔥🔥🔥

[@CharlySUASISA]

how can we use llamaindex on nodejs ?

[@kelvinadungosi1579]

Hi what if I dont have ustructured data and instead of a vector store, I just want to query the llm itself or the general internet. Plus how to implement chat functionality where by I can ask follow up questions based on previous answers?

[@dota2gammingfun93]

How can i use it whithout OPEN API KEY - i dont want to use Open AI and want to use open source llm

[@dennissdigitaldump8619]

There was a pine api key. This is Llama, which can be run locally.

[@SanjayRoy-vz5ih]

​@@dennissdigitaldump8619 pine is a vector database and has nothing to do with foundation model llms though...one way is to use huggingface hub api token

[@jayasreelingam5862]

Can you share the code once

[@FoxnewsFan]

So it's basically some sort of an Agent

[@ohmatokita5990]

Hi , what if the SQL database has 10 million records, this code still working?

[@SanjayRoy-vz5ih]

Unlikely without a pro version with unlimited token size limitations, you will face challenges

[@____2080_____]

You stated that the Jupiter Notebook was linked in the description. I don’t see it. 🫨

[@gabrielkeith3189]

And folks... he put the QR code in the video.😅😅😅

[@daviteodoro1225]

TORONTOTOKYO ?