In my PDF files, there are several questions organized in tables. I want to extract these questions group by group, considering the headers, etc. There will be 4-6 sets of questions. Should I use an LLM for this task? I believe Llama cannot handle this part. If so, which ChatGPT model would be the best fit for this use case? I previously implemented a project involving chat with multiple PDFs using a specific model of chatgpt. Is it still a good idea to use that model, or is there a better option available now? By the way, I will have some paragraphs in future pdf files where I am supposed to extract structured data as well. What is your recommendation in general?

hey there, is that because your company requires that the data not leave the premisses?

<3

that would usually take a bit of time :/ the good news is that you only need to do the indexing once. after the contents are indexed, retrieval is very fast

will do!!

absolutely, that's the main use of this api. since the table is converted to markdown, it can be used in retrieval for rag apps :)

is he good at retrieval?

@@alejandro_ao yes, as long as he's given a reality check

Much appreciated :)

Noted!

absolutely. it even works with powerpoint slides

@@alejandro_ao I just tried it gave me the markdown. But the images are missing 😞

hey sam, i'm glad this is useful! that's a great question. i am actually working on a comprehensive set of tutorials dealing precisely with with multimodal rag. essentially, you have to use a model with vision like GPT-4V to parse the tables and images if you want to do this. expect to see this in the channel soon!

@@alejandro_ao MANY MANY THANKS 🙏 🙏 🙏 that will help the academic research greatly! Passionately looking forward to watching and learning from them!

hey man, thank you so much!! so glad to have you on board and very happy to know that you have found my work useful :) let me know if i can help you with anything :)

@@alejandro_ao Come on bro, I'm just doing a cancer project and although it's not similar to the dataset you used, the example you gave in other videos was one of the things I also used as a guide. When it is well prepared I will show it to you so you can give an opinion.

it's my honour

thanks chris!

hey there, thanks! sure. the theme is robbyrussell and i'm running it with ohmyzsh 😎

hey there, it is possible to have LlamaParse run within your own system. but that is only possible for bigger companies with their enterprise solution. you can get in touch with them for that here: www.llamaindex.ai/contact i am not an official interface of LlamaIndex, but when I asked Jerry (the founder of LlamaIndex) this same question, he mentioned that LlamaParse (and LlamaCloud) uses its own GenAI for parsing these documents, and the process and model they built to make this possible is proprietary. so you cannot just install it on your computer. however, if your company requires that the data never leaves your premises, they can put LlamaCloud within your servers with the enterprise solution. if your concern is privacy, Jerry declared that they do not store any source data from their clients. sometimes they might store metadata of the documents to improve retrieval, but that's all. you can hear his response from this same question here: kzbin.info/www/bejne/n57PgmSfmN2jeLc on minute 41:34.

@@alejandro_ao Right!! Thank you very much for your feedback.. I need to extract tables from laboratory PDF documents, this is extremely sensitive data. That's why I'm looking for an LLM or IA that does this locally. I have already managed to extract when the table is only on one page, but the table sometimes overflows into several pages and then it becomes more complex to apply logic to it. I will continue to look for a solution.. I always watch your videos, they help me a lot. Congratulations!!

@@vagnerbelfort687 This means a lot! Thanks!! That sounds like a pretty interesting task. Let me know if you find a way to do that. I am preparing a bunch of videos on advanced RAG so I might cover something like this soon!

you're the best

no problem! it's mostly useful to create RAG applications

happy to hear that!

@@alejandro_ao Thanks. But I asked for an email to contact you :)

Hey, sorry about that! That must have been a bug with my UI! Sure, you can send me an email to [email protected]. I will be going back to consulting starting from next week.

thank you so much!

indeed, they use GenAI for parsing the documents, and it the exact way how they do that is part of their secret sauce. but they make it possible to run LlamaCloud (and LlamaParse) within your servers as part of their enterprise solution so you can be sure that the data never leaves your premises

​@@alejandro_ao can implement this using NextJs React?

not yet! it has been in my todo list for a while, but haven't got around to doing that yet. the repo is open source, though. so if by any change you are able to do it, i will be grateful!

i love this idea

@@alejandro_ao thanks! Excited for it. I think its a very common use case where ppl wanna have multimodal RAG on several doc types and return the source doc

hey there, i have a pretty rudimentary tutorial here: kzbin.info/www/bejne/bWXGZH6Xdr2DrM0 in it, i show how to deploy a streamlit app like the one you see here

<3

maybe i should change the thumbnail 😓

@@alejandro_ao more clickbait

@@rifkyuntara6112 i'm trying to make it more clickable 😅, not super good at it!

there's one coming up this week indeed :)

Thank you! Cheers!