Use ChatGPT-4o Vision on Images with Power Automate

[@andrewhess123]

Ok, it seems the ChatGPT + Power Automates videos are not hot enough currently 😀Will be switching topics next week. Back to Power Apps?

[@JulianTRamon]

Hi @andrewhess123, you just come on my feed so maybe the youtube algo is taking a bit. I love this content and for my org is right up our ally! Would love to see how you would connect to GPT Assistants via PowerAutomate.

[@andrewhess123]

@@JulianTRamon You are right about the GPT assistants to Power Automate, that would be golden! 😀

[@waleedkhan2500]

Would like to throw my hat in the ring and give my appreciation for your informative videos. The gpt and power automate/apps integration is something that is seemingly invaluable at the moment. Would love to see some use cases and tutorials for gpt integration to dataverse as-well. Thanks for the great resource Andrew!

[@andrewhess123]

@@waleedkhan2500 Thanks I think the youtube algorithm may of hid my video a little bit 😀. Seems people are very interested in this stuff, just like I am.

[@hammadyounas2688]

Can you make the same tutorial for resume attached in attachment (PDF) to extract the information regarding the PDF, like Years of experience, SKills?

[@andrewhess123]

Thanks Hammad! Let me see how well ChatGPT API does with this stuff, maybe it perfect, not sure yet. I know some options in SharePoint premium and Cognitive Services in Azure can do this though.

[@hammadyounas2688]

@@andrewhess123 Yeah but ChatGPT extract the details from the pdf. As we can upload any document to ChatGPT. Is it possible you can make tutorial on it?

[@hammadyounas2688]

@@andrewhess123 Which options can do this in sharepoint premium? I just want to reduce cost thats why i am targeting chatGPT.

[@andrewhess123]

@@hammadyounas2688 I am not sure which cost is best yet. Many of these concepts are very new. There are "autofill" columns that you can set up: techcommunity.microsoft.com/t5/sharepoint-premium-blog/introducing-sharepoint-premium-the-future-of-ai-powered-content/ba-p/3981076. Also using Microsoft Syntex you can do OCR also: www.linkedin.com/pulse/microsoft-premium-syntex-optical-character-recognition-eda-f0xme/ I am currently researching all of these options.

[@hammadyounas2688]

@@andrewhess123 You already pass the image to the chatgpt, so there is not much time to make a tutorial on pass pdf to chatGPT which produce the summary of the pdf.

[@mikeloopsthings]

just discovered your videos, really fascinating. I've started using powerautomate a lot and chat GPT so these were really helpful. Do you think it would be possible using a similar method to use powerautomate and GPT vision to analyze an image and generate a PDF report (based on a template) and using a custom prompt. This could potentially save a massive amount of time at my workplace.

[@andrewhess123]

Yes totally possible. Worth checking out the Microsoft side of things too. With Power Automate you could customize the template just how you want it to too. 100% it's possible and the options are available for which AI tool you want to use: azure.microsoft.com/en-us/products/ai-services/ai-vision.

[@mikeloopsthings]

@@andrewhess123 yes!, thanks for this mate. it looks like Azure AI might be just GPT4 turbo and not GTP 4o? Cant quite find clear info. Using powerautomate with gpt vision is definitely a game changer. So many practical applications.

[@andrewhess123]

@@mikeloopsthings I believe that is correct, currently it is just GPT4 Turbo and not GPT-4o

[@mikeloopsthings]

@@andrewhess123 thanks mate. i really love the idea of using powerautomate. Realistcally im just looking for a reliable automation to upload images to GPT and have it analyse them send back the data. I cant see any way to do this natively with GPT so powerautomate would be the most obvious way