Use Azure Cognitive Service Form Recognizer and Power Automate to Extract PDF Text

[@NS-gr9cy]

really liked this innovative camera view.

[@CassieBreviu]

Thanks!! 😊

[@saurabhkumar-vj6xp]

Thanks, Cassie for this helpful session and for explaining it with simple eg. Doing great work.

[@sathya2870]

hi cassie, for me the train model action is not visible in my power automate the application, for this option, we may have the any subscription

[@SagiSulimani]

I stuck on the spot when I need to create a ”Form Recognition” (3:52 on the tutorial) - The list of “Actions” is empty when I try to do so. Any ideas? Thanks!

[@SagiSulimani]

Apparently the Form Recognizer connector is deprecated :(

[@CassieBreviu]

Its now part of AI Builder. Checkout the docs here: docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/tutorial-ai-builder?WT.mc_id=youtube-talk-cassieb Check out the steps here on this blog: techcommunity.microsoft.com/t5/azure-ai/extract-data-from-pdfs-using-form-recognizer-with-code-or/ba-p/2214299

[@soulcracker23]

Great work Cassie. I will try it

[@JoshuaMadurai]

very helpful...please make more content, you explain concepts very well

[@rebecca4762]

Thanks for the video and update! Are we able to extract signatures with the AI Builder form recognizer?

[@22bdickson]

hi Cassie, this is very informative. Thanks! Can this same process be used to translate legal language within contracts (PDFs) into a structured data format to be ingested into a database for reporting purposes etc?

[@KansasKidzs]

Thank you so much for vlog...

[@FranciscoCamacho_fjcamachoj]

Hi, I guess this is a cheaper option for using AI with Azure instead of the AI capacity of Power Platform. Great video, thanks.

[@CassieBreviu]

Thank you!

[@xinyiluo6587]

This is so helpful! Thanks a lot.

[@dwainbrowne]

Great presentation, thank you!!! Please post more, more more :)

[@justdeeeeeeeeeeeeeepak]

THis Helpsssssssssssssssssssss........ Thanks

[@hmn4124]

This From Recogniser seems to have been deprecated.

[@lmrpereira]

I can´t find form recognizer steps on my power automate, are there any license requirements? From pricing mode I understood that there is a free tier that would allow me to test. Thanks in advance!

[@CassieBreviu]

Its now part of AI Builder. Checkout the docs here: docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/tutorial-ai-builder?WT.mc_id=youtube-talk-cassieb

[@engrAbdul1]

What about invoices having 100 of line items? Do forms recogonizer works accurately with such invoices.

[@CassieBreviu]

You could use the customized Supervised Machine Learning model in Form Recognizer to label your data for more complex forms: docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/overview#custom-models?WT.mc_id=youtube-talk-cassieb

[@ResponsibleXI]

How I use this if my documents are uploaded on SharePoint Document library? We dont want to go with AI Builder Forms Processing due to hefty licensing cost. Looking for Azure Cognitive services. But can I my documents be stored on SharePoint?

[@johnmctiernan4937]

Seems Train Model is no longer supported (or at least I dont see it). anyone else?

[@deeps5526]

i cant see too

[@sebastiannickel3044]

I miss the most important information how to train a model? In this example everything is prepared, you have a model, etc. But how can I get to the model?

[@joshoverholt3141]

Search google for FOTT

[@CassieBreviu]

Do you mean download the model created from the service? This service doesnt have the ability to download the model at this time. I could see it being added in the future for offline runs and then it would connect back to the cloud for billing similar to how the Custom Vision Service works.

[@pinkystar2020]

Hi how about handwritten invoice? What is the accuracy rate?

[@CassieBreviu]

There is a confidence score returned with each field that is found on the PDF. If you mean the accuracy rate of the model that was not something I documented when I created this. However my confidence scores returned are almost always in the 90th percentile. If you have PDFs that arent performing you may need to create a supervised model and use the labeling tool to train the model. Check out more on that here: docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/quickstarts/label-tool?tabs=v2-1

[@surooraga7978]

How do we train the model?

[@cassie1486]

The first flow trained the model from the training data in azure storage

[@CassieBreviu]

The first Power Automate Flow trained the model from the Azure Storage Account with the 5 PDFs. This was the unsupervised learning model built into Form Recognizer. If you need to label your data (for more complex forms) you can create a custom model as well. docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/overview#custom-models?WT.mc_id=youtube-talk-cassieb

[@surooraga7978]

Can it extract written text?

[@cassie1486]

Yep!

[@CassieBreviu]

Yes. docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/overview#layout-api?WT.mc_id=youtube-talk-cassieb

[@adolfocorrea3569]

whya a flow vs a logic app?

[@CassieBreviu]

You could use a Logic App as well!

[@G1g3-c8k]

Hi

[@mundadasiddhant]

Uhh my neck is hurting seeing you