[PowerApps] MULTIMODAL GPT-4 and WHISPER in Canvas Apps

[@jonaskarlsson477]

I get problem with the api when i use a mobilephone with the app, desktop workes

[@daniellesutton6059]

awesome video! i've been having troubles with the json, is there any chance you could share the json code?

[@R2Power]

OpenAI documentation is pretty good and has good examples. They can explain their API better than I ever could 😉 platform.openai.com/docs/api-reference/chat

[@shreyayadav2131]

How to use it for mobile . I am facing the error of unsupported audio format

[@R2Power]

Haven't found a solution for that. Seems like the API doesn't support the Android/iOS audio formats 😢

[@jonaskarlsson477]

kzbin.info/www/bejne/g6CZdmOZrKiLkJY Pleace come back if you solve it... i haven't solved it yeat. But we have contacted one of top 10 Power Platform developer in the world now.

[@robinsovasco1900]

Hello, how do you get full screen in development mode?

[@R2Power]

Press F11 (works in every Browser Window)

[@Amersfoort10]

I use the following command without a flow to convert a microphone recording to a text: Set(mySpokenText; Whisper.Speech2Text(Microphone.Audio; "audio.wbmp"; "whisper-1"; {'Content-Type': "multipart/form-data"})) What is the advantage of your flow solution?

[@R2Power]

No, just didn't get it to work... Could you upload the yaml/JSON for your connector?