Real-time Speech Recognition in 15 minutes with AssemblyAI

Get your free speech-to-text API token 👇
www.assemblyai...
Transcribing in real-time is a super skill only court reporters can brag about. But luckily, we don’t need to learn how to type fast to get transcriptions of audio quickly. Thanks to Assembly AI’s Streaming Speech-to-Text model (previously real-time speech recognition), it is very simple to set up a python script that can listen for audio and turn it to text.
In this video, we will see how to create this script on Python with the help of pyaudio, web sockets and asynchronous functions. The app will have the power to listen to audio input through a microphone and display the transcription in real-time. We will integrate this code into a simple Streamlit application to showcase the real-time speech recognition with a touch of interactivity.
If you’d like to follow along, don’t forget to get your own AssemblyAI API token for free at assemblyai.com
You can find the code from this tutorial in this GitHub repository: github.com/mis...
Find the written form of this tutorial here: www.assemblyai...
AssemblyAI Streaming STT docs: www.assemblyai...

[@saifullahkhan9837]

The accuracy and formatting is quite interesting here.

[@AssemblyAI]

Thank you! - Mısra

[@debojitmandal8670]

​@@AssemblyAIhi what if I want the input to be not from microphone and i want it from my speaker or laptop speaker how do I do it then.

[@pjayo]

Is there a JavaScript version of this video please? Both service side and front end…

[@lfmtube]

Most instructional and useful video. Thank you.

[@AssemblyAI]

You're very welcome!

[@otomakannioc8213]

Very sympathic and engaging presentation. Maybe the most beautiful side of Artificial Intelligence 😊

[@AssemblyAI]

Thank you!

Thanks for everything :)

[@ashiqashervegar7973]

How can I use this for transcribing particular chrome tabs for online meetings? Can you help me with that?

[@slimyelow]

Very kewl it works. However for the live service a $8 minimum is required. - but totally worth it

[@Asparuh.Emilov]

This is really awesome! I would prefer though to see the final result as a short highlights at the beginning of your videos before you go into the details of how to. But thanks anyway for the effort and the time! Hugs!

[@AssemblyAI]

Thanks for the feedback! It's definitely a good idea to give an impression of the app that is being built. With the newer videos we do a preview at the beginning of the videos indeed. - Mısra

[@Asparuh.Emilov]

@@AssemblyAI 🤗🤗♥️♥️

[@mehdismaeili3743]

Excellent .

[@claudiotassis]

Incredible video. Would I be able to use chatGPT, as an intermediate, to correct the sentences based on vocabulary and grammar, and after that, get the response from that chatGPT "reviewed" sentences?

[@mohamedshagie3342]

Yup i tried to make it but it worked only text cant use speak 😅

[@MrThought2012]

Very nice and easy setup! Took me ages to achieve the same with whisper. However, are you planning to support other languages, german, french or even a multilinugal model?

[@omarsiddiqi5018]

Can I ask how you were able to do it?

[@alexander5429]

@assemblyai : When will you finally support Streaming in German?

[@fahnub]

Does it also offer diarization in real time?

[@ckames22]

Awesome 👍

[@AssemblyAI]

Thank you!

[@1992kshitizyadav]

As of now, only the English language is supported in the live transcription feature. when can we expect more language support ?

[@lookersky6145]

I've this installed and worked on windows. My question is that Real-time Speech Recognition only recognize english ? Does it support other languages ? Thank you.

[@Pinkijhabnp]

Thank you for this nice tutorial

[@AssemblyAI]

Glad you liked it

[@usus8420]

hi great works but what about smartphone ?

[@PoojaVerma-sl6mg]

Could you please instruct me on how I can include this in my Angular project?

[@KashyapJadav]

Live transcript is paid version?

[@adhikesavan9377]

when i tried to install pyaudio terminal displays this error: "Cannot open include file: 'Python.h': No such file or directory "

[@Miguel-hq1lx]

is it possible to transcribe in real-time in other languages, such as spanish?

[@weebiesoftware6296]

I want to implement a realtime app using voice recognition on python 3 / android 11 on my samsung s22. It's my understanding portaudio is NOT supported on Android 11. Is portaudio your only way to get to the mic?

[@moncefarajdal4582]

Can you please let me know how can I integrate this in my JAVA Maven project?

[@AssemblyAI]

Hey Moncef, unfortunately I also don't have experience on that. -Mısra

[@GiulianoGolfieri]

Is it possible to use this service in other languages apart from English?

[@tiagofyhnesteves74]

im also trying to find an answer to this question

[@GiulianoGolfieri]

@@tiagofyhnesteves74 they answered to me privately. It's not possible yet. I switched to Azure cognitive services, which is multi-language.

[@frizzfrizz3550]

@@GiulianoGolfieri I had taken it for granted that it was a multilingual service, a fucking morning's work wasted. Grazie della info, Giuliano

[@amineelarif7001]

that is sick! goodjob

[@AssemblyAI]

Thank you Amine! - Mısra

[@spinal_cord]

I know this is a little old, but I get a 4002 error, what might cause that?

[@walker71391]

Did you ask ChatGPT?

[@HomelessRafi]

How can I introduce um, ahs, and other filler words in to the Realtime transcription? I see it is an option for uploading an audio file

[@borr2749]

Assembly ai real time transcription doesn't have a free trial ?

[@onintsoavola5698]

Is it possible to make it faster ? The transcription takes a little time

[@loubino18]

Should have mentioned cost to go to pro version.... why hide it?

[@GaneshRedagani]

can you pls let me know how to save that text

[@eagold]

buut.. if i have no money to buy the pro key?😕

[@AssemblyAI]

You can get started for free!

[@MDMUHTADEEFAIAZKHANSOUMIK]

Can we setup Bangla language for this system?

[@parameswaranesnsce-cse9491]

can we speak any indic languages , will this endpoint will transcribe or not ?

[@AssemblyAI]

Yes AssemblyAI's API supports Hindi Transcription, check out this tutorial: kzbin.info/www/bejne/aYjPf4J5mt6soLM

[@REALVIBESTV]

Can this work in Unreal Engine 5

[@angelfernando8954]

Hi. how can i change the lenguage to transcript in spanish?

[@AssemblyAI]

Hey Angel, here is the documentation on transcribing in languages other than English. docs.assemblyai.com/walkthroughs#specifying-a-language

[@dirtydevil81]

@@AssemblyAI But do different languages work with realtime transcription on this specific endpoint? The documentation, regarding changing the language, is not clear about this.

[@giovanniied]

@@dirtydevil81 do you find a solution?

[@rubibeats]

how to add custom ui?

[@bakhshizade]

I am here for Freddie.

[@IntricateMoon]

I'm on windows, When I try to run it it does nothing, just creates a new line on the terminal. when I cloned the github repo, it was working, hmmm

[@AssemblyAI]

Have you tried speaking while the code is running? It might be that you don't have a microphone connected to the computer.

[@siamkamelia87]

does this work for song transcription ? in real time ?

[@AssemblyAI]

Hey Siam, depending on the amount of background music and clarity of pronunciation you'd get varying levels of success with transcribing songs.

[@marlontuquerres6072]

THIS IS ONLY AVAILABLE ON MAC/LINUX, RIGHT?

[@AssemblyAI]

No, it is available independent of the operating system.

[@ibrahimimohssine8131]

is assemblyAI support arabic language with vowelization?

[@AssemblyAI]

We are launching support for Arabic in late January!

[@benyusu8045]

received 4001 (private use) Not authorized; then sent 4001 (private use) Not authorized

[@Homurdan]

Aha Türk !

[@egeyay9470]

Ahahahha

[@barankaya3333]

Türk müsün?

[@valerozanoni952]

When i added this line if json.loads(result_str)['message_type'] == 'FinalTranscirpt': it wouldnt transcript anything anymore