Speech Recognition in Python | finetune wav2vec2 model for a custom ASR model

[@infinitewebrevolution]

Thank you so much sir with your hard work and pertained model, it has helped me alot I would always thank you

[@PyLessons]

Glad to hear that! You are welcome

[@filofilo9695]

Why do you use batch size = 1. Is it just for ram space reason? Great tutorial thank you!❤

[@hugok6212]

Excellent video and explanation. I have a question, if I train a model this way, can I use it for speech recognition in real time?. Thank you

[@PyLessons]

Hey, yes and no. If depends on what hardware you'll run model (cpu, gpu or other). It depends on your "real time" requirements. You need to test it and you'll see :)

[@SagarPatel-h1g]

After Training and Testing how can we use this onnx model for any Speech to Text Task?

[@shafiqrhmankeliwall8019]

Hi Great job Keep it up, I have one question that : I want to build/Train model for some low resource languages such as Pashto, I will make a dataset from scratch. any idea how to start or any useful links. Thanks

[@PyLessons]

Thanks! I do not recommend to make a dataset from scratch alone, I believe you should be able to find something in open source. I don't have dataset, but check my dataset structure and you'll see what format it required

[@BrightShoko-m7c]

Good job👏..........but i'm getting errors on onnx installation, ....what python version did you use

[@PyLessons]

I used it with 3.10 python. What error you receive, often it might be related with protobuf version

[@konami_cheater]

Can you give me the Paper Link 0:57

[@victormessias107]

When I'm training, its freezes on the end of the first epoch. Any idea?

[@PyLessons]

It shouldn't be like that, try to debug it. For example iterate through training data provider and validation data provider, for example "for data in data_provider" and check if it can reach the end. If you still face these issues open issue on GitHub with more details

[@AmitYadav-rp3ot]

Hi there, great video! I wanted to know your opinion on training a model like this just for recognising numbers and couple of words from an audio file. will such a custom training help to reduce the size of the model ? I want to create a very small model so that I can run it on a sub GHz clock CPU. please share what you think. Many thanks

[@PyLessons]

Hi, thanks! No, training model on simpler data doesn't reduce model size. Check my other videos to create your own custom model for simpler data, such as numbers and words. But if your variety of words is simple, maybe you should consider classification task. Also, to reduce size of the model check quantization and pruning techniques

[@maimunahmaskur7525]

its a great code! Could you please help, if I want to use this code for a dataset labeled phonemes and use PER (Phoneme Error Rate) for test and validation, what should I do? I mean which parts of the code do I need to adjust? Thank You!

[@PyLessons]

I am not familiar with PER, so I can't tell you

[@djrocks5678]

Hi there! Thanks a lot for this. I wanted to ask you - I am working on a desktop voice assistant project as part of my university work. I wanted to train my own speech recognition model. How would I go about this? I saw datasets and something like Mozillas 79GB data is too much for my needs and was wondering how I'd go about making a smaller scale speech recognition model for my project.

[@PyLessons]

Hi, usually its impossible to get great results, without huge datasets and GPU computing. But you may try to create a custom ASR model with my another tutorial, what you can check here: kzbin.info/www/bejne/bpjCZX99Z9GjiJo. Also, there are a lot of trained ASR models that usually you need only to integrate (just an idea)

[@BASDOURI]

your contact please ?

[@N3ONGNCS]

i want to create an ASR for an African Vernacular/local language ,could i use this for that, ill create my own dataset if need be, or what would you suggest, im attempting this for the first time an am a little lost and overwhelmed

[@daisy-bot-py]

Im working on a similar project and im just curious to know if you trained the model in an African language?

[@mohamedabdiaziz5993]

My final university projects is like this system, I need help I have prepared my own dataset

[@PyLessons]

I already helped by creating this step by step tutorial mate :)

[@mohamedabdiaziz5993]

@@PyLessons I am facing error, already I have prepared my own dataset for the last 4 months

[@mohamedabdiaziz5993]

@@PyLessons I tried but wer is 100% even if model make 7200 steps

[@Ogamp]

thank you for this. Could you please put me through an ASRmodel for recognizing regional accents please? how can i contact you thanks

[@PyLessons]

Your task is classification task, try to google it, but usually it's done only with Encoder model.

[@PyCode.academe]

God bless you!

[@PyLessons]

You are welcome :)

[@山田林-f5b]

06:05

[@aqibmumtaz1262]

Great

[@PyLessons]

Thanks