OpenAI Whisper model: ASR for many languages AND other languages to English translation model

[@dr-bijay-kumar-singh]

I got no error message, but at "print(len(transcripts_all_NoFall))" the output is zero. Although I have kept 10 English audio samples in the directory. Because of this when I proceed further the output for WER is empty results without any error message. Can you share how you kept the audio samples in your directory. I am using your code on colab.

[@prabhjotgosal2489]

Hi - The audio samples are simply kept as .wav files in the directory that I am reading from. This directory exists in my Google drive. There are few ways to help root cause your issue further. 1. Before you do any ASR with Whisper.. check if audios are properly read. You could use librosa.load( ) to do so.. Check the output of the librosa.load() to see if the values in the audio files are non-zero. 2. Make sure the audio files contain speech. If there is no speech detected by the Whisper model in the audio, it will output nothing for the transcripts.

[@ABAnuSaraReality]

Hi, i have doubt . I uploaded the files in google collab via google drive , but the upload files and folders are not displaying even i auth the google drive with google collab , it doesn't show. Is it ok to use vscode as i am familar with the vscode functionality? Or is it compulsory to submit via google collab or can i upload the vs code executed files in google collab ?

[@prabhjotgosal2489]

Hi - What error do you get when you try to run the code in colab? I am not sure I understand what you mean by, "the vs code executed files in google collab", Are you refereeing to audio files or something else?

[@ABAnuSaraReality]

@@prabhjotgosal2489 I am referring about mounting the whole project in google collab. but i can't properly auth the google drive in google collab and mount them.

[@prabhjotgosal2489]

@@ABAnuSaraReality You can run the entire code in VScode locally on your machine. You may have to adjust some syntax and ofcourse the filepath. I suggest creating a new file in VScode and copy/paste sections of code from my file little by little, rather than running the original file all at once. It will make debugging and understanding the code easier.

[@lavkushdas5529]

hey getting error as " FileNotFoundError: [Errno 2] No such file or directory: '/content/drive/My Drive/Whisper_Test/NoFall' " how to resolve?

[@prabhjotgosal2489]

Hi.. you will need to adjust the file path.. Change it to wherever the audio file you are trying to process is located on your machine or Google drive if you are using colab.

[@CricketExpress-hx4mh]

@@prabhjotgosal2489 hey can you provide the test audio for this?

[@jatinjoshi7549]

can i get the dataset used by you