Audio Data Processing in Python

  Рет қаралды 140,733

Rob Mulla

Rob Mulla

Күн бұрын

In this video Kaggle Grandmaster Rob shows you how to use python and librosa to work with audio data. We import play and visualize the data.
Timeline:
00:00 Introduction
00:54 The Dataset
01:44 Package Imports
03:20 Audio Terms to Know
05:30 Reading and Playing Audio Files
08:58 Plotting Raw Audio
10:18 Trim and Zoom
13:19 Spectogram
17:08 Mel Spectogram
19:37 Outro
Notebook used in this video: www.kaggle.com/robikscube/wor...
Follow me on twitch for live coding streams: / medallionstallion_
Intro to Pandas video: • A Gentle Introduction ...
Exploritory Data Analysis Video: • Exploratory Data Analy...
* KZbin: youtube.com/@robmulla?sub_con...
* Discord: / discord
* Twitch: / medallionstallion_
* Twitter: / rob_mulla
* Kaggle: www.kaggle.com/robikscube
#Python #DataScience #AudioProcessing #Kaggle

Пікірлер: 180
@sarthakkumar8696
@sarthakkumar8696 Ай бұрын
i have no words to express how helpful this was!!! really thank you
@HadiCurtay
@HadiCurtay 2 жыл бұрын
Hey Rob, thanks for a great video. I've been looking at how to do audios and this video was great to jump into.
@robmulla
@robmulla 2 жыл бұрын
Thanks Hadi. I'm glad you found it helpful.
@robmulla
@robmulla 2 жыл бұрын
Tmeline links!: 00:00 Introduction 00:54 The Dataset 01:44 Package Imports 03:20 Audio Terms to Know 05:30 Reading and Playing Audio Files 08:58 Plotting Raw Audio 10:18 Trim and Zoom 13:19 Spectogram 17:08 Mel Spectogram 19:37 Outro
@fudgenuggets405
@fudgenuggets405 Жыл бұрын
This guy's videos are so awesome. Big fan.
@FilippoGronchi
@FilippoGronchi 2 жыл бұрын
Really interesting to learn how to deal with audio/sounds with python...something new! Great idea and as usual clear and simple explanation. Thanks a lot Rob PS would love to join one of the next live condig sessions but unfortunately they are not in confortable time slot for ourself in central europe.
@robmulla
@robmulla 2 жыл бұрын
Thanks for the feedback Filippo, glad to hear you learned something new. Cool to know you're watching from Europe maybe I'll do a twitch stream at a different time in the future and you can join!
@nixboaski
@nixboaski 10 ай бұрын
This is so interesting. A few days ago I wanted to produce a digital reproduction of a particular musical note, using the note as the basis and its harmonics (I was analysing A=440Hz, but I wrote the script in such a way I could alter that). So I had basically two aspects to take into account: the frequencies and its amplitudes. I recorded a note from the piano, cleaned it of noise as much as I could and extracted the amplitudes from it for each frequency that forms an A note. It was terrible! The final result sounded ghastly. Your video will help me understand how I must proceed to make a digital sound that makes more sense. I totally would like to learn how to use machine learning on audio processing too.
@Cmax15
@Cmax15 Жыл бұрын
As an audio engineer who's making a smooth transition to data science, you have no idea how interesting this topic is to me. I feel assured that I can put my current expertise in great use despite the career shift/transition.
@robmulla
@robmulla Жыл бұрын
I went through a similar career change so I can totally relate. You’ll never regret learning python. It’s so powerful!
@oayala65
@oayala65 Жыл бұрын
@@robmulla I found my place in the world. thamks a lot!!!!
@EtBilu295
@EtBilu295 Жыл бұрын
I need to create a cell phone application that compares two audios, one previously recorded and the other spoken at the time, and I need the application to say if they are the same, is there any reference work that you can point me to?
@elitecoder955
@elitecoder955 11 ай бұрын
How can machine learning and AI change your previous industry ?(audio/sound engineer)
@Michallote
@Michallote 7 ай бұрын
@@EtBilu295 Shazam algorithm, check it out
@mohammadreza518
@mohammadreza518 2 жыл бұрын
this is what im looking for, thanks for the great video !!!
@robmulla
@robmulla 2 жыл бұрын
Thanks so much. I’m glad it helped you out.
@danielolmos5484
@danielolmos5484 Жыл бұрын
Thanks for this! Very nice for beginners in this area
@robmulla
@robmulla Жыл бұрын
Glad you found it helpful!
@justnspace
@justnspace 2 жыл бұрын
thank you for sharing this, really cool stuff.
@robmulla
@robmulla 2 жыл бұрын
I appreciate that Justin. Glad you liked it.
@ErickCalderin
@ErickCalderin Жыл бұрын
Awsome, thank you. I built some months ago a music genre classifier using spectograms and a Convolutional Neural Network. It was the best thing ever since I got a high accuracy in the first attempt.
@robmulla
@robmulla Жыл бұрын
Nice work! Do you have the code you could share?
@Woofawoof_wwooaaf
@Woofawoof_wwooaaf 9 ай бұрын
@robmulla @ErickCalderin Could you please help me in my acedemic project. I am getting many errors while implementing speech emotion recognition project using cnn. Please guide me to complete my project
@iluvsyphonfilter
@iluvsyphonfilter Жыл бұрын
Amazing tutorial, thank you!
@robmulla
@robmulla Жыл бұрын
Thanks for watching and giving feedback!
@pycsr-by-pankajsoni
@pycsr-by-pankajsoni 4 ай бұрын
Very nicely explained!!🙂
@1412-kaito
@1412-kaito Жыл бұрын
Gonna use this for a project, thanks!
@robmulla
@robmulla Жыл бұрын
Awesome! I love it.
@chronicsynths6961
@chronicsynths6961 Жыл бұрын
I've heard so many people say: "Python can't do...", "Python shouldn't really do...", and "Python isn't..." Throughout all my learning up to this point I'm seeing now that Python can do just about anything and I don't understand this half-aversion to Python a lot of developers seem to have when talking about anything that isn't reading tables and manipulating data. Thanks for making this - everyone I had talked to about this topic kept pointing me back to learning C++ and I thought that was a lame answer.
@robmulla
@robmulla Жыл бұрын
Love this feedback. Glad to hear this helps you start your python journey. It’s such an awesome language. The others are good too!
@twinblade02
@twinblade02 2 ай бұрын
So the reason why devs say things like this is because Python is rarely used to actually put out a full fledged application that's essentially IOT compatible; then there's the speed. C++ is apparently faster so everyone wants you to learn that.
@TheBontenbal
@TheBontenbal Жыл бұрын
Really nice video! Thanks
@robmulla
@robmulla Жыл бұрын
Thanks so much for the feedback.
@pywidem5823
@pywidem5823 4 ай бұрын
Working in both audio and IT, this sample rate display in your files feel like they're halved. To be able to display a frequency accurate, you'd need 2xfrequency as the sample rate, therefore it would be 44.1khz (which is much more common and I have never seen the option to record witch 22050hz). With 22050 you would have data representing only up to roughly 10khz when accounting for the inquest filter.
@Levy957
@Levy957 2 жыл бұрын
Hey Tom, nice video! Can you show us wich reference did u use, any books, courses, etc? Love your content, congrats for the 1k followers on twitch
@robmulla
@robmulla 2 жыл бұрын
Thanks Larry! I learned a lot of what I know through school and kaggle. Thanks for the congrats on the 1k twitch followers, hopefully just the beginning.
@ademhilmibozkurt7085
@ademhilmibozkurt7085 Жыл бұрын
I love content thank you. please make more :)
@robmulla
@robmulla Жыл бұрын
Thanks, will do!
@sphyrnidae6749
@sphyrnidae6749 5 ай бұрын
Hi Rob! Thank you for your videos. You inspired me to start digging deep into DataScience. I read a lot of books, watched almost all your videos and did some courses on Coursera. Do you have any recommendations how to train now on real data. I do some work now with some fields of intresst data but i think it would be great to have a community or at least at the very beginning some kind of guided projects. I discoverd data scratch. Do you recommend something like this?
@jopposity
@jopposity Жыл бұрын
This intrigued me as a data scientist who works with EEG data (brain signals). Signal is signal in the end :)
@robmulla
@robmulla Жыл бұрын
Very true. Signal is signal. Glad you found it helpful.
@danieldanielineto7228
@danieldanielineto7228 8 ай бұрын
Great Job, obrigado.
@Pxmuchim
@Pxmuchim Жыл бұрын
Hi! Would you be able to create a tutorial on how we can use the processed audio data (such as the one in this video) to train a machine-learning model? Thanks for the great video!
@robmulla
@robmulla Жыл бұрын
Hey Jerryl. I have plans to do that but I'm not sure when. Hope you liked the video.
@T0berius
@T0berius Жыл бұрын
Sir, you are the one. I'm a hobbist and it's video was useful to me. Thanks for share you time and expertise with us.
@footkol
@footkol 11 ай бұрын
Thank you for informative video. May I ask what software are you using in it? Is it JupyterLab?
@youngzproduction7498
@youngzproduction7498 Жыл бұрын
Nice. It’s what I need.
@robmulla
@robmulla Жыл бұрын
I guess I’m just what you needed!
@anirbanc88
@anirbanc88 Жыл бұрын
Its so cool!
@robmulla
@robmulla Жыл бұрын
Glad you think so. Thanks for watching.
@fahnub
@fahnub Жыл бұрын
great vid!
@robmulla
@robmulla Жыл бұрын
Thanks for watching 😆
@jti107
@jti107 2 жыл бұрын
really cool! would you be able to do a video on how something like shazam works. conceptually i understand its using key points in audio spectrogram and matching it against library of known files. but i've never been able to get it really work, so was just curious
@robmulla
@robmulla 2 жыл бұрын
Thanks. That’s a great idea for a future video.
@devisthesis343
@devisthesis343 2 жыл бұрын
hi, do you have tutorial feed the spectrogram or melspectrogram to NN?using CNN or RNN-LSTM algorithm?it will be interesting if you continue to feed them to the NN..great presentation..
@robmulla
@robmulla 2 жыл бұрын
That’s a good suggestion. I’ve made models like that before but no video tutorial yet. I’ll put it on my todo list. Thanks for the suggestion
@pasindutharaka3519
@pasindutharaka3519 Жыл бұрын
awesome !!
@robmulla
@robmulla Жыл бұрын
Glad you liked it!
@AnimeSyncInfinite
@AnimeSyncInfinite 9 ай бұрын
I want to mimick others voice with my voice. In short i will give a small audio sample as a input (for example my voice) and the code will get the various charateristics of my voice so that i can manipulate it with audio of some other person's voice. Is it possible to do it in python?
@yusufcan1304
@yusufcan1304 2 ай бұрын
thanks man
@robmulla
@robmulla 2 ай бұрын
Thanks for watching.
@conquestech
@conquestech Жыл бұрын
Awesome! I wish for a tutorial on TTS & STT technology, audio dataset, in python, to create a model for my indigenous language using IPA phonemes. Thanks
@robmulla
@robmulla Жыл бұрын
That’s a good idea. Thanks for watching
@dannybee9068
@dannybee9068 10 ай бұрын
Hello! Thank you for the excellent video! I have a question though: What is the difference in use cases between STFT and Melspectrogram? Both methods appear to extract features for the model, but in distinct ways. I am interested in understanding when one is more advantageous than the other. For example for sentiment analysis, I think melspec seems more appropriate but it's nothing more than a guess with a bit of intuion, and feels like if we feel with a speech its better to use melspec and any other sound stft
@omeryilmaz199
@omeryilmaz199 18 күн бұрын
Did you get answer? I reall wonder what's the difference between them
@mudasserahmad6076
@mudasserahmad6076 7 ай бұрын
Hi Rob interesting video. My task is to create mel spectrograms with windows length 93ms 46ms and 23 ms .And then combine them i need one i am confused with this like (128,216,3) what does 3 shows here. 128 in nmels 128 and 216 nu ber of frames.
@kavinyudhitia
@kavinyudhitia Жыл бұрын
nice thanks!!
@robmulla
@robmulla Жыл бұрын
Glad you like it!
@space_aware7846
@space_aware7846 Жыл бұрын
Awesome video! Is there a way to use the Melspectrogram to determine programmatically if a file contains human speech?
@robmulla
@robmulla Жыл бұрын
Thanks. That’s a great question. It would depend on how accurate you would need the system to be and the volume of the voice. You could setup a heuristic to determine if there is voice based on the frequencies. You could also train a machine learning model as a classification problem. This would require a lot of labeled examples. There also may be some pre-trained models you could use.
@JL2010
@JL2010 Жыл бұрын
@@robmulla Thank you for your response. Do you have any recommendations on pre-trained models I could explore? Or videos to watch? I don't need anything precise, but want to find out (roughly) what proportion of a corpus of audio contains human speech (as opposed to silence, music, other noise).
@antony830
@antony830 Ай бұрын
Thanks Rob. How to upload files so that this works (audio_files = glob('../input/ravdess-emotional-speech-audio/*/*.wav'))? Are you using a website or software in this video to do Python? I just started to know Python
@shubhampadekar2590
@shubhampadekar2590 Жыл бұрын
Hi, I hope you are doing well. Excellent tutorial May I know, how should i approach to a problem of to detect (just want to detect the presence) of background noise in an audio file Which python audio libraries can be useful?
@robmulla
@robmulla Жыл бұрын
That's a great question. There are probably many different ways to do this. One way would be adding a filter to the audio file to remove the specific frequencies containing noise. Check out the librosa filters and try some of them out.
@amuigayle2231
@amuigayle2231 6 ай бұрын
Ill probably never get a reply to this but is it that its either or with the STFT and the Mel spectrogram? Why did u not create the Mel spec from the transformed data?
@TheFullofrage
@TheFullofrage Жыл бұрын
I have a question about sample rate. Is sample rate (that integer sr) defined by that method librosa.load() or by some other way? Btw amazing video! Than you so much!
@iao83
@iao83 Жыл бұрын
I had a whole spiel about how the sample rate is dictated by the Nyquist theorem but it answered none of your question so I decided it best not but I am also curious how it derived that sample rate seeing as it appears to be half of 44.1 but I'm not certain why it would give it in that form
@pfrmusic_remix
@pfrmusic_remix 26 күн бұрын
Awsomeeee!!!!, can I feed the CNN network by melspectograms ?
@cappy2112
@cappy2112 2 жыл бұрын
Great presentation. What SW did you use to get your video in front of the notebook?
@robmulla
@robmulla 2 жыл бұрын
Thanks. I used a green screen sheet with OBS software to overlay my camera in front of the screen.
@cappy2112
@cappy2112 2 жыл бұрын
@@robmulla Thanks. Please check your twitter messages, I've sent you a PM there
@dexnug
@dexnug Жыл бұрын
hi Rob, I have question. what is the meaning number of colorbar in 17:00, why is the number is negatif?does it have units?like freq in Hz or time in second?
@robmulla
@robmulla Жыл бұрын
Great question OrangUtan - the y-axis values in that plot is in decibels (dB). Decibels are not an absolute measure of sound energy but a comparison with a reference value. In the librosa function "power_to_db" you can see it takes a reference value, which we provide as the max value. Since dBs are in log scale all negative numbers are less than this max value. Hope that helps! Check this out for more info: www.scienceabc.com/pure-sciences/why-negative-decibels-are-a-thing.html
@dexnug
@dexnug Жыл бұрын
@@robmulla hi rob thanks for the answer. another question, since you mention about "power_to_db" what is the difference with function "amplitude_to_db" 18:27?
@cerita-ceritanabi3343
@cerita-ceritanabi3343 Жыл бұрын
Hi, I want to analyze an SNR using a CSV file. I want no the signal from 0-200 Hz. In CSV file only has the data on G. What should I do for SNR analysis?
@biblicalrevelations6383
@biblicalrevelations6383 2 жыл бұрын
Hey Rob, Can you do a audio background noise cancellation using deep learning tutorial if you can.
@robmulla
@robmulla 2 жыл бұрын
Thanks for the suggestion. I’ll add it to the list of potential future videos!
@user-kb6yo4gq2o
@user-kb6yo4gq2o 7 ай бұрын
What are the y values that you first extract?
@Zizos
@Zizos 7 ай бұрын
As a "I understand what's going on but not a coder" I understand that it would take me months if not years to create what I want. How hard would it be to create a audio visualizer plugin? Like make a plugin for a video editor that takes a audio track, analyzes frequencies with custom ranges and drives parameters based on loudness of the frequency ranges you've set up? I'd have to learn how to manage data, memory, incorporate into video editor, libraries, compiling and who knows what else... ah yes, more than basic coding.
@DialectDialogue
@DialectDialogue Жыл бұрын
This is really awesome! Whats your setup to get tto this? I'm on a Mac and so far Librosa has not been successful ...any tips? SQL background & new to Python 😬
@robmulla
@robmulla Жыл бұрын
Glad you enjoyed the video. I'm running on linux, but librosa usually installs fairly easily for me. I use conda/anaconda as my base python environment. I then just pip installed librosa. Other than that I'd suggest reading the install instructions on their documents page: librosa.org/doc/latest/install.html
@DialectDialogue
@DialectDialogue Жыл бұрын
@@robmulla thank you so much for the info and prompt response. I think my African Bantu Language project has a chance with the milestones.
@liamgough479
@liamgough479 Жыл бұрын
Hi as a new comer to Python - I want to get to a stage that I can librosa to play around with audio in raw form - as appossed to using Audacity etc. Specifically interested in band filtering. If I were to follow your excellent videos where will I find the basics to start with please and which Python app are you using or recommend for Win 10 please? I am pretty good with Excel and VBA and have a reasonable understanding of audio so hoping that I can get a good start to learning Python.
@robmulla
@robmulla Жыл бұрын
I’d recommend checking out my introduction to jupyter and jupyter notebooks video. It explains how to write python code in a notebook. kzbin.info/www/bejne/a6HJYZKYpbOVodk
@liamgough479
@liamgough479 Жыл бұрын
@@robmulla many thanks will do!
@meditation-tunes
@meditation-tunes Жыл бұрын
Thank Rob, do you know how to compare two audio files and show the matching rate for example. Can Python help? For example I want the user to record a sentence and then we compare it with our library and check if it is matching with for example with a sad tune.
@robmulla
@robmulla Жыл бұрын
Hmm. There must be a few ways. I'm not sure of the best. But you could see if the correlation between numpy arrays is close using np.corrcoef?
@trevordevs
@trevordevs Жыл бұрын
Im an iOS engineer currently, and am looking to get into audio processing/ML - would you recommend python over c++? Most recommend python for beginners and ML in general, but I have also mostly seen c++ recommended for audio work.
@robmulla
@robmulla Жыл бұрын
Hey Trevor, that's a great question. I mainly just code in python so I can't really say which is better. At least for machine learning I believe most of what you want to do can be accomplished with python. Hope that helps!
@durgaganesh423
@durgaganesh423 11 ай бұрын
Hi Can you help for finding glitches or audio obnormalites from wav file
@ramazanguldemir3847
@ramazanguldemir3847 Жыл бұрын
Amazing Tutorial
@robmulla
@robmulla Жыл бұрын
Great question. Check out the filters in scipy.signal. There are different filters you can apply that should work similar to an equalizer. Good luck!
@lesptitsoiseaux
@lesptitsoiseaux Жыл бұрын
Hi Rob, could you give me some pointers please? I suffer from severe sleep apnea which is getting worse and I'm hoping to build a raspberry pi microphone that buzz me gently when it doesn't hear the regular cpap machine whirring up and down of my respiration for more than twenty seconds. How do I write a bot to listen in ? My prototype is just to listen for a certain decibel and constancy of noise, but I'm hoping I can write something I can share for folks to train their own specific sample to detect. Thank you from Vancouver!
@robmulla
@robmulla Жыл бұрын
Hey, thanks for the comment. This sounds like an interesting project. I'd be a bit concerned with using something like this for such a serious medical condition like sleep apnea. Definately take the advice of a medical professional. But for a side project I think doing auto detection might be possible. You would need to deal with streaming audio which I don't cover here. I'm not sure what the best approach would be but wish you the best of luck and hope your sleep apnea gets better!
@larcomj
@larcomj Жыл бұрын
great video. kinda odd to see "sr" for sampling frequency(Fs in the dsp world) but thats me being particular.... im trying to make the jump from matlab to python ughhh.....
@robmulla
@robmulla Жыл бұрын
Glad you liked the video. Welcome to the wonderful world of python. You will love it.
@SvSzYT
@SvSzYT 3 ай бұрын
if you want to increase the resolution on the x axis you can increase the sr. But how do you increase the resolution of the frequency on the y axis? Edit: It seems quite hard to use this code to shift the frequencies as the frequencies are coded in the iteration of the db matrix ... that was my actual aim because it seemed other software kind of compressed alot of data which mostly seems to be accounted to the mel or log scale... i think. If you want to simple shift 1000 hz to 100 hz you lose a lot of frequencies, which could be compensated with higher y-resolution... but i guess there are more clever methods?
@shaimaalbalushi1739
@shaimaalbalushi1739 6 ай бұрын
what are you using as notepad to write the codes
@jadeddinefariss6059
@jadeddinefariss6059 Жыл бұрын
hello, i couldn't understand what the numbers in the chosen interval [30000,30500] refer to, are they seconds or maybe microseconds 12:42
@robmulla
@robmulla Жыл бұрын
Great question. In this part of the video I am just zooming into part of the audio to show how it looks visually in the plot. Each datapoint has a relatioship to time by the "sample rate" - this audio file has a sample rate of 22050 Hz (22050 samples / second). so 1 sample is 1/ 22050 of a second. This slice of 500 samples equates to ~0.0227 seconds. Hope that helps!
@jadeddinefariss6059
@jadeddinefariss6059 Жыл бұрын
@@robmulla thanks a lot !
@navyaanzaheen3233
@navyaanzaheen3233 Жыл бұрын
sir i am new to data proceesing so plz tell me that on 8:58 In plotting the raw audio you analyze one voice or all the voices
@robmulla
@robmulla Жыл бұрын
Glad you are learning something new. At that timestamp I am only looking at a single audio file results. `audio_files[0]` means I am only reading the first value in the audio_files list.
@navyaanzaheen3233
@navyaanzaheen3233 Жыл бұрын
@@robmulla thanks for reply
@yeahx32p69
@yeahx32p69 Жыл бұрын
How can I store the audio data (X axis would be the time and Y axis will the be the power (db)) in an excel file format (So I can analyze the audio data better). I have been reading a lot regarding this but havent come across any one doing this or found a code snippet that does something like this. Its been really bugging me a lot. I would really appereciate your help a lot.
@robmulla
@robmulla Жыл бұрын
Although I’m not a fan of excel, this should be pretty easy. Simply wrap the DB transformed dataset like this df = pd.Dataframe(y) and then save the data as CSV df.to_csv(‘my_data.csv’)
@yeahx32p69
@yeahx32p69 Жыл бұрын
@@robmulla alright. Thank you so much.
@sandymlgenai
@sandymlgenai Жыл бұрын
Given a flute music file, how can we convert the music to notes and decompress the file back to audio blocks using literally any method( trained spectograms, any ML algorithm..)
@robmulla
@robmulla Жыл бұрын
I’m not sure exactly but I know librosa has some modules for pulling on notes.
@googul2041
@googul2041 7 ай бұрын
Glob, librosa, wavered, ivi kakundaa hasalu dsp audio yenduku work avataledu adigo librosa
@KJ7JHN
@KJ7JHN Жыл бұрын
Hey Rob, could you please create a video that takes the trimmed audio data, data set, and apply this to the actual mp3 file? This should result in a trimmed MP3 file. Saving need not be necessary. I'd like to open a file, and play specific time stamps within the file. Thanks.
@robmulla
@robmulla Жыл бұрын
Hey Damon, not sure exactly what you are looking to do but should be pretty easy to save a trimmed audio file using the techniques I show in this video. You would just need to also save the result.
@bradydyson65
@bradydyson65 Жыл бұрын
Why does it seem like the frequency values in the spectrograms are much higher than they should be? I tried to use the same method with a piano sample of an e minor scale and found that the primary frequencies ranged from 1000 Hz to 3000 Hz. Then I noticed that a lot of the frequency content from the speech examples also seems high. Am I doing something wrong?
@robmulla
@robmulla Жыл бұрын
That’s a good point. I don’t really know. Have you figured it out? I’m curious to know.
@sandymlgenai
@sandymlgenai Жыл бұрын
How can we split an audio file into several equal sized chunks ( with padding)? ( I'm dividing the audio into chunks to apply DCT on every chunk)
@robmulla
@robmulla Жыл бұрын
Good question. This is pretty comment for deep learning. Check this notebook: www.kaggle.com/code/colinnordin/audio-segmentation-tutorial
@sandymlgenai
@sandymlgenai Жыл бұрын
@@robmulla Thank you for your response.
@pythonmini7054
@pythonmini7054 Жыл бұрын
what book can you recommend to learn everything that is needed for machine learning?
@robmulla
@robmulla Жыл бұрын
There are many. "Approaching (Almost) Any Machine Learning Problem" by my friend Abhishek is a good one but also very technical.
@rs9130
@rs9130 Жыл бұрын
thanks for the tutorial. how can i convert to time series data wrt to frames ex: (time_step, feature_dim)
@robmulla
@robmulla Жыл бұрын
Absolutely, a melspectogram is just like that - time x feature!
@rs9130
@rs9130 Жыл бұрын
@@robmulla if i want to use lstm model, suppose i have a video, i have to trim multiple short videos and convert it into audio, then use librosa transformation for these short videos and convert all transformations into time series? Or is it possible with single audio file to split data into frames?
@rs9130
@rs9130 Жыл бұрын
​@@robmulla if my loaded audio data shape is (67032,) can i reshape it to (12,5586) #feature size and then repeat data with 3 time step to create (3,10,5586)
@shubhamkapoor5152
@shubhamkapoor5152 Жыл бұрын
Hi i have an audio dataset with gz extension.i dont know how to load it in python and do preprocessing and extract mfcc from it.Can you give me a brief idea on what to do.i am very lost about this
@robmulla
@robmulla Жыл бұрын
gz is usually a gzipped file. So you need to unzip it first.
@SA-oj3bo
@SA-oj3bo 2 жыл бұрын
Hi If I send sound converted to PCM data to a python websocket, how then convert it to a wav file, save it and analyze it? Thanks!
@robmulla
@robmulla 2 жыл бұрын
I'm not an expert on PCM data, but if you are able to convert it into a numpy array you should be able to save it as a wav file using librosa. Maybe this could help: stackoverflow.com/questions/16111038/how-to-convert-pcm-files-to-wav-files-scripting
@SA-oj3bo
@SA-oj3bo 2 жыл бұрын
@@robmulla With PCM data I mean something like you showed in your intro, 16 kHz audio samples with 16 bit resolution, we capture sound with a simple ESP32 + I2S microphone and the ESP32 streams the samples over a websocket to any other websocket. Is a numpy array different then a normal array or list? Is there an example in one of your tutorials how to put integer sample values into the numpy array and convert it to a wav file? Can this be done also in real time? What I like to do is to record the streamed sound and analyze it later ( or real time if possible) and count how many times a particular sound occurs in the recording. All advise is very welcome! ( technical college project about AI and sound pollution ) Thanks.
@irgiahmadmaulana5915
@irgiahmadmaulana5915 Жыл бұрын
Dose anyone know how to make statistic descriptive based on the audio sound like this? I mean what should we count or you can send a reference instead, thank you
@robmulla
@robmulla Жыл бұрын
I'm not sure exactly what you mean but there are many ways of doing feature engineering with librosa. Check this out: librosa.org/doc/main/feature.html
@zachfarrell7162
@zachfarrell7162 Жыл бұрын
using python 3.11, and having an awful time with librosa module. so many dependencies, and it says that librosa is not compatible with 3.11 so 3.7 is required. anyone know of a way around this?
@robmulla
@robmulla Жыл бұрын
Why not create a conda or virtual environment with python 3.7?
@user-sr5em8gi2u
@user-sr5em8gi2u 4 күн бұрын
can I make this project using vs code?
@danishjilani7710
@danishjilani7710 2 жыл бұрын
Hi. I wanna play an audio in python with different Dbs. how to do that please?
@robmulla
@robmulla 2 жыл бұрын
Hey Danish. Thanks for watching the video. When you says "different dbs" do you mean change the volume of the audio? If so you might want to check this package out: pydub.com/
@notknown84
@notknown84 Жыл бұрын
sir in 7:26 this part i am getting module not callable error kindly tell how to solve this issue
@robmulla
@robmulla Жыл бұрын
it's probably something with how you imported it but I cant say without seeing your code.
@notknown84
@notknown84 Жыл бұрын
@@robmulla is it possible somehow to send you ,it'll be a great help for me
@navyaanzaheen3233
@navyaanzaheen3233 Жыл бұрын
Sir I want to make a quranic qaida in which i want to apply pronunciation technique of each alphabet using deep learning so how i can make this project and please define the steps so i can make this project because i am new to deep learning and it is my final project so plz help me
@robmulla
@robmulla Жыл бұрын
Thanks for your question. That sounds like an interesting project but it's well beyond the scope of what I can help you with here. Good luck.
@doullagdz9479
@doullagdz9479 2 жыл бұрын
Is there different between matplotlib.pyplot and .pylab?
@robmulla
@robmulla 2 жыл бұрын
Great question. From what I've seen they are almost identical. There are some differences with pylab being preferred for non-interactive plots.This post goes into more detail: stackoverflow.com/questions/23451028/matplotlib-pyplot-vs-matplotlib-pylab
@doullagdz9479
@doullagdz9479 2 жыл бұрын
Thanks @@robmulla
@Julien-hg8jh
@Julien-hg8jh Жыл бұрын
Can someone explain to me how he can show the details here 11:25 ?
@robmulla
@robmulla Жыл бұрын
Great question Julien. SHIFT + TAB. In jupyterlab it will show the docstring for the function you are calling. This also works in a kaggle notebook like I'm using in the video. I cover this and more in my jupyter notebook tutorial video.
@Alkansa
@Alkansa Жыл бұрын
How to get all time stamp where audio intensity is 0db ¿
@robmulla
@robmulla Жыл бұрын
For all frequencies? You could try librosa.effects.trim which will remove silence below a threshold. Then compare with the original and see which timestamps are removed. Good luck!
@Alkansa
@Alkansa Жыл бұрын
@@robmulla how to compare them, i m a total noob 😂
@theTenorDrummer
@theTenorDrummer 11 ай бұрын
Hey, I'm learning Python and want to eventually be able to analyze a drummer's rhythmic timing vs. a "perfect" performance. Definitely stealing a few nuggets from this. Thanks! Anyone out there want to help me out???
@robmulla
@robmulla 11 ай бұрын
That seems like a cool project. I can’t help directly but you can join my discord and ask there! Glad this video helped you get started
@mir_intizam
@mir_intizam Жыл бұрын
hello everyone, I have audio data, I want to train this audio data and use it offline. Is there anyone to help me?
@robmulla
@robmulla Жыл бұрын
Not sure exactly what you are asking. By "train" do you mean record?
@mir_intizam
@mir_intizam Жыл бұрын
@@robmulla No, I have voice data, how can I create a model from this voice data, I will use it to convert text to speech
@SanjeevKumar-dr6qj
@SanjeevKumar-dr6qj Жыл бұрын
I have subscriber you.
@robmulla
@robmulla Жыл бұрын
Thanks so much for the sub!
@nwaforchinonsobenedict.7095
@nwaforchinonsobenedict.7095 Жыл бұрын
I need the video pls
@robmulla
@robmulla Жыл бұрын
What video do you need. I'm confused about your comment :)
@user-xm5wm4zf2r
@user-xm5wm4zf2r 7 ай бұрын
you're not working in jupyter?
@sporttyt
@sporttyt 4 ай бұрын
You can create me product?
@user-xg1hf2ek2v
@user-xg1hf2ek2v Жыл бұрын
ana mafdtinich
@riittap9121
@riittap9121 2 ай бұрын
This video would be very helpful, but the distracting background music makes it really difficult to follow the content 🙁
@omart9411
@omart9411 5 ай бұрын
it's a shame that this is such a low level tutoial but you assume that I'm already familiar with the meaning of the terminology.
@harisabekti
@harisabekti 2 жыл бұрын
???????????
@robmulla
@robmulla Жыл бұрын
Sorry - did you have a question?
@Lokesh-dt4mp
@Lokesh-dt4mp 2 ай бұрын
Hey Rob good to see u .. But one thg background music is disgusting kindly stop that upcoming videos ...
@robmulla
@robmulla 2 ай бұрын
Will do thanks.
Image Processing with OpenCV and Python
20:38
Rob Mulla
Рет қаралды 119 М.
25 Nooby Pandas Coding Mistakes You Should NEVER make.
11:30
Rob Mulla
Рет қаралды 255 М.
ISSEI funny story😂😂😂Strange World | Magic Lips💋
00:36
ISSEI / いっせい
Рет қаралды 118 МЛН
I PEELED OFF THE CARDBOARD WATERMELON!#asmr
00:56
HAYATAKU はやたく
Рет қаралды 28 МЛН
Plenary 5 - Future Threat Plenary
1:08:46
CYBERUK ONLINE
Рет қаралды 96
This INCREDIBLE trick will speed up your data processes.
12:54
Rob Mulla
Рет қаралды 253 М.
Mel Spectrograms Explained Easily
30:31
Valerio Velardo - The Sound of AI
Рет қаралды 90 М.
How to Extract Audio Features
22:19
Valerio Velardo - The Sound of AI
Рет қаралды 86 М.
Basic Sound Processing in Python | SciPy 2015 | Allen Downey
18:59
INSANE OpenAI News: GPT-4o and your own AI partner
28:48
AI Search
Рет қаралды 194 М.
How to Extract Spectrograms from Audio with Python
23:26
Valerio Velardo - The Sound of AI
Рет қаралды 63 М.
ISSEI funny story😂😂😂Strange World | Magic Lips💋
00:36
ISSEI / いっせい
Рет қаралды 118 МЛН