Distil Whisper: Up & Running
27:36
Benchmarking Whisper Variants
9:27
Rocket vs. MiniRocket
42:56
10 ай бұрын
Transfer Entropy Illustrated
3:58
Removing Baseline Wandering
28:19
Жыл бұрын
Hjorth Parameters
37:51
2 жыл бұрын
Walabot on the wheels-2
2:19
2 жыл бұрын
Walabot on the wheels-1
2:39
2 жыл бұрын
Wavelets-based Feature Extraction
37:40
PCA vs. LDA
32:49
3 жыл бұрын
Las Vegas of Deep Neural Networks
17:47
IMG 1725
2:27
13 жыл бұрын
Пікірлер
@YoyoSein
@YoyoSein 24 күн бұрын
Thanks for the great vid. The frequency content diagram really helped my understanding.
@shalbbyaali1852
@shalbbyaali1852 Ай бұрын
Such an interesting, easy and a clear explanation. So grateful to have found it on the right time! Thanks!
@MissPiggyM976
@MissPiggyM976 2 ай бұрын
Very clear, many thanks!
@HananAli421
@HananAli421 3 ай бұрын
Thanks can I have the slide?
@HananAli421
@HananAli421 3 ай бұрын
Thanks can I have the slide?
@zinebadaika6544
@zinebadaika6544 3 ай бұрын
Super useful lecture ....May Allah bless you
@AlaphBeth
@AlaphBeth 3 ай бұрын
Thank you so much, appreciate the feedback.
@rawadmelhem4490
@rawadmelhem4490 5 ай бұрын
Thank you very much for the great explanation, but I have a question please, is there an inverse transform for Wavelet scattering? since I need to make some processing in the features extracted by wavelet scattering then go back to same domain.
@AlaphBeth
@AlaphBeth 5 ай бұрын
Thanks for your feedback. This topic has been discussed here dsp.stackexchange.com/questions/78514/wavelet-scattering-properties-implementation/78515#78515. An example is also available here where the authors train a convolutional network to invert the scattering transform see www.kymat.io/gallery_2d/regularized_inverse_scattering_MNIST_torch.html Read this paper if you trying to implement GANs: arxiv.org/pdf/1805.06621
@rawadmelhem4490
@rawadmelhem4490 3 ай бұрын
@@AlaphBeth Thank you very much.
@حسینمهرعلیپورفرد
@حسینمهرعلیپورفرد 5 ай бұрын
can you suggest a book to increase my knowledge more about detail?
@AlaphBeth
@AlaphBeth 5 ай бұрын
Check this book link.springer.com/book/10.1007/978-3-642-56702-5
@AlaphBeth
@AlaphBeth 5 ай бұрын
Check this book link.springer.com/book/10.1007/978-3-642-56702-5
@shaidakargarnovin5568
@shaidakargarnovin5568 6 ай бұрын
Hi there! Thanks for the video. Is it possible to provide a reference(book, papers, etc) for the part you talk about how wavelets are decomposed into LPF and HPF and the iterative process of breaking the signal down?
@AlaphBeth
@AlaphBeth 6 ай бұрын
Hi there, thanks for your feedback. Have a look at this one link.springer.com/book/10.1007/978-3-642-56702-5 The video is the result of books, papers and work experience, so you may or may not find everything in the books. However, this specific book is one of the best IMHO.
@shaidakargarnovin5568
@shaidakargarnovin5568 5 ай бұрын
@@AlaphBeth Thank you very much! This helps a LOT!
@josephdays07
@josephdays07 7 ай бұрын
Good job 👍💯. I have generated wavelets with the theory of trigonometric partition equations we can create wavelets. kzbin.info/www/bejne/pmG9lGylo7CEZrMsi=dX1K0xLtJ2iWSgf5 kzbin.info/www/bejne/aXbFp6ymn5pqbacsi=zeLyrZc54430eV5b kzbin.info/www/bejne/eoeUmn2MZdSUbbssi=798Te0vetj90Q7j1
@nfpurnama
@nfpurnama 7 ай бұрын
Hi, Rami. Amazing video, amazing explanation cleared things up for me. Do you mind sharing the references you used? I would like to learn more. Thanks!
@AlaphBeth
@AlaphBeth 7 ай бұрын
Thank you for your feedback. I would recommend this book link.springer.com/book/10.1007/978-3-642-56702-5. However, there are many more out there. For me, it was mostly the papers and the book chapter I read from here and there plus work experience.
@nfpurnama
@nfpurnama 7 ай бұрын
Thank you very much!
@burcugoz112
@burcugoz112 7 ай бұрын
The best video on this topic, thank you so much for sharing this with us!
@kayeezhou9427
@kayeezhou9427 8 ай бұрын
So ',' and ';' both represent 'and', however, it is like ';' has higher priority than ','. They have same portion in the Venn diagram if there are only two variables.
@安铂
@安铂 10 ай бұрын
very good video and so helpful to me although still not fully understand
@enum4794
@enum4794 11 ай бұрын
great video! Can I use DWT for preprocessing data before forecasting stock prices using LSTM?
@AlaphBeth
@AlaphBeth 11 ай бұрын
Thanks for your feedback. That has been actually done by many researchers, see for example www.hindawi.com/journals/mpe/2019/1340174/ Or this one www.researchgate.net/publication/334519126_LSTM_with_Wavelet_Transform_Based_Data_Preprocessing_for_Stock_Price_Prediction
@jb_kc__
@jb_kc__ 11 ай бұрын
Top drawer explanation, really appreciate it
@FreeMarketSwine
@FreeMarketSwine 11 ай бұрын
You are one of the best data science/ML teachers that I've found on KZbin and I really hope keep making videos.
@AlaphBeth
@AlaphBeth 11 ай бұрын
Thank you so much for your feedback.
@miladkhazaei2305
@miladkhazaei2305 11 ай бұрын
hello. it's a so good explanation. thanks👏
@Pshubham1012
@Pshubham1012 Жыл бұрын
thank you so much for this🤩
@joe_hoeller_chicago
@joe_hoeller_chicago Жыл бұрын
Intriguing…
@nanthawatanancharoenpakorn6649
@nanthawatanancharoenpakorn6649 Жыл бұрын
I've watched a tons of vdo about Entropy. This is the best !
@jomfawad9255
@jomfawad9255 Жыл бұрын
Is it trained on large database? and does it need calibration?
@AlaphBeth
@AlaphBeth Жыл бұрын
Hello, thanks for your inquiry. The database associated with this demo is available here www.rami-khushaba.com/biosignals-repository, it’s the very last one at the bottom of the page. This demo was prepared around 2011 to support our publication. Calibration is always an issue with EMG pattern recognition. Look at this paper for some ideas ieeexplore.ieee.org/document/6737313
@jomfawad9255
@jomfawad9255 Жыл бұрын
Thank you just one more question was the model also trained on the emg of the person thats in the video performing the gestures?
@AlaphBeth
@AlaphBeth Жыл бұрын
@jomfawad9255 yes, model was trained on the subject data and then put in test in real time on his real-time data. Be aware though, if the person gets fatigued or if the sensors locations change or shift during real-time then even if you include his/her data in training then the performance would still be impacted heavily by electrodes shifts.
@jomfawad9255
@jomfawad9255 Жыл бұрын
@@AlaphBeth For such software do you recommend to train software on the person's emg signals plus a large database of people performing gestures with their emg signals or just the person himself in enough? thank you
@tianfrank-bp1pq
@tianfrank-bp1pq Жыл бұрын
thanks a lot
@RajivSambasivan
@RajivSambasivan Жыл бұрын
Absolutely fantastic video. This is the best information theoretic feature selection explaination that I have come across - so accessible, so well explained. Kudos on a fantastic job.
@AlaphBeth
@AlaphBeth Жыл бұрын
Thanks for the feedback, much appreciated.
@hassansaad9331
@hassansaad9331 Жыл бұрын
dear mr rami, i want to decompose an EEG signal (sampling frequency is 500 Hz) into its frequency bands: delta, alpha, theta, beta, gamma. i will be using the discrete wavelet transform and db4 as a family, what should be the decomposition level to cover all the frequency spectrum ? if taking into consideration the nyquist frequency the levels is 6 ? if not is it 7 ?
@riekesyochranizaef2067
@riekesyochranizaef2067 7 ай бұрын
hello hassansaad, "I am currently working on a thesis similar to your task. May I see your guidelines on how to understand what DWT, signal decomposition, and db4 are?"
@SajjadZangiabadi
@SajjadZangiabadi Жыл бұрын
This video is absolutely fantastic! The presenter's clear explanations and engaging visuals made it a pleasure to learn from. I'm grateful for the valuable insights and real-world examples provided. Well done!
@ranjanpal7217
@ranjanpal7217 Жыл бұрын
Amazing explanation....Could you please explain why do we recursively divide the low pass output ?
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback. This is the way it was designed originally as the goal here is to separate the high frequency fluctuations from the rest of the signal. We keep decomposing the low pass till we reach the frequency range of interest or to the point we can’t decompose further beyond (criteria to check that is known). However, wavelet packet goes further and says why only decomposing low pass side and let’s do that for the high pass side too and by that providing a better picture of the time frequency contents of the signal.
@JunqiYan-m6v
@JunqiYan-m6v Жыл бұрын
Hi, first of all, this is an excellent video! I have a question on page 13. in each square of the 2 dimensional graph, what should be the filled in value? at the left lower square, is the value there equal to the sum of the number of data samples from the first bin of the feature represented by the horizontal axis and the number of data samples from the first bin of the feature represented by vertical axis? Thanks for your clarification!
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback. The answer is not the sum of the individual values, as you just need to think multidimensional rather than single dimension. The answer for that lower left bin is a count of the number of samples from feature 1 that falls within the range of the first bin while the samples in the second feature fall within the range of the first bin of that feature. In that example it is given as how many samples from feature 1 fall within the range of 0.1 to 0.34 while at the same time the samples from feature2 had values within the range of 1 to 1.59. Think of this as driving on a highway with 4 lanes. How many times did the car on lane 1 drive on a speed of 60 to 70 km for example while, at the same time, the car on lane 2 had a speed between 80 to 90km for example. When you do individual cars you just look at car on lane 1 individually from other cars and count number of times it drove on a specific speed regardless of other cars on other lanes.
@hassanrashed9329
@hassanrashed9329 Жыл бұрын
Dear mr rami, can i use the discrete wavelet transform to extract and plot the EEG frequency bands ? In other words can i represent the EEG signal in frequency domain using DWT ? Or when it comes to representing the frequency domain i have to use the fourier tranform ? Please i need a practical answer
@AlaphBeth
@AlaphBeth Жыл бұрын
Hi Hassan Let’s take this one by one. EEG is a non-stationary signal. By using FFT on EEG, you may lose some info and you have to work on small segments of the EEG signal during which one can assume that the EEG is stationary. FFT can though show you the power spectrum with frequency on the x axis and power on the y axis, that is the contribution of every single frequency. On the other hand, DWT can deal with non stationary signals like EEG. It usually chops the frequency spectrum into bands or segments and keep dividing these bands into smaller portions that allow us to zoom at specific events of interest. In the video, I already showed you how to extract the EEG bands related features. So if you ask can you plot EEG bands then I would say watch the video again as you obviously missed this part. Your second question, DWT is not a frequency analysis tool like FFT, it’s a time frequency analysis tool or time scale. Hence you can get localised info in time and frequency. For your question in which one to use, I would say use whatever works the best for your example.
@pedrohenriqueborghi1279
@pedrohenriqueborghi1279 Жыл бұрын
Hi, @AlaphBeth ty for your video! Could you clarify something? When decomposing the signal with wavelets, the decimation process won't make the left most portion of the spectrum (lowest frequencies) have less duration? If so, is it not contradictory? Should not the left most have the greatest duration due to larger wavelength? TY (:
@AlaphBeth
@AlaphBeth Жыл бұрын
Thanks for your feedback. With every decomposition step you have a filtering process and a down sampling step. The down sampling step will result in less samples being kept as you keep decomposing. This downsampling applies to left and right sides of the generated nodes. As a result, the number of samples left after each decomposition step reduces on both sides. About your question on wavelength, not sure why you assume the left most to have the greatest duration if you keep downsampling! Check the book titled Ripples in mathematics, it explains it all in an excellent way link.springer.com/book/10.1007/978-3-642-56702-5
@Martinko_Pcik
@Martinko_Pcik Жыл бұрын
9:20 I woul add that with SFFT you lose low level frequencies for capturing of which you need the longer sample time. That nicely lays out the motivation for wavelets, which addresses thei conflict between time resolution and detection of low frequencies
@the-hanhpham8950
@the-hanhpham8950 Жыл бұрын
Thank you very much for your teaching. May I know if you have any recommendations for removing the powerline interference in ECG signals? Thank you again.
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback. The choice of the method depends pretty much on the platform in which you are applying the baseline wandering methods. If you are running these kind of analysis on a PC then you can use whatever method there and specifically explore the deep learning approaches as the literature is promoting these methods. However, if you are considering running these analyses on a wearable device, then it’s all about the computational power of your wearable device that will determine what method(s) you can use. As for the selection of the methods themselves, I have explored a number of these in the video specifically for ECG signals, and there could be more methods out there, but it all depends again on what you want specifically, that is to extract some features without caring much about the shape or pattern or you want very nice:clean representations for exploring:plotting or other purposes.
@JudgeFredd
@JudgeFredd Жыл бұрын
Great explanaions tx !
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you, appreciate the feedback.
@RafaelQuirinoVex
@RafaelQuirinoVex Жыл бұрын
What an excellent lecture. Its really hard to find such good ones. Hats off for you!
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you so much for your feedback, much appreciated.
@KhaledMohammed-i9r
@KhaledMohammed-i9r Жыл бұрын
nice explanation. can you provide us with slides?
@indrakishorebarman5267
@indrakishorebarman5267 Жыл бұрын
you are applying Histogram Approach to discrete data or continuous data?
@andrewwang9405
@andrewwang9405 Жыл бұрын
Great video! Thanks.
@-E42-
@-E42- Жыл бұрын
I think the metaphor of the train platform vs. seat choice is interesting - it has some confusing aspects though since the frequencies make no choices on where to sit :D There is a spatio-temporal uncertainty in spectral/temporal analysis, but it is still a deterministic affair without any random or choice elements :) But there is something to it about the signal passing by, the "window" the train represents and people getting in and out of the train and so on :D Still wrapping my head around it
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback, much appreciated. I tried to draw an intuitive example that a new starter in the field can relate to and couldn’t find something easier from the real world rather than the train example :)
@dreamdrifter
@dreamdrifter Жыл бұрын
​@@AlaphBeth Your video is impressively detailed and the effort you've put in is clear. Thank you! The train metaphor was a decent attempt but it was a bit confusing. Have you thought about using audio/music as an example instead? Consider a song, where each instrument contributes distinct frequency components unique to its timbre, which can be represented as Fourier constituents in a signal. Instruments don't always play throughout the entire song - they enter and exit. Similarly, our signal's frequency content varies temporally. This variation can be visualised in a spectrogram, correlating to temporal analysis.
@AlaphBeth
@AlaphBeth Жыл бұрын
@@dreamdrifter Good one 👍 For me the idea of train/people seemed more appealing at the time as you get to see people sitting in the different seats but you can tell when they went inside the train (if you are sitting already), and from outside the train you don’t know what seats they will take without being inside, which paved the way for time frequency view (standing near the door). I guess with some nice presentation the idea of song would look great in this topic.
@dreamdrifter
@dreamdrifter Жыл бұрын
@@AlaphBeth Indeed. However, it is not clear how the distribution of the people standing on the platform has any temporal element - I perceive that as a spatial distribution. And to be difficult, if I am sitting on the train I can turn my head towards the door and see who is coming in and out. I understand the analogy assumes otherwise but this fact is likely to cause some cognitive dissonance (at least, it did for me)
@-E42-
@-E42- Жыл бұрын
There are some errors and also mild misconceptions in this presentation, but also a lot of good in it. I definitely do not regret having spend the hour on it, thank you!
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback, much appreciated. When you have some time, it will be great if you can share with me what went wrong and the misconceptions through an anonymous email through my website www.rami-khushaba.com/contacts.
@SSS0401
@SSS0401 Жыл бұрын
Great video Rami :-). Do you have any python code for your method that was in the IEEE article?
@AlaphBeth
@AlaphBeth Жыл бұрын
Thanks for your feedback. Yes, the repo link is shown on slide 13, github.com/mitbal/py-bwr
@spandandey3113
@spandandey3113 Жыл бұрын
In 1D example, why does the feature dimension (2nd) become 13 ?
@AlaphBeth
@AlaphBeth Жыл бұрын
The number of scattering coefficients depends on the values of the SignalLength, InvarianceScale, and OversamplingFactor properties of the scattering framework SF. Specifically, len = 1+fix((sl-1)./2^(cr-osfac)); sl = SignalLength cr = criticalResolution osfac = OversamplingFactor
@shabbirahmedosmani6126
@shabbirahmedosmani6126 Жыл бұрын
Amazing! Just amazing.
@sachingiri6017
@sachingiri6017 Жыл бұрын
Hello, I am trying to do similar project in my final year engineering with 2 channel grove emg sensor having 3 electrodes each. Can you help me share the resources, related codes ?
@AlaphBeth
@AlaphBeth Жыл бұрын
Hello, this video is from 11 years ago, so as much I would like to help you here, I honestly don’t have any code here for grove EMG data collection.
@janschmidt1218
@janschmidt1218 Жыл бұрын
Thank you for this great explanation! Helped me a lot. I have one question: In 31:20 you say what is I(X,Y,Z) in the Venn diagram. From what I understood from the example with just two variables, X and Y, the area for I(X,Y) was the envelope of the Venn diagram (at least it was marked like this). Why is it here not the envelope of the three circles? Thank you very much already in advance!
@AlaphBeth
@AlaphBeth Жыл бұрын
Hello, thanks for your feedback. About your question: for the case of two variables, the exterior envelope of the two circles is H(X,Y) that is the entropy of the two variables. Mutual information, I(X;Y) is given by the overlapping region between the two circles. So you start from entropies, and the joint areas are the portions that one variable knows about another and hence reducing entropy - this is mutual information. The same goes for the case of three variables. I(X;Y;Z) is the joint part between the three circles and the outside envelop for the three circles is the entropy.
@janschmidt1218
@janschmidt1218 Жыл бұрын
Thank you, ah yes I mixed up the entropy and the mutual information. It’s clear now, thanks!
@BioniChaos
@BioniChaos Жыл бұрын
great content, highly recommended!
@monashaaban2337
@monashaaban2337 Жыл бұрын
Thank you so much dr Rami Khushaba for the information. what about the detrend function to removing baseline wandering from ECG signal? please dr continue analysis of ECG signal.
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback. If you mean the detrend function in Matlab, that one is based on curve fitting, I.e., fitting a curve to the data and then subtracting that curve away. This is not explicitly looking at filtering a range of frequencies like the FFT, classical filters, or wavelet approaches. So the methods in the video look at frequency domain analysis or time-frequency analysis versus detrend that does curve fitting. On the other hand, the deep learning approach learn how to act as a robust filter based on how much data you show it (can be thought of on both sides).
@monashaaban2337
@monashaaban2337 Жыл бұрын
@@AlaphBeth Hi, dr.. If using DWT db4 level 10 to ECG Signal to removing noise Fs= 360 baseline wander (0 - 0.5hz) = [a10+d10+d9+d8+d7+d6+d5+d4+d3+d2+d1] =for feq between (0- 0.35hz) and for power line interference (50 / 60 hz) PL= [a4+ d4+ d3+d2+ d1], is the correct dr.
@AlaphBeth
@AlaphBeth Жыл бұрын
@@monashaaban2337 there is no correct and wrong here, it’s about what works the best for your signals. Just run your code and see how good it is denoised. For the baseline wander that range seems to be within the limits so it should give you some good approximation there. For the power line interference, 4 levels of decomposition will give you ranges of nearly 22.5Hz and that is a bit wide range if you want to filter 50Hz. As you are trying to do multiple ranges of frequencies, how about you try the same idea in the video but with wavelet packet transform? That will give you more control over the ranges.
@monashaaban2337
@monashaaban2337 Жыл бұрын
@@AlaphBeth thank you dr.
@AlaphBeth
@AlaphBeth Жыл бұрын
@@monashaaban2337 happy to help anytime, keep the questions coming if you have more :)
@anilpokhrel8136
@anilpokhrel8136 Жыл бұрын
Excellent video
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you, appreciate the feedback
@hassanqassim8945
@hassanqassim8945 Жыл бұрын
Thank you very much Dr for the valued information. I think the wavelet transform approach is beneficial for identifying unknown noises and their frequencies. In the example of this video, the ECG has already known frequency, so using suitable band pass filter with appropriate order would also give good result. However, wavelet transform for baseline wandering gives me a lot of ideas to apply in the future. Thanks again Dr
@AlaphBeth
@AlaphBeth Жыл бұрын
Thank you for your feedback, I am glad it helped.
@slembcke
@slembcke Жыл бұрын
I've used IIR filters for real-time use cases in the past, but would be interested in trying something better. I don't have much experience with the DWT, so it's not clear to me how you would apply it in real time. Doesn't it require the entire signal? With an IIR filter you can just process each sample as it comes in, or use a short buffer for FIR/FFT filters.
@AlaphBeth
@AlaphBeth Жыл бұрын
Here is one paper that discusses the implementation details for denoising with wavelets in real-time www.researchgate.net/publication/4174293_A_real-time_system_for_denoising_of_signals_in_continuous_streams_through_the_wavelet_transform. A more recent experiment with a DSP kit is also available here akulmalhotra.github.io/posts/2020/05/waveletecg/. Myself, I have used the DWT for EMG feature extraction (not ECG denoising) in real-time experiments, working on windows of 256ms worth of data. As for your question, a short buffer is suggested.
@slembcke
@slembcke Жыл бұрын
Thanks! I'll give this a read.
@ProgrammingCradle
@ProgrammingCradle Жыл бұрын
Thank you so much Rami for this video. It helped me to understand the basic concepts involved in removing baseline wandering.