17: Principal Components Analysis_ - Intro to Neural Computation

[@SyedMohommadKumailAkbar]

Absolutely incredible teaching. started doing math again after a gap of 12 years and this just clicked.

[@ksjksjgg]

Great thanks Prof. Fee and MIT for sharing this excellent lecture!!!

[@markdebono1273]

I have been watching videos on this topic for the last 2-3 months. However, it was ONLY after watching this lecture that I understood EVERYTHING! Not to discredit any of the other videos I watched, but this video is made at a very good pace and I did not need to pause a hundred times to give my mind time to process all the incoming information and cool down 😁 If I could give a thumbs up 10 times, I would do it!

[@ElectroCute10]

This is nice, I tried to replicate the de-noise in Python using sine and cosine "signals" with some random noise (basically sine(timepoint) + np.random()) and realised that it does not work the way it is described here because the variance is always roughly the same in every dimension (i.e. every timepoint). To be able to isolate the underlying trend using eigenvectors I had to skip the step Z = X - MU at 1:16:01, as that step causes the variance the be approximately the same in all dimensions. If we do not subtract the mean but define our "covariance" matrix as simply Z * ZT then our "variance" is actually higher when the underlying signal is higher and lower when the underlying signal is lower. That way I could isolate the signal. Having said that, maybe I have done something completely wrong. This is MIT after all :)

[@prasanth_y_11]

Wow, This is an amazing explanation by building the topic from basics, Even spectral clustering comes with a similar final analysis of the eigenvalues of the covariance matrix.

[@CristianTraina]

Is really needed to zoom in and zoom out all the time? It doesn't let me focus on what I'm reading..

[@SphereofTime]

9:21 for a diagonal matrix, Why lambda stretches the vector

[@ganeshhampapura9842]

Superb clarity professor God bless you

[@jonilyndabalos7105]

Thank you, MIT for sharing these awesome lecture series with the public. You make learning accessible to all, especially the underprivileged. Please keep these videos coming.

[@djangoworldwide7925]

This cloud is basically the electron cloud, isnt it? amazing how everything just fits to that same radial gussain distribution

[@lijisisi]

wonderful material! thank you so much Dr. Fee

[@jorgegonzalez-higueras3963]

Thank you, Professor Fee, for a very clear explanation!

[@nshilla]

The application part of the lecture is at time 41.00

[@et2124]

lol Lina always asks the exact questions I want to

[@animikhaghosh6536]

3:29 wow

[@lohaniamit]

40:24 Just tagging the PCA main part for my reference

[@andrewfalcone2701]

Can someone confirm that lambda+ = a+b, lambda- = a-b is a mistake? I couldn't simplify the radical and double checked with MATLAB's symbolic equation solver (but it doesn't always simplify correctly) and some numbers.

[@andrewfalcone2701]

The A matrix is not the general 2x2 symmetric matrix but [a, b; b,a]. For some reason, d is used on the right side.

[@not_amanullah]

thanks ♥️🤍

[@benjaminbazi9355]

Good lecture!

[@abhay9994]

Awesom

[@jimmylok]

All those zoom in and zoom out make me dizzy...

[@djangoworldwide7925]

I dont believe anyone actually goes thru this process. nowadays its a simple line of code + biplot

[@not_amanullah]

this is helpful ♥️🤍