Singular Value Decomposition (SVD): Overview

  Рет қаралды 587,644

Steve Brunton

Steve Brunton

Күн бұрын

Пікірлер: 183
@aravindhvasu195
@aravindhvasu195 5 жыл бұрын
Oh my god, was going through the control bootcamp, hit a wall with SVD, the next day, series in SVD. Thanks a lot for these gorgeous lectures.
@philippbeer
@philippbeer 4 жыл бұрын
This is a fantastic channel Dr. Brunton! I just stumbled across it searching for SVD and got hooked on the content. Your unpretentious, clear and thorough explanations are a delight. They way you've set up the board and screen projection is fantastic. I'm really impressed with this and want to say thank you to you and the team that made this production possible.
@Tggfredcsawsdfgbhhhhu
@Tggfredcsawsdfgbhhhhu 4 жыл бұрын
"I'm gonna walk you through..." Dude has no legs and is still gonna walk. #Inspirational
@vaibhavsharma1634
@vaibhavsharma1634 4 жыл бұрын
how do I like this twice
@sydlogan9300
@sydlogan9300 3 жыл бұрын
He also seems to be able to apply a mirroring transformation allowing him to write backwards.
@ayoubsbai6339
@ayoubsbai6339 3 жыл бұрын
I can't unsee that now lmao
@wzyjoseph7317
@wzyjoseph7317 3 жыл бұрын
and write words in mirrow form omg
@glq-xz9de
@glq-xz9de 4 ай бұрын
hahahaha!!! LMAO!
@itsgoubie
@itsgoubie 4 жыл бұрын
It's really interesting to see how left-handedess works when mirrored. Quite an effect on the brain!
@danluba
@danluba 3 жыл бұрын
Dude, I've been trying to figure out whether he's writing everything backwards, which side his parting is on, whether he's left-handed or right-handed, married or not... Do you understand what magic is this?!
@danluba
@danluba 3 жыл бұрын
Haha... no worries - I've figured it out!
@aishaaijazahmad6184
@aishaaijazahmad6184 3 жыл бұрын
@dan do tell because I have no idea how this video was made
@beastmode1647
@beastmode1647 2 жыл бұрын
@@aishaaijazahmad6184 he writes normally on a piece of glass between him and the camera. Then, in editing, he mirrors the video It looks like he’s writing backwards with his right hand. In reality, he’s writing normally with his left hand
@evain4760
@evain4760 2 жыл бұрын
@@beastmode1647 😂I was wondering how too ! Thank u
@willw4096
@willw4096 Жыл бұрын
Great video! My notes: 2:32 3:15 3:26 used to solve non-square that are non-invertible 3:38 3:52 3:58 4:40 4:52 5:07 5:26
@pranavthiriveedhi8127
@pranavthiriveedhi8127 4 жыл бұрын
hey, steve! just wanted to say that I am doing data science in college right now and it is really hard to learn when you don't understand why you are doing something but you make it really easy to understand why we do a certain thing and how it actually connects to data science. so thank you sm!
@PunmasterSTP
@PunmasterSTP 2 жыл бұрын
Hey I just came across your comment and was curious. How have your studies in data science been going?
@ryanjones1704
@ryanjones1704 4 жыл бұрын
Truly a remarkable series of lectures. Infinitely appreciative.
@Eigensteve
@Eigensteve 3 жыл бұрын
Glad you like them!
@jessysaintauret3615
@jessysaintauret3615 5 жыл бұрын
Wow ! Wasn’t expecting a new video, especially on that topic though ! Great to see you back on lecturing! The new video aspect looks great with the black background. Thank you !
@Cidou_h
@Cidou_h Жыл бұрын
Discovering this channel is one of the best things that happened to me. Thank you isn't enough to say how I feel. wow
@Mechomittencaterpillar
@Mechomittencaterpillar 10 ай бұрын
Machine Learning for Manufacturing Automation is a brand new course being offered at Missouri University of Science and Technology, and I am in the second class ever to go through it. Thanks for your videos, they’re very helpful to establish intuition!!
@manishamin7142
@manishamin7142 3 жыл бұрын
is he filming through a mirror or writing backwards? or mirroring the video before posting? what is going on here, how is he writing backwards!?!
@charlieolivergomez2376
@charlieolivergomez2376 3 жыл бұрын
it's called a lightboard, just google it
@fixed-point
@fixed-point 3 жыл бұрын
"just google it". I guess some people can't help but be assholes
@charlieolivergomez2376
@charlieolivergomez2376 3 жыл бұрын
@@fixed-point did i hurt your feelings little man? I think you need to grow up. I don't know much except that it is called a lightboard and google definitely knows more than me. It is an admission that I'm not an expert. Who's the asshole, asshole
@fixed-point
@fixed-point 3 жыл бұрын
@@charlieolivergomez2376 looks like I hurt your feelings. I'm sorry 😢
@charlieolivergomez2376
@charlieolivergomez2376 3 жыл бұрын
@@fixed-point No offense taken brother. It was my fault in the first place for not being clear
@Veptis
@Veptis 3 жыл бұрын
Watched a lecture on SVD as part of a vector semantics course. Will watch the 2nd part and exercise tomorrow, but I added a few of your videos to my watch later and will watch them over night. Your rather visual explanations always help me to understand the concepts and see their use.
@Qornv
@Qornv 4 жыл бұрын
I love finding wonderful teachers unexpectedly
@markreichelt9281
@markreichelt9281 8 ай бұрын
These videos are priceless. Thank you for such a clear exposition of an important topic.
@MsAlarman
@MsAlarman 3 жыл бұрын
Really amazing how you introduce us to “mysterious” ways of manipulating our interests in such a crystal clear way!
@andrewchen2349
@andrewchen2349 5 жыл бұрын
Thank you, Dr. Brunton! Really hope you can upload more videos!
@VedJoshi..
@VedJoshi.. 2 жыл бұрын
never realized that Prof Kutz was your colleague. he really is a legend.
@adricat59
@adricat59 5 жыл бұрын
Thank you! It is nice to have you back 😉
@wym247
@wym247 Жыл бұрын
A big thanks to you Dr. Brunton !
@aymenoulmi7672
@aymenoulmi7672 2 ай бұрын
data driven generalization of the fourier transform OMG!!! this is why i love MATH
@hdadeathly
@hdadeathly 4 жыл бұрын
Awesome videos - thanks so much for the easy-to-understand explanations. I just ordered the book and this greatly helps supplement!
@nishantaswani8976
@nishantaswani8976 4 жыл бұрын
Thank you so much for the effort you put in to help others. So grateful for the quality content. I'm very privileged to have access to this quality of teaching!
@yaoliu7034
@yaoliu7034 5 жыл бұрын
Excellent! Can you add numbers (in the series) so we know what order to watch them? Thanks
@Eigensteve
@Eigensteve 4 жыл бұрын
I have put everything into playlists, so that should help with the ordering.
@37047403
@37047403 5 жыл бұрын
Thank you! I was just studying Word2Vec and GloVe algorithms and really needed this kind of content!
@jyoti_4568
@jyoti_4568 3 жыл бұрын
This series helped me immensely. Thanks a lot!
@GreenBean0222
@GreenBean0222 10 ай бұрын
Thank you so much for this video series. It helped me a lot!
@Mustafa51993
@Mustafa51993 5 жыл бұрын
Wow soo good to have you back 😃....Thank you
@vermashwetank
@vermashwetank 4 жыл бұрын
I am learning this because I saw this being used in Battery modelling for electric vehicles. I don't understand how it is used (which is why I am here) but you can add that to number of applications of SVD
@Eigensteve
@Eigensteve 4 жыл бұрын
Thanks!
@YYchen713
@YYchen713 2 жыл бұрын
Awesome lecture!!! Writing in mirror style and still be able to have great flow of thought, woow
@tanyapatel4130
@tanyapatel4130 2 жыл бұрын
i really like the video presentation and clarity of topics, stayed and subscribed.
@loden5677
@loden5677 Жыл бұрын
Thanks so much for this series, I’m so excited to watch it! Just wondering if there are videos for all chapters of the book or only a select few?
@hubstrangers3450
@hubstrangers3450 5 жыл бұрын
Hope the series could link to the colab, thanks for the content.
@sanjoybhattacharjee8261
@sanjoybhattacharjee8261 3 жыл бұрын
I would have changed the series name, as you have said @ 5:33, to "Linear Algebra to make Money" :-). Thank you Professor for sharing the series of lectures - very thorough and extremely helpful.
@malihareza4754
@malihareza4754 4 жыл бұрын
Very very excited for the series. Thank you
@PunmasterSTP
@PunmasterSTP 2 жыл бұрын
SVD overview? More like "Super great information that everyone should view!" 👍
@ehabnasr6925
@ehabnasr6925 Жыл бұрын
Where can I find -in the playlist- the "tailored" data-driven transforms part?
@sapertuz
@sapertuz 4 жыл бұрын
Hey Steve. Silly question... Did you learn to write backward so you can do these videos or how do you achieve this? 😅
@and_jannis
@and_jannis 4 жыл бұрын
mirror the video ;)
@musaerdemsevim
@musaerdemsevim 3 жыл бұрын
@@and_jannis no it is not. He is actually writing from his right to left as backwards
@TEOGUN
@TEOGUN 3 жыл бұрын
kzbin.info/www/bejne/rXSypqhmYtRoj6s HE is probably shooting through a mirror
@ehabnasr6925
@ehabnasr6925 Жыл бұрын
Thank you so much for these videos I'm persuing the playlist and I really love it!
@ScottSummerill
@ScottSummerill 4 жыл бұрын
Is there an order to all these videos? Difficult to discern. Except for the ones that begin, “Welcome back ...”.
@Eigensteve
@Eigensteve 4 жыл бұрын
Here is the playlist: kzbin.info/www/bejne/nYnFhZt5jc-NfK8
@garrettdyess1110
@garrettdyess1110 2 жыл бұрын
Which classes would be prerequisites for this content if it were to be presented in a class at a University?
@hecanyon2161
@hecanyon2161 2 жыл бұрын
Super curious about how he writes in that direction with out hand writing flipped.😲
@shailshah5803
@shailshah5803 2 жыл бұрын
are you writing backwards on a glass board or is this some kind of editing magic ... this keeps me up at night
5 жыл бұрын
I always wondered how these videos are recorded. Is there a glass between you and the camera? Great content anyways!
@Sonnentau1
@Sonnentau1 4 жыл бұрын
Blind guess: Its glass and than they flip the video horizontally... Or Mr Brunton is not only a genius but is also able to write mirror font. I finde both equally likely
@jobleser
@jobleser 4 жыл бұрын
@@Sonnentau1 Dr Brunton seems to be actually left-handed as per other videos; so the glass/flip-video hypothesis/trick seems likely. Neat.
@radarmaker1
@radarmaker1 4 жыл бұрын
Wedding band on the "right" hand, so think he's left-handed and image flipped :)
@hariprasadhparthasarathy6360
@hariprasadhparthasarathy6360 4 жыл бұрын
I have asked Prof brunton in another video about the exact same thing and he replied with 'years of practice' :)
@dylangomes3853
@dylangomes3853 4 жыл бұрын
If there is glass, the writing is still backwards relative to the writer. I don't see how it matters if you flip it.
@anondoggo
@anondoggo 3 жыл бұрын
Concise and rich. Brilliant!
@justinli19901027
@justinli19901027 4 жыл бұрын
love it, what a series, thank
@prabalghosh2954
@prabalghosh2954 3 жыл бұрын
Very, very nice explanation and presentation. Thank you!
@timanb2491
@timanb2491 3 жыл бұрын
Hi, Steve! Nice lecture. Is there a exercise for this topic?
@kunalvshah
@kunalvshah 3 жыл бұрын
Hi, is there any sequence I should follow to watch these videos ?
@flybekvc
@flybekvc 4 жыл бұрын
Is there some video for each chapter of the book?
@Eigensteve
@Eigensteve 3 жыл бұрын
Yes, we tried to break it down so each section has a video.
@andrewalamban3632
@andrewalamban3632 3 жыл бұрын
Thanks for the content! Also super impressive if it is the case that you're writing in reverse!
@Eigensteve
@Eigensteve 3 жыл бұрын
Glad you like it!
@Mario112352
@Mario112352 2 жыл бұрын
Can not access some of the function since they are in the Statistical Toolbox.
@EW-mb1ih
@EW-mb1ih 2 жыл бұрын
What do that mean "Data-driven" generalization of FFT?
@videofountain
@videofountain 4 жыл бұрын
Good Presentation. 👩🏽‍🏫. There is a book and .pdf listed above. Where can I find how correlated or not these documents are? Do these two documents work together? Does the .pdf document have an errata sheet? Thanks.
@FrankGibbs-e7p
@FrankGibbs-e7p 11 ай бұрын
What dry erase markers do you use?
@Jean-BaptisteMalagnoux
@Jean-BaptisteMalagnoux Жыл бұрын
Does someone now what marker pen this guys use ?
@akanhakan
@akanhakan 4 жыл бұрын
Great lectures. I have ordered your book.
@charliehou9553
@charliehou9553 3 жыл бұрын
Best lectures of SVD! BTW, Dr.Brunton looks like Filthy Frank (but more handsome than Papa Franku)
@woowooNeedsFaith
@woowooNeedsFaith 4 жыл бұрын
Why this video is available only in HD? It can be a bit problematic...
@mcmormus
@mcmormus 4 жыл бұрын
i have all the options from 144p up to 1080p...
@woowooNeedsFaith
@woowooNeedsFaith 4 жыл бұрын
Strange. I still have only 1440p and 2160p options.
@Eigensteve
@Eigensteve 4 жыл бұрын
Sorry about that. Newer videos will have this issue fixed.
@vlogs627
@vlogs627 Жыл бұрын
Just surprised at the production logic behind the video. Had to think for solid 5 min to figure out how it was recorded and edited for us to be able to read those words. I got inner peace after figuring that out.
@lacnguyen178
@lacnguyen178 4 жыл бұрын
What application did you use to make this transparent board?
@Eigensteve
@Eigensteve 3 жыл бұрын
We are using the lightboard
@ahmedgharieb5252
@ahmedgharieb5252 Жыл бұрын
If I have a single time series.. Then what should i do to get eigenvalues?
@Tyler-pj3tg
@Tyler-pj3tg 2 жыл бұрын
Amazing series!
@naeimwtg
@naeimwtg 4 жыл бұрын
Steve, thanks for sharing! Can you please clarify the how can combine results two or more singular value decomposition got from same object like multilayer matrix?
@shubhamkumarsaurav5212
@shubhamkumarsaurav5212 4 жыл бұрын
You like like "Harrison wells" character in the flash season 1. He was a great scientist and teacher in Reel life , You are same in real life. Very nice Videos, Thank you
@blitzkringe
@blitzkringe 3 жыл бұрын
I tried to get a tailored basis for my data using SVD, and it yielded the exact Fourier basis. :D
@AnqHuang
@AnqHuang 4 ай бұрын
How can I make such an instructional video? This handwritten text feels like it is written upside down in the mirror.
@jezza10181
@jezza10181 Жыл бұрын
Fantastic presentation. I only know what the SVD was, had no idea it had so many uses.
@CSEVARUNKARTHICKP
@CSEVARUNKARTHICKP Жыл бұрын
are you left or right handed?
@trungkienngo6267
@trungkienngo6267 Жыл бұрын
The writing is trippy man. The words are not supposed to look like that if he’s facing the camera, it’s supposed to be from right to left and written backward. How does the writing looks like normal in the video? Unless the guy is writing backward
@jacobanderson5693
@jacobanderson5693 5 жыл бұрын
Thanks for posting these videos
@randythamrin5976
@randythamrin5976 4 жыл бұрын
I've done watched the videos, till data visualization - buyer beware. Please tell me, should I watch another one playlist before watch this video? Like linear algebra or begining scientific computing? Thank you
@wentaowu3070
@wentaowu3070 11 ай бұрын
I have to say: not only the lectures are really handsome, the man himself is also really handsome. hahaha. What a great educator!
@jacobwise7008
@jacobwise7008 2 жыл бұрын
For the first 3 minutes and I was so confused and amazed by his incredible talent for mirror writing (it looked as good as my normal handwriting!) Then I realized he probably flipped the video 😅😆
@supriyakm471
@supriyakm471 3 жыл бұрын
Loved it content, presentation 💗💗💗
@KhanhDinh-l6k
@KhanhDinh-l6k 15 күн бұрын
this is just gorgeous
@aubinthomas
@aubinthomas 4 жыл бұрын
I did high graduate school in engineering and I learned there how to hate mathematics. If only I had such a teacher, it would have been definitely different.
@adinovitarini6173
@adinovitarini6173 4 жыл бұрын
Hello Prof. I want to ask you something, is SVD have big impact on system identification of a dynamic system, if we combine with least square algorithm ? or it just useful enough for machine learning task ? Thanks you
@Falconoo7383
@Falconoo7383 3 жыл бұрын
at 5:34... How we can make money from Linear Algebra?
@bediosoro7786
@bediosoro7786 3 жыл бұрын
i understand clearly how to compute the SVD. but it seems like that i forgot something. if i have a matrix of nxn and i want to reduce the dimesion to rxr . how do i get the rxr matrix? if someone knows inform me i need it right away.
@phamhongvinh550
@phamhongvinh550 4 жыл бұрын
Thank you so much for the content.
@mohamedelaminenehar333
@mohamedelaminenehar333 3 жыл бұрын
Thank you )) Sir can you tell us the most important math lessons a student of automatic control and signals needs? 😊😊😊😊
@hoopssheaffer
@hoopssheaffer 5 ай бұрын
How does he write backwards?
@محدثهاحمدی-ق6ط
@محدثهاحمدی-ق6ط 2 жыл бұрын
0:52 ! how it is possible? writing backward!!!
@all_bright
@all_bright 3 жыл бұрын
Hi! Thank you so much for these vids. Realized yesterday that I couldn't make myself use SVD unless I understand the logic of it. Could someone possibly recommend the topics I should look into beforehand in order to understand it and subsequent topics? I don't have a foundation in Maths beyond High School Level.
@ronronn3148
@ronronn3148 3 жыл бұрын
you should learn some linear algebra. you need a little calculus to do linear algebra sometimes, but it can mostly be done with integration and differentation. easy topics to look into, you're going to be using basic integration and differentiation. linear systems, manipulating them, understand matrices and how to manipulate them, how to find eigen values and eigenvectors, what eigenvalues and eigenvectors are. kinda gives you a base level for linear algebra.
@all_bright
@all_bright 3 жыл бұрын
@@ronronn3148 Thank you so much! I think I know what all you've mentioned but I'm coming to realize that what I know generally isn't everything I'm supposed to know. I'll look up the mentioned topics in detail. :-D
@ronronn3148
@ronronn3148 3 жыл бұрын
@@all_bright There's alot of stuff you're gonna be lost on and I think its important to write stuff down, or take mental note of what vocabulary and operations makes your mind blank. You look those words up, read about the topics, and fill in the blanks. alot of resources online.
@all_bright
@all_bright 3 жыл бұрын
@@ronronn3148 Yes! Thank you for the suggestion. Will keep that in mind.
@ulrikalundholm5458
@ulrikalundholm5458 3 жыл бұрын
I love this, thank you!
@mehmetaydin3103
@mehmetaydin3103 16 сағат бұрын
thanks man you are the best
@nisbahmumtaz909
@nisbahmumtaz909 2 жыл бұрын
Yo, how do you learn to write in reverse like that
@mndhamod
@mndhamod 3 жыл бұрын
You are left-handed. Gotcha!
@hyperduality2838
@hyperduality2838 4 жыл бұрын
Simple, linear = Predictable or syntropy The time domain is dual to the frequency domain Thesis (time) is dual to anti-thesis (frequency) -- the time independent Hegelian dialectic Predictability is dual to unpredictability, certainty is dual to uncertainty, syntropy is dual to increasing entropy, the fourth law of thermodynamics. Energy is dual to mass -- Einstein. Dark energy is dual to dark matter.
@dankons6578
@dankons6578 4 жыл бұрын
what
@hyperduality2838
@hyperduality2838 4 жыл бұрын
@@dankons6578 There is a 4th law of thermodynamics, syntropy is a dual process to that of increasing entropy. Teleological physics (syntropy) is dual to non-teleological physics (entropy). Certainty is dual to uncertainty -- the Heisenberg certainty/uncertainty principle. The conservation of duality is the 5th law of thermodynamics. Duality is energy, energy is duality. Potential energy is dual to kinetic energy. Apples fall to the ground because they are conserving duality. Action is dual to reaction -- Sir Isaac Newton. Positive charge is dual to negative charge -- electric fields. North poles are dual to south poles -- magnetic fields. Electro is dual to magnetic, electro magnetic energy (light) is dual. "Always two there are" -- Yoda.
@dankons6578
@dankons6578 4 жыл бұрын
oh ok i get it now
@hyperduality2838
@hyperduality2838 4 жыл бұрын
@@dankons6578 Gravitation is equivalent or dual to acceleration -- Einstein's happiest thought, the principle of equivalence (duality). There is a pattern of duality hardwired into the physics and also philosophy, mathematics, biology, control theory etc. This important fact is currently not appreciated by those who fund science.
@Plin34
@Plin34 4 жыл бұрын
Thanks!
@Eigensteve
@Eigensteve 3 жыл бұрын
Welcome!
@LGURUGUBELLISAIKUMAR
@LGURUGUBELLISAIKUMAR 3 жыл бұрын
nice explain how to interact with you
@rodentrider2
@rodentrider2 3 ай бұрын
svd gun?
@Dimpu82
@Dimpu82 3 жыл бұрын
Great video. Wish my ADHD brain would stop focusing so much on the handwaving and the hows and why of the this weird otherworldly transparent glassboard/whiteboard
@3ss3ns3
@3ss3ns3 3 жыл бұрын
SVD is gangsta until Matrix: 1000000 x1000000 arrives!!
@Eigensteve
@Eigensteve 3 жыл бұрын
Then hit it with randomized SVD!
@Otohmanuye
@Otohmanuye 9 ай бұрын
I’m searching SVD gun and this video shows up
@JayaPrakash-zk5ep
@JayaPrakash-zk5ep 4 жыл бұрын
Love from india❤️
@Eigensteve
@Eigensteve 3 жыл бұрын
Hello from Seattle!
@afiqyahya3398
@afiqyahya3398 4 жыл бұрын
Guess I'm late to the party. Just found out your channel. Damnnnnn
@kannakamuiedits
@kannakamuiedits 3 жыл бұрын
Svd like when I be pulling out this Russian svd dragunov in the school
@WealthyInsuranceOfficial
@WealthyInsuranceOfficial Жыл бұрын
D - Decomposition R - Rational A - Angle G - Geometry U - Unitary N - Numbers O - Obstacle V - Variation
@alexandresibony1345
@alexandresibony1345 3 жыл бұрын
The fact that you are left handed makes it even more confusing
@monh964
@monh964 4 жыл бұрын
Today, I have discovered a gold mine...
Singular Value Decomposition (SVD): Mathematical Overview
12:51
Steve Brunton
Рет қаралды 410 М.
Une nouvelle voiture pour Noël 🥹
00:28
Nicocapone
Рет қаралды 9 МЛН
Don’t Choose The Wrong Box 😱
00:41
Topper Guild
Рет қаралды 62 МЛН
Principal Component Analysis (PCA)
13:46
Steve Brunton
Рет қаралды 406 М.
StatQuest: Principal Component Analysis (PCA), Step-by-Step
21:58
StatQuest with Josh Starmer
Рет қаралды 3 МЛН
Singular Value Decomposition (the SVD)
14:11
MIT OpenCourseWare
Рет қаралды 628 М.
Singular Value Decomposition (SVD): Matrix Approximation
14:54
Steve Brunton
Рет қаралды 248 М.
Unitary Transformations
12:11
Steve Brunton
Рет қаралды 59 М.
What is the Singular Value Decomposition?
7:40
Stochastic
Рет қаралды 124 М.
Lecture 47 - Singular Value Decomposition | Stanford University
13:40
Artificial Intelligence - All in One
Рет қаралды 339 М.
Lecture: The Singular Value Decomposition (SVD)
44:36
AMATH 301
Рет қаралды 231 М.
But what is the Fourier Transform?  A visual introduction.
20:57
3Blue1Brown
Рет қаралды 10 МЛН
Singular Value Decomposition (SVD): Dominant Correlations
11:19
Steve Brunton
Рет қаралды 140 М.