The Wasserstein Metric a.k.a Earth Mover's Distance: A Quick and Convenient Introduction

  Рет қаралды 32,170

Bob Laramee

Bob Laramee

Күн бұрын

Пікірлер: 108
@mochen9282
@mochen9282 7 жыл бұрын
The BGM is a bit annoying.
@baaliilyes
@baaliilyes 6 жыл бұрын
I totally agree...this is math, we need some silence to focus and understand
@maxsuica6144
@maxsuica6144 6 жыл бұрын
"A bit" annoying. Because apparently there is some possible world where atonal fretless bass is only "a bit" annoying.
@BobLaramee
@BobLaramee 6 жыл бұрын
That's the infamous Tony Levin on bass.
@BobLaramee
@BobLaramee 6 жыл бұрын
It's the amazing Tony Levin.
@ahmedmustahid4936
@ahmedmustahid4936 5 жыл бұрын
Not a bit, VERY annoying
@williamstephenjones3863
@williamstephenjones3863 3 ай бұрын
Brilliant video. Ignore the comments about BGM. We are forever grateful for efforts like this.
@BobLaramee
@BobLaramee 3 ай бұрын
Thanks for watching.
@vanshajkhattar8373
@vanshajkhattar8373 3 жыл бұрын
The explanation is very nice. Highly recommended video for someone who wants to get an intuition into Wasserstein metrics. I think the dislikes are due to music or may be his slow teaching style. I would recommend watching the video at 1.5x atleast.
@BobLaramee
@BobLaramee 3 жыл бұрын
Thanks for watching.
@ArmanAli-ww7ml
@ArmanAli-ww7ml 2 жыл бұрын
But i like this slow style. Everyone has different preferences
@danielliu9616
@danielliu9616 6 жыл бұрын
Speed x1.25 the video becomes normal
@prasanthsrinivasan7709
@prasanthsrinivasan7709 5 жыл бұрын
Thank you so much. It works ;)
@akrammustafa3569
@akrammustafa3569 5 жыл бұрын
Thanks, that is much better
@kamilozdemir9772
@kamilozdemir9772 5 жыл бұрын
x2 speed is better
@Barsay
@Barsay 3 жыл бұрын
oh s^it it works
@HA-zd5gx
@HA-zd5gx 6 ай бұрын
but with that speed the background music is not harmonic as before😢
@lalakyadav1493
@lalakyadav1493 7 ай бұрын
I understood d represents the distance between two distributions. But I'm unclear about the role of dy, specifically how the height of a block (as suggested by dy) contributes to the overall distance calculation.
@BobLaramee
@BobLaramee 7 ай бұрын
Thanks for watching. Yes, the video is not a complete explanation, more like just the beginning. For more, you'll have to do some more research. Have a look at some of the video comments and description.
@roman6575
@roman6575 7 ай бұрын
The BGM is great, felt like background music of a video game, makes it easier to focus.
@BobLaramee
@BobLaramee 7 ай бұрын
The BGM is from Tony Levin.
@shinykaushal
@shinykaushal 8 жыл бұрын
Thank you so much Sir for such a great help. On a single email you made this video & uploaded for me. I am so happy that you responded very kindly. Thanks a Ton !!! :)
@BobLaramee
@BobLaramee 8 жыл бұрын
Thanks for asking a good question.
@amansahani2001
@amansahani2001 Жыл бұрын
Precise Explanation Sir, You are helping me in writing my master thesis. Thank You
@BobLaramee
@BobLaramee Жыл бұрын
Thanks for watching
@justinchen8519
@justinchen8519 6 жыл бұрын
recommend watching in x1.25 speed
@TonyKaku-g8n
@TonyKaku-g8n 4 жыл бұрын
The BGM made me think you were actually living in Antarctica with lovely penguins, I like it btw
@BobLaramee
@BobLaramee 4 жыл бұрын
Chart Denkra thanks for watching
@yashjain8117
@yashjain8117 3 жыл бұрын
Sir make a video on Kullback-leibler distance please
@a.3659
@a.3659 10 ай бұрын
Thanks alot. It really helped me understand!
@BobLaramee
@BobLaramee 10 ай бұрын
Thanks for watching
@Dafiya445
@Dafiya445 3 жыл бұрын
Thanks for your initiative in making this video. Can you please provide a link that compare images using EMD
@ArmanAli-ww7ml
@ArmanAli-ww7ml 2 жыл бұрын
I need further help on this? Anyone?
@GaylordNdemboNDATORO
@GaylordNdemboNDATORO 2 ай бұрын
The number of bins are the same for both distributions?
@SoichiHayashi2014
@SoichiHayashi2014 7 жыл бұрын
Thank you for the video. I have 2 questions. When you say to move a box from one distribution to another, how are you decide the destination of the box? In another words, how do you determine "d" ? If you are moving it to match the shape of the destination, how do you consider its size? Like.. UK is smaller than US, so how do you move all parts of US to UK? Another question is, when you are considering a distance between 2 mathmatical distribution, wouldn't there be a simple equation to calculate it using calculous? Thank you!
@harikannantube
@harikannantube 7 жыл бұрын
Take a look at the first few pages of "Optimal transport meets graph spectra" by Shiping Liu. It is one of the many good introductions that will clarify your questions. In a simplified manner, the answers to your questions are: The moved quantities are infinitesimal in nature. They correspond to densities. The destination in the target of a source point is what one tries to obtain by solving the Monge version of the problem. In the Kantorovich version, a source point can be split and assigned to multiple target points. These transportation maps (for Monge) and transportation plans (for Kantorovich) are obtained by solving optimization problems. Existence of the solution is easier for the Kantorovich problem. The total sizes of the source and target are assumed to be normalized to one, in general. Optimal transport is a rigorous way to get the distance between distributions.
@jjjgrp
@jjjgrp 7 жыл бұрын
Nice share. Thx pal
@alexanderyau6347
@alexanderyau6347 6 жыл бұрын
hi the link is not available now
@Smatema
@Smatema 4 жыл бұрын
@@harikannantube nice explanation. I tried to read the text but this isn't available now. Could you sent to me, please?
@harikannantube
@harikannantube 4 жыл бұрын
@Alexander Yau, @Samuel Francisco, the article title and author are mentioned now.
@ArmanAli-ww7ml
@ArmanAli-ww7ml 2 жыл бұрын
Anyone who have applied this technique with simple example?
@BobLaramee
@BobLaramee 2 жыл бұрын
There are some pointers in the comments.
@ArmanAli-ww7ml
@ArmanAli-ww7ml 2 жыл бұрын
@@BobLaramee thanks, but can i just simply say wasserestein distance as the disimilarity cost one has to pay for any deviation?
@asifmujtaba334
@asifmujtaba334 6 жыл бұрын
Sorry I couldn't understand the part that the distance between two small parts of hight d_y is d.dy?Could you please clarify what am I missing? By the way, it helps a lot.Thanks.
@BobLaramee
@BobLaramee 6 жыл бұрын
Don’t rely on this video for the exact details of the computation. You can check out the paper references in the description.
@taco9453
@taco9453 2 жыл бұрын
Try to apply Wasserstein k means to financial market, thanks for this explanation.🙌
@mahmudzaman9107
@mahmudzaman9107 6 жыл бұрын
Is it possible to give the explanation with an example a = (1,2,3, 4, 6, 11,18) b = (2,6, 18) c= (2,3,4) what is the earth mover distance between a,b and a,c
@JackLe1127
@JackLe1127 6 жыл бұрын
there are a lot of seagulls where you live...
@BobLaramee
@BobLaramee 6 жыл бұрын
Yes there are.
@jay-xj1om
@jay-xj1om 4 жыл бұрын
What is the last song?
@BobLaramee
@BobLaramee 4 жыл бұрын
It is by Tony Levin on an obscure album called world diary
@tejasduseja
@tejasduseja 4 жыл бұрын
Hi, sorry if this sounds like a dumb question but how is the distance between two pieces is dy*d? Does distance metric is defined in such a way?
@BobLaramee
@BobLaramee 4 жыл бұрын
Hi Tejas. It's a fine question. I didn't explain the mathematics very well in the video. I would need to make a follow up video to present the mathematics better. In the meantime, you can have a look at the references made in the comments.
@tejasduseja
@tejasduseja 4 жыл бұрын
@@BobLaramee Thanks for the quick reply and for nice explanation in video ^^. It really helps students like us.
@yehdhihanna6114
@yehdhihanna6114 5 жыл бұрын
the background sound is so anoying (can't focus)
@BobLaramee
@BobLaramee 5 жыл бұрын
It was just an experiment. My other videos have no background music.
@marvinpeng1930
@marvinpeng1930 4 жыл бұрын
Super amazing explanation. Thank you so much!
@BobLaramee
@BobLaramee 4 жыл бұрын
Thanks for watching.
@jaskarankaur4971
@jaskarankaur4971 4 жыл бұрын
Am I wrong, or the music is the cliché US movies's Indian music?
@BobLaramee
@BobLaramee 4 жыл бұрын
The music is from Tony Levin's World Diary album. Not a very popular one but I really like it.
@BobLaramee
@BobLaramee Жыл бұрын
Where are you studying?
@AredioVani
@AredioVani 3 жыл бұрын
Fantastic video, thank you
@reynaldo2232
@reynaldo2232 4 жыл бұрын
Great explanation, thank you
@BobLaramee
@BobLaramee 4 жыл бұрын
Thanks for watching.
@leemun41
@leemun41 3 жыл бұрын
Greate thanks from Brazil!
@jonathanballoch
@jonathanballoch 2 жыл бұрын
6:19 for the math 7:28 for the computing
@TammyZhen
@TammyZhen 7 жыл бұрын
Thank you! Great video, and a very clear explanation.
@BobLaramee
@BobLaramee Жыл бұрын
Thanks for watching
@durandsinclair5338
@durandsinclair5338 7 жыл бұрын
Thanks for your explanation. It really helped me understand things!
@BobLaramee
@BobLaramee 7 жыл бұрын
Durand Sinclair Thanks for watching.
@lujia
@lujia 6 жыл бұрын
Do I need a controller for this video? Because I feel like I have to fight a final fantasy boss at some point. Besides the music great video. Btw I am reading the original paper right now and are the little boxes you drew "signatures" from the paper?
@BobLaramee
@BobLaramee 6 жыл бұрын
Yes, you need a good controller to watch these videos. Probably I should have read the papers I refer to more carefully before making the video.
@JuliusG73
@JuliusG73 6 жыл бұрын
Can Wasserstein be nondeterministic? It seems the Python implementation is giving me very similar values but there are tiny perturbations when I rerun the calculation on the same distributions.
@BobLaramee
@BobLaramee Жыл бұрын
I think the result will depend on the implementation. Thanks for watching
@rahuldeora5815
@rahuldeora5815 6 жыл бұрын
You could have added a bit more dept into this
@BobLaramee
@BobLaramee 6 жыл бұрын
True. i had no idea how much demand there is for this material. A follow-up is on my todo list.
@rahuldeora5815
@rahuldeora5815 6 жыл бұрын
Is there anyway I can contact you( maybe email)? I was planning on doing a research paper walkthrough(kinda like my first but not exactly) of WASSERSTEIN AUTO-ENCODERS: openreview.net/pdf?id=HkL7n1-0b This paper was named one of the top 5 papers for deep learning in 2018. My goal with these videos is to get more more familiar with research papers.
@BobLaramee
@BobLaramee 6 жыл бұрын
Sure. A skype call is also fine. My email is r.s.laramee at swansea.ac.uk. My skype name is rlaramee.
@rahuldeora5815
@rahuldeora5815 6 жыл бұрын
Awesome I will definitely contact you
@shivampadmani_iisc
@shivampadmani_iisc 2 ай бұрын
I am also from Indian Institute of Science Banglore, India
@BobLaramee
@BobLaramee 2 ай бұрын
Thanks for watching.
@AC-dn7xp
@AC-dn7xp 5 жыл бұрын
Is the wasserstein distance symmetric?
@fvguerino
@fvguerino 5 жыл бұрын
Aneeshaa Chowdhry yes
@kb777md
@kb777md 4 жыл бұрын
Thank you
@BobLaramee
@BobLaramee 4 жыл бұрын
Thanks for watching.
@Merajmohdkhan
@Merajmohdkhan 7 жыл бұрын
Perfect explanation ...thumps up for ur effort dude
@BobLaramee
@BobLaramee 7 жыл бұрын
thanks for watching.
@squat200
@squat200 5 жыл бұрын
This is amazing. Thank you.
@BobLaramee
@BobLaramee 5 жыл бұрын
Thanks for watching.
@sanek-kisliy
@sanek-kisliy 7 жыл бұрын
Aweome video, thanks!
@BobLaramee
@BobLaramee 7 жыл бұрын
Thanks for watching.
@Ferguson02871
@Ferguson02871 5 жыл бұрын
Well done sir thank you.
@BobLaramee
@BobLaramee 5 жыл бұрын
Thanks for watching.
@alexanderyau6347
@alexanderyau6347 6 жыл бұрын
You have a big cup!
@BobLaramee
@BobLaramee 6 жыл бұрын
Big cup for big mouth 😉
@imranrashid2890
@imranrashid2890 5 жыл бұрын
what's with this annoying background music? I just want to learn!
@BobLaramee
@BobLaramee 5 жыл бұрын
High standards.
@sydneystriker5355
@sydneystriker5355 4 жыл бұрын
How is the difference between those boxes is dy *d. It was a bad decision to watch your video you just ended up confusing me
@BobLaramee
@BobLaramee Жыл бұрын
I agree it's not perfect
@carlossoto7083
@carlossoto7083 Жыл бұрын
save yourself some time; the real video starts around 2 minutes in
@angelorf
@angelorf 5 жыл бұрын
"Computing is the best subject." haha
@MaxLevill
@MaxLevill 6 жыл бұрын
Pésimo el fondooo jaja distrae mucho
@UgurA0
@UgurA0 3 жыл бұрын
Great explanation, thanks.
@BobLaramee
@BobLaramee 3 жыл бұрын
Thanks for watching.
Introduction to the Wasserstein distance
17:28
Applied Algebraic Topology Network
Рет қаралды 30 М.
КОГДА К БАТЕ ПРИШЕЛ ДРУГ😂#shorts
00:59
BATEK_OFFICIAL
Рет қаралды 7 МЛН
Каха и лужа  #непосредственнокаха
00:15
The Singing Challenge #joker #Harriet Quinn
00:35
佐助与鸣人
Рет қаралды 13 МЛН
Soheil Kolouri - Wasserstein Embeddings in the Deep Learning Era
56:09
One world theoretical machine learning
Рет қаралды 6 М.
Frechet Inception Distance and Inception Score - AI Bits and Pieces
19:28
Estimating the Wasserstein Metric - Jonathan Niles-Weed
15:20
Institute for Advanced Study
Рет қаралды 19 М.
Flat Earth "Science" -- Wrong, but not Stupid
15:50
Sabine Hossenfelder
Рет қаралды 1,9 МЛН
Shape Analysis (Lecture 19): Optimal transport
1:24:41
Justin Solomon
Рет қаралды 13 М.
Marco Cuturi - A Primer on Optimal Transport Part 1
42:48
MLSS Africa
Рет қаралды 19 М.
КОГДА К БАТЕ ПРИШЕЛ ДРУГ😂#shorts
00:59
BATEK_OFFICIAL
Рет қаралды 7 МЛН