How Snapchat's filters work

The engineering behind Snapchat's augmented-reality selfies.
///
Subscribe to our channel! goo.gl/0bsAjO
Vox.com is a news website that helps you cut through the noise and understand what's really driving the events in the headlines. Check out www.vox.com to get up to speed on everything from Kurdistan to the Kim Kardashian app.
Check out our full video catalog: goo.gl/IZONyE
Follow Vox on Twitter: goo.gl/XFrZ5H
Or on Facebook: goo.gl/U2g06o

[@annachancy7429]

I could listen to Joss all day. Her voice is so relaxing.

[@KewlDude123]

I could watch her all day too, shes a treat for the eyes ;D

[@nerfkid2.043]

She should make an audio book series!!

[@smzxvv771]

I agree.

[@nikkiitoyo]

can I see it hehehehe

[@JackieWelles]

and she is really pretty i must say!

[@abdullahmohammad6803]

*5%* comments related to Snapchat filters *95%* comments about how cute Joss is and how relaxing her voice is

[@anoukgijzen1116]

"'It´s actually illegal in a lot of places to wear facemasks" People in 2020 watching this: good times

[@omorxfe]

rip

[@jeremyharrison4778]

For real. That really threw me for a loop when I heard it then remembered to check when the video was made.

[@huynhtranhung]

Joss Fong related videos always amaze me, good job to Vox.

[@arcum]

Needs more Joss ( ͡° ͜ʖ ͡°)

[@ifonlyeah]

seems like everybody want to vox the fong outta the joss

[@huynhtranhung]

Dingleberry ew

[@_derp-ish_6673]

+Dingleberry ikr ( ͡° ͜ʖ ͡°)

[@forrestadventures5038]

Hi, we have the same name. Nice to meet you.

[@CoinOpTV]

not a big snap chat person but this video was pretty interesting!

[@clintross7778]

Waddup coinop!

[@adityakhanna113]

Because there was nothing relating to snapchat here. Just Computer Vision

[@TCHNOGAMRGaming]

+Aditya Khanna Technically, it did. After all, one of the first things they said was "We are going to explain how the Snapchat filters work" then the talked about computer vision... so ya..

[@mv-hg5eh]

CoinOpTV l

[@filterforsnapchat1252]

yeah..im a great with u like this app play.google.com/store/apps/details?id=com.snapchat.filters.lenses.stickers.forSnapchat&hl=en

[@TeamTwiistz]

This girl is so cute🙈

[@andyvo6769]

Agreed 😂😂👌👌

[@andyvo6769]

OMG TWIISTZ!!!

[@wildjoker2928]

Surprised to see you here

[@toranggurning1346]

Twiiitz? 😂 WTH are you doin here though you was watching minecraft video not this kind

[@rayhansidimedia]

ikr

[@RealationGames]

This was surprisingly in-depth. I almost ignored this because I though it was going to be "The camera scans your face and applies decorations" kinda non-explanation. Well done Joss.

[@MrDogjoeychavez]

So complex and complicated. Gosh! Engineering dudes, I salute you guys.

[@oliverage24]

Oh great, so it isn't magic? Spoilers everywhere.

[@ramdino1249]

Bloody hell! It's Oliver!

[@bellamybug]

Dang, it's you!

[@itmmc1261]

Hey

[@ThatGuyWithSomeSubs]

lol

[@neverangel]

Vox, the production value of your video are amazing. keep it up

[@tiro0oO5]

As someone working in that area I have to say: You did an incredible good job in explaining the topic while staying scientific accurate and pointing out and visualizing the key parts of such type of technologies. Great job :))

[@Worldwidegam3r]

Where is it illegal to where a facemask?

[@Vox]

en.wikipedia.org/wiki/Anti-mask_laws

[@Worldwidegam3r]

Vox I was just wondering if there was more detail for the US as that article isnt as specific. Thanks for the reply tho :D

[@Dede040TT]

+Vox So Vox actually uses Wikipedia. Thought professionals didn't do that.

[@UltraTM]

+Monarch Wikipedia is your friend. Most the time anyway.

[@davishall]

+Monarch Linking someone an article as a list is not to be frowned upon.

[@mfwhom5214]

Do another video on hip hop.

[@johnnyappleseed4279]

The one where they deconstructed rap lines was my favorite video from them.

[@Candyrock15]

+Johnny Appleseed which one was that?

[@borz7187]

+Johnny Appleseed Hello my son

[@johnnyappleseed4279]

+Nemojerhi it's called rappers deconstructed. I'm a saxophone player so I love learning new things about how music is made up.

[@johnnyappleseed4279]

+John AppleSeed mom wants to know where her child support is.

[@2024vasco]

I love these Vox videos. Very entertaining, well made and interesting topics. keep the good work!

[@Olodus]

Woop woop! AR is so freaking cool. As a IT-engineer student it is so cool to hear this discussed among the public so commonly. It is amazing that we live in an age where huge advances in so many different and important IT fields are being made. AR, Machine learning, Big data, cloud.. mobiles even. And that it is being made available to the public so easily. It really feels like we are on the runway for a new era. I choose to be optimistic about what that era might contain :)

[@hesleygonzalez1911]

Vox 2016: "It's actually illegal to wear a face mask out in public" Covid-19 2020: "We reserve the right to refuse service to you if you're not wearing a face mask" Ahhhh the good old pre corona days.... But seriously, everyone wear a mask in public... Let's all try to end this thing.

[@MakeSomething]

This is such an amazing channel! Love this vid! Time to get off the computer and go Snapchat!

[@Imansportfolio]

I’m so ugly that Snapchat couldn’t recognize my face

[@dyutilov]

This was so cool. Great content and presentation as always from VOX.

[@Kabloosh]

All these technology related videos have really amazed me, fantastic job Vox! :D

[@Bubbles88]

she is so dreamy

[@asad0810]

I must say that Vox spectacles was pretty smart and I loved it.

[@TiagoNugentComposer]

Wow. I just found this channel a week ago. You guys are amazing. You just earned a sub!

[@motashamoore7374]

Someone got my password and started extorting my friends for money till I got referred to use Hackereboo on instagram and thanks God they were able to change the password and help me re-gain access back to my Snapchat account again

[@spencerhodkinson5304]

Joss Fong always makes the best Vox videos, I learn more from one video than I do in a week at school

[@MrAnonymousme10]

"Its illigal to wear facemask in public" Me: welcome to 2020s

[@FirstNameLastName_255]

i love your Joss, i mean videos, keep these Joss coming! dang it...

[@kukumartha5303]

Next: supermarkets will buy your face data from fb and sell you products in real time when you enter the store.

[@lazyboy1060]

Supermarkets will scan your face at the self service, see what you like on Facebook ETC, then put up advertisements just for you.

[@Vox]

yes, this is coming!! facial recognition is already in some retail stores as a security measure www.theguardian.com/cities/2016/mar/03/revealed-facial-recognition-software-infiltrating-cities-saks-toronto

[@phantomr277]

When your joke becomes a reality

[@theflaggeddragon9472]

lol that's literally a project my dad is working on >_< except it just uses the video cameras in the store

[@SayWhat2363]

Thank you for the exquisite idea, Dragon. I'll hire my team to make a similar project. Once we're done we'll sell it to top name competitors, you can buy the patent if you wish. Thanks a *million*, buddy. Literally.

[@RidingWithDave]

Now i'm no science rocket, but this is how rocket science works doesn't it?

[@xxlibarat0rxx280]

Not funny, didn't laugh

[@JatPhenshllem]

@@xxlibarat0rxx280 Not sure it was meant to be funny

[@fireballneverlose]

I really hate the comments all over KZbin saying "this girl/guy is so cute/hot". It's getting annoying.

[@garrusn7702]

I'm sure it tickles the people who these comments are made about that so many people think they are beautiful and personable. As long as the comments aren't overly personal or crude, I'm sure it makes most of these people smile when they check the comments on their videos and are told by a few dozen strangers that they are personable and beautiful. I think it's nice.

[@chriswinter5765]

I know right! Don't they know it's politically incorrect to compliment how someone looks?

[@adityakhanna113]

+David A. But often they disregard all the work done by them in the video.

[@chriswinter5765]

Aditya Khanna Maybe let the video authors complain, rather than crusading on their behalf on an assumption?

[@bucky13]

It is an upgrade over the usual KZbin comments though. The only thing that annoys me is that she's a woman, not a girl.. Big difference.

[@johntakoor1814]

i always smile whenever i see joss

[@danielkim4051]

thank you for mentioning the security aspects of face recognition!! It is a pretty big deal and people need to be aware of exactly what they are providing companies like snapchat and Facebook

[@teruphoto]

I've been catching up on old videos after recently subscribing to this channel and Joss is definitely at the top of my list for narrators. She doesn't make each sentence sound like a question, a habit that is too prevalent on KZbin.

[@junaidbaig2288]

you manged to make a mind boggling topic so easy to understand and replicate

[@shan_singh]

I am beginner in programming !!! Imagining about the code for image processing and the algorithm is fascinating and inspiring ! Algorithms are always fun to learn about !!

[@awesomness6775]

4:49 Well that line aged well Edit: Ok apparently a lot of people already mentioned that.

[@demolitionman8276]

last time I was this early, well... I am never this early..

[@socialelitist4256]

same

[@KLienne]

These KZbin comments, damn they get more original with time!

[@functionparameter]

+Joe Nome ok

[@KLienne]

Joe Nome It was sarcastic, I meant the overall KZbin comments turning unoriginal debate. >>Damn last time I responded so early to a comment I became a father.

[@KLienne]

Joe Nome I thought it was too formal to be a troll comment.

[@Endru_cz]

Last time I was this early, UK was still in the EU

[@xChimichungaCraft662]

just stop we've heard it a million times already

[@zeroarticulation]

+PixelMonkey yess. Everytime we see this joke. The English Pound goes down by one

[@jsepn]

Very original /s

[@Endru_cz]

ikr lol

[@ninja2566]

L

[@TheGoreyDetails]

super well illustrated and explaied concept. i don't have or use snapchat, but loved this video anyway.

[@KimposiGames]

The makeup filters always make me look weird bc the eyebrows don't go to my eyebrows and the lipstick goes either noticeably smaller or larger than my lips. Can't a girl just enjoy some snapchat filters?!?

[@LilLeanCuisine]

😂😂

[@maxsimes]

cabbitch no. now get back in the kitchen.

[@cybershrooms3316]

@@maxsimes what in the world-

[@buttersstotch2014]

The graphics department of this channel is ridiculous, the real heros here

[@Katherine-vu2mn]

you know whats impressive? that I actually took time to watch the whole video.............

[@MindyMcAdams]

This video is so well done. The storytelling, the pacing, how it illustrates the concepts. It's excellent! Still holds up more than 4 years later!

[@Dane411]

Thanks for the detailed info, really loved it, one of the best videos I've seen lately

[@hsyn95]

The speed of processing is incredible and i think that is the most delicate part,otherwise no one would have loved the effects this much, wish the video included more about processing time, thanks for the rest,great video .

[@andreaadams2068]

In some places it’s illegal to wear a mask in public, but now in 2020 we are required to wear them!

[@lw28]

Exactly what i was thinking

[@AprilsPunk]

The snapchat filters always astounded me. I love this video so much

[@VidClips858]

2016: "It´s actually illegal in a lot of places to wear a face mask in public." 2020: Bank won't let me in without one on.

[@jasongutierrez4159]

Love u, Joss 👷

[@baronvg]

Joss is so GD easy on the eyes AND easy on the ears!

[@khalidalnajjar1558]

You have a smile that can make a mans heart skip a beat.

[@noealva]

it's amazing how fast a phone can find your face and track it.

[@chek1n]

just wait till they figure out quantum mechanics

[@Bi0M3Tr1xx]

It doesn't work. If you give quantum mechanics some interest you'll find out it's impossible

[@kristianszabo3817]

Uh... Quantum computing already exists.. The theory behind it exists and it works in tests. Are you a master in CompSci? Or are you just a random youtuber trying to discredit a science that you don't understand?

[@kristianszabo3817]

You do realize to actually build a quantum computing machine, you need computer scientists, right? Physicists create the theory and math behind it, but a compsci is the one who will design, engineer, and build a quantum computer. Theories are great and all, but you can't exactly have quantum computing without a computational machine. That's the difference between theory and application of the theory. But you won't understand that until you're done with highschool, so you still have time, so don't worry.

[@chek1n]

Kristian Szabo Quantum computing is COMPLETELY different from CS. Quantum is a differently form and level of computing. Computer science has Steven Wang says, is the study of the algorithms and manipulating numbers to be more efficient at tasks. Quantum is completely dependent on Physics as it goes into a deeper level of particles which makes it more capable in less space. If it gets figured out, it will branch out into Quantum Computer Science.

[@rohansinha2817]

Anyone know which lock screen/app/mod she's using at 00:00?

[@Vox]

I use nova launcher with an icon pack called Circle White :) -joss

[@rohansinha2817]

+Vox Thanks!

[@BigOlSmellyFlashlight]

Ali Wajid overdoooooose on meeeeediciiiiine and diiiiiiiiiiie

[@bridge2753]

Vox Nova launcher corrupted half of my apps :/

[@mastersdegreeburn4601]

rohan sinha t

[@KastaRules]

Gorgeous, gorgeous woman.

[@Holagrimola]

Thank you so much, you're very kind :)

[@KastaRules]

@@Holagrimola Nah, must have been drunk at the time.

[@oxicontin]

The fact that it does all this so fast its amazing....

[@virgoguy29ify]

I hate the doggie filter with a passion -_-

[@TheFaro2011]

and me. not cute. i say this as a girl

[@jaxketches2542]

Same!

[@sharmintareque]

Fari yes, so?

[@Maino88]

Dear Joss You're amazing.

[@thereaper4463]

When you get an ad of Snapchat before this video:

[@motashamoore7374]

Someone got my password and started extorting my friends for money till I got referred to use Hackereboo on instagram and thanks God they were able to change the password and help me re-gain access back to my Snapchat account again

[@ericpa06]

That's the kind of video that makes me subscribing to vox

[@pardisranjbarnoiey6356]

Computer science student here. I’ll definitely take computer vision next semester

[@DaveyGuitar]

Joss, this article was EXCELLENT.

[@touko_nanami]

so much science for so much cancer

[@amc0208]

i know there will be haters, by why the hell are they like cancer? they just want people to know stuff.

[@petercahill6696]

Wah! Someone talked about an app I don't like so I'm going to call it cancer! My opinion matters!

[@amc0208]

lol sarcasm.

[@BaxzXD]

+Devin Goffard no he's talking about snapchat. It is such a cancerous app.

[@VerdantAssassin]

+DoomGhoul ikr

[@jjm7158]

I already love u .lol ur reaction when I saw u had braces omg I never laughed so hard.u can tell u have a awesome sence of humor.thanx.u

[@lazyboy1060]

SO easy to keep the Plebs entertained xD

[@motashamoore7374]

Someone got my password and started extorting my friends for money till I got referred to use Hackereboo on instagram and thanks God they were able to change the password and help me re-gain access back to my Snapchat account again

[@yakshashreyas]

GREAT Work People.. Great Efforts! KEEP Growing!🔥💯

[@jakescourage]

She's pretty

[@noahleach7690]

Simp harder

[@keelygrigelprojectmanager4513]

Excellent video. I've always been obsessed with camera data imaging. Running anything in real time from a mobile device is a leap forward. Snapchat's tech acquisition was both a bargain and privacy advocates' nightmare. Thanks for including both perspectives. I love engineering and augmented reality. Very inspiring.

[@cianmattern1896]

But they really work by TheLegend27 kicking your ass

[@Jinn99]

Excellent video, I love how thorough you guys were. Learned some new things!

[@tonkae]

im really dumb

[@jalouse369]

Yep

[@ginasylvester5653]

Dumb.

[@КыздарханАбдраимова-т3л]

🐇🐇🐰🐰🐰

[@okaypearl]

i'm*

[@tidebleach8641]

bb I'm*

[@rickolin]

I've been wondering this for a while now, thank you!! But now, how do brands create filter ads? Do they work with a team at snapchat to create the filter or is it done by an agency?

[@RiskyNights]

I love Joss. Her expose on Great White's was also super fascinating.

[@jarrettmaier8106]

I and so many people use this app everyday and probably never think about how this works. Thanks for enlightening us Joss you smart beauty!

[@ChunkyChipz]

I want to protect her smile.

[@d0tz_]

as someone who knows a few things about motion tracking in video production, it's pretty crazy how well and how fast snapchat's filter work.

[@Consoneer]

The girl is really pretty. Anyone know her name? For research purpose of course.

[@swanlee6077]

Ikr

[@MrRastaprince]

Joss Fong. you wont find much social media of hers tho

[@loshan1212]

Joss Fong - she's the editor for Vox, not an actress.

[@jon99867]

You can find her twitter @jossfong

[@artbytandy]

She looks like my friends mom, almost a clone.

[@joshuakwok5155]

Just love this part of youtube where you can actually learn something informative and related

[@JohnDoe-tp5jj]

I feel bad for the people who use snapchat.

[@IkeOkerekeNews]

Why?

[@gmarangoni295]

Why?

[@blanco2664]

+Otto Von Skidmark how lol

[@blanco2664]

+Otto Von Skidmark 😂 well if your insecure I can see how you'd hate sc

[@Aguycalledmax]

I think we found the ugly kid.

[@snoopy2511]

So close to 1 mil, congrats from 20k

[@dylanparry-lai1295]

Dude Joss has got to be the most interesting Vox narrator ever, plus she's the prettiest one too lmao

[@j_0anna]

now explain why Snapchat doesnt detect my face half the time in proper lighting

[@johnnycat995]

because you have pale skin

[@j_0anna]

Johnny Cat that actually makes sense

[@La-libellule]

I absolutely love the animation in your videos!!

[@aznfangrl612]

snapchat always gets my lips wrong though

[@VeggieBond]

ur lips around my...

[@RobinsM]

As someone in the tech industry i've always found it crazy that so much good tech goes towards such dumb things the users don't even fully appreciate. Just like those GE commercials to much talent is going towards mindless startups instead of the private tech devision that really makes a difference in this world..

[@PADARM]

Congrats Ukrainian!

[@petek6905]

your phenom is amazing

[@WalterWhiteFromTheBlock]

Joss is gorgeous ^__^

[@aidanmco]

I saw some people using snapchat and using those filters, and I was amazed at the technology! Imagine how much work it took to program that, and just so some kids can have a dog nose. Just imagine the practical applications!

[@dariy1999]

wow, proud to be Ukrainian😊

[@fakeemoboy3895]

+Álvaro Lopes Yup

[@Mongol1232]

yes. slava ukraine. my dad studied in odessa at a military academy for 4 years and he said it was the most beautiful country in the world.

[@kawaiiforlife2418]

I'm proud to be Mexican🇲🇽

[@rex3443]

Dariy Pozinenko Im proud to be a swede🇸🇪

[@TheDaryna]

I'm proud of those who invented the technology but it's so typical for our ppl to sell ideas half way. I mean snapchat clearly makes way more money

[@boreal3255]

"it's actually illegal to wear a face mask in public in some places"

[@shay3355]

Hell : watching jake paul videos... Next level hell : watching vox's crew faces with snapchat filter..

[@redoyjoarder6330]

I am on vox marathon. Thanks for making such intresting videos from where we learn something from it. Thanks for all the hard work. And Joss , you are very beautiful. :) Looking forward to vox's next upload.

[@rujakandroid]

shes pretty.

[@pauliusd6505]

love this video! especially love the clean video animation, keep it up Vox!

[@arwacloud2736]

Okay can we talk about the fact that she is so gorgeous!!!!!

[@RRSYSinfo]

Yeah this is awesome behind the scenes

[@bismarchiavelli]

Why you tryna hide behind all 'em filters? I see you ;)

[@bismarchiavelli]

Hands down my creepiest comment. I regret nothing.

[@kristianszabo3817]

It's less creepy than it is sad =/ Don't worry, things will get better

[@meh855]

Best comment ever

[@lodalehsun6294]

I searched for this video, it wasn't a suggestion. And i loved it ♥️

[@skiiimsk]

such a cringey intro

[@carterduncan5757]

Yes

[@chrisau31]

Such an interesting world we are heading into marketing wise! In this world of immediacy and file piracy, advertiser's have really got to change the game as a lot of us now can't even stand fast forwarding ads on a PVR let alone waiting out the 5 seconds to skip an ad on KZbin. It's like how Giphy is modelling itself by having brands in GIFs. It's better for us to interact with brand by choice and then share it with others willingly than having it shoved down our throats. It'll be fascinating to see what advertising will be like in 50 years or even 10 years time!

[@canadianpsycho1867]

Now it’s illegal to not wear a face mask