Rana el Kaliouby: This app knows how you feel - from the look on your face

Our emotions influence every aspect of our lives - how we learn, how we communicate, how we make decisions. Yet they’re absent from our digital lives; the devices and apps we interact with have no way of knowing how we feel. Scientist Rana el Kaliouby aims to change that. She demos a powerful new technology that reads your facial expressions and matches them to corresponding emotions. This “emotion engine” has big implications, she says, and could change not just how we interact with machines - but with each other.
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and much more.
Find closed captions and translated subtitles in many languages at www.ted.com/talks/rana_el_kali...
Follow TED news on Twitter: / tednews
Like TED on Facebook: / ted
Subscribe to our channel: / tedtalksdirector

[@OxzimO]

I met her back at TEDxCairo 2010 and told her that her work is very promising and took her card. Obviously, she didn't disappoint me :)

[@HigherPlanes]

This problem is worse than I had imagined. People are forgetting they can actually use their phone to make phone calls.

[@Kaitlynsfashion]

Technology is advancing which isn't always a bad thing

[@HigherPlanes]

KaitlynsFashion sure.

[@lxc647]

HigherPlanes Meh why call on the phone when you can skype

[@HigherPlanes]

David Chen Even better. Not sure if the speaker forgot these things or failed to mention them to make a point.

[@lxc647]

HigherPlanes I know right? It completely defeats the purpose of her original intentions. Maybe her app is better off for machine and human interactions. Like futuristic robots for example.

[@shukarity2220]

That's so awesome to be placing an ad at the exact time you're really happy

[@just.s.]

She makes a good point when she mentions this tech being used to notice when drivers are tired, BUT I really can't imagine that working well. Maybe I look tired often when I'm not.

[@Mountainman1971]

How exactly does this help us reconnect with each other? It seems to me that all it does is more data mining and connects us more to our devices. How does an app responding to our emotions help to connect with humans? I do not see how it is any more effective than skyping, where you can See for yourself the emotions. I see how this is beneficial to businesses/corps, and I do see the benefits for certain disabilities, but not to reconnect emotionally. Perhaps we just need to have new priorities, put down the devices and be real. This is a step toward transhumanism.

[@lloydgush]

***** bla, bla, bla. Bullshit. She's a well lived, successful and smart woman. She's doing this for the same reason why successful smart people do this kind of stuff. Money. Yes, this is nothing but corporate goals being fulfilled, and she's going to be able to give her kids college, houses and cars, like every parent wants to. On the bright side, it may be useful as a lie detector.

[@spamcam7981]

Whats here religion have to do with anything? This technology is amazing and will perhaps evolve into a lie detecting software or even help us make discoveries in psychology. The possibilities are endless.

[@solomonvandy8318]

+Ima Wake was thinking exactly the same thing.

[@dewvey1]

In the interview with Tim Ferris, she mentioned children on the autism spectrum using this technology to better connect with people. Applications in diagnosis of various mental health conditions as well.

[@gidi1899]

8:45 - The highlight for me - really amazing !!!! Real use case! Thanks for all your work!! I hope this app reaches people - just keep it about a 'tool for understanding facial expression' -don't make it about the other stuff.

[@qotyop]

Test your app on Jim Carrey. Then I'll be impressed.

[@petervschicken7398]

I would be more surprised if they could get emotion out of Keeanu Reeves lol.

[@MultiVred]

1984 here we come !

[@Skyfox94]

MultiVred Well we've been on this path for a long time. Remember Eddie Snowden?

[@markmaclean4130]

She states that our "devices" that we use today seperates us and she wants believes that by putting emotions on devices will bring us back together, how? If you can interact with an ipad and it gives you results or answers based on your emotions you will most likely spend more time talking to SIRI than real people. People that are shy will love this, but we want people to be more social. Her idea is good for small things but the bad outwieghs the good.

[@user-jt1cx4mb6z]

What for? If you want to share your emotions with your relatives just use a video call. I didn't understand the purpose of this emotional technology 🤷‍♀️

[@Dr.AmrWady]

Wow! What an informative presentation!

[@elenimarkudi5208]

Anyone else who has to watch this for English class?

[@elipothesarcosuchus8758]

Yeah lmao this sucks

[@imrannazir6931]

I can't believe this hadn't already been done. There are mature software libraries in Python for deep learning, image processing and of course google images for training material.

[@Kaitlynsfashion]

This is amazing

[@jumanaat]

I agree with most of comment I've read, it won't make us closed, but it's a smart and new idea: ) good job Dana and ur team

[@MadihaMansour]

Bravo, skill and entrepreneurship. It's up to us how to use this well.

[@angelpeace121]

This is great 👏👏

[@Dave_AI]

What if you're one of those unfortunate individuals afflicted with "Bitchy resting face?"

[@aducksecho]

Thanks for your question. We implemented algorithms that learn an individuals resting expression. Over time the program will correct itself if at first it misidentifies. This is possible because an individual can sustain certain expressions for a limited time before exhausting the facial muscles.

[@beanbuster1]

***** let me reiterate what I try and get the mentally enslaved morons like this halfwit, rana el kaliouby, to do. Try Skypeing your loved ones (free) and talk to them, often with tears and that jerkiness in your voice that tells them that you love them and miss them instead of promoting transhumanism like this pathetic overweight halfwit is doing whilst trying to fill her pockets in the process. I am horrified that psychopaths like this are allowed to wander free in the country I was born in!!!

[@KatoNamus]

***** You have some serious issues. This algorithm is just a tool. A damn amazing tool in my opinion, but still just a tool. For some, like yourself, it will not be "their cup of tea" and for others it will be the next best thing after sliced bread. There is no eugenics agenda there. In fact from everything I can see, quite the opposite; the example of people on the autism spectrum would obviously be able to better get along with others and thus be easier accepted by others. That's the only bit I'll be feeding you, so please stop trolling.

[@beanbuster1]

***** And as an aside, don't YOU DARE tell me anything about autism, and/or it's causes. Go to my blog, do the same studies I have done over the last four years. Go look to see what the finest medics such as Dr Russell Blaylock and Dr Rima E Laibow have brought to the table on the topic of autism....Go research chemtrails/geoengineering and look into heavy metal toxicity, for there you will find your true calling if you are what you profess you are....

[@Dave_AI]

***** Classic conspiritard. I'm sure your "blog" is full of cutting edge, peer reviewed science.

[@frytek2441]

It's incredibly sad that we need an app to include our emotions to messages

[@OssieRichards]

It was being on your laptop that helped you get in touch with the belief that you wanted to connect with real time people, based on your unconscious belief that this is preferable for you

[@thaliavergaracampos3279]

so touching for an excellent video

[@ShawnRavenfire]

This video couldn't have come at a more appropriate time for me. I'm in the middle of writing a comedy sketch about designing an android to mimic human emotions... with a clever twist ending.

[@magidz]

Very impressed

[@Dawars00]

This is perfect for the app I'm currently working on, thanks :)

[@MostafaZaher]

+Dawars AffdexMe on App Store and Google Play Store. You can always contact them @ Affectiva.com

[@yomnazahran6530]

amazing!!!

[@redbull5671]

Great TEd Talk!

[@JulianHibbert]

This is an amazing breakthrough. It makes content more relevant to our personas! WOW

[@TheNewYou2022]

I like the presentation

[@davidhenriques4829]

what if I cry with joy or laugh nervously of sadness? You cant tell what people really feel by just looking at their faces...

[@edwincito289]

Excelente!

[@danieladambedford828]

love her

[@TaroutCommodore]

Imagine this as a "Chick-pick-up-O-meter" integrated in google glass you can see how bored someone is and change the conversation, or if they are afraid so you tone yourself down and fix it. This is the future of communication : Augmented Emotions.

[@songxiong5674]

Beautiful and smart.

[@CDittyInc]

Now, not only can google use our browser history to provide ads, but emotions as well! Hooray for data mining. Sad? How about ice cream right to your door, just 5.99 with free shipping. And how could we have ever communicated emotion through technology without an app that analyzes emotion? Surely not through Skype.

[@dowddash]

Great now our computers will need therapists after dealing with women's emotions all day. =p

[@LogarAcc]

***** No, he's just a sexist idiot trying to act funny.

[@dowddash]

Msl LogYt I am totally serious, you just wait till computers start committing suicide after women break up with them and take half their RAM.

[@victorialang9310]

SICKKKK👏😄

[@viktorjamrich]

Great, now it is possible to even collect data about if you liked the commercial/ad. Monetization just moved to another level!

[@jenniferk9468]

My computer tells me that during most of the time I was watching this talk, my eyebrows were furrowed.

[@b__05]

"So I want the technology which has seperated us to bring us back together." Just Awesome

[@lloydgush]

"That wanted to share their emotions with us..." "Well, they bought a camera app, of course they want to share their expressions 24h/day. They allowed access to the camera."

[@d.b.levitt]

I do not think that we are entering a world with less emotion involved. In fact, I think that we are becoming much much more emotional as we develop and I do not think this would help at all. People have passed time for centuries. People read books, practiced music, watched grass grow. None of those concepts have needed to read you face.

[@OssieRichards]

It is beliefs that control every aspect of your life. Beliefs triggers the appropriate emotions.

[@user-fd3cl9to5e]

برافوا ممتاز

[@mohammadabdel-wanes3931]

بنت بلدي ❤️

[@jbetteridge23]

Listen to the sheeple laughing as their privacy is trample upon even more. Just think what Big Brother can do with this technology. Thought Crime 24 hours on demand.

[@theworldeatswithyou]

The interesting parts of the talk happen at the end.

[@physioweng]

Where can I download this app?

[@MostafaZaher]

+Kar Weng AffdexMe on App Store and Google Play Store

[@voidjest]

yo this is crazy, I've met this woman

[@TrenTonStackZ]

I wonder what plans the government has for my "facial emotions"

[@kaioxys]

Wait, so what’s the app? How do I download?

[@gidi1899]

Where is the talk about "intentions", you know, the middle part between 'emotion' and 'understanding'?! For example, teaching a hard drive to identify facial actions, and not teaching it how to show show back the emotion - to show understanding (which is an intent), or not teaching it ask the right question with respect to the seen emotion - well, will cause to much "misunderstanding". So you think intentions (not emotions) are also conveyed in our facial expressions?

[@MonkeyKong21]

is this software mostly being trained to recognize acted/phoney emotions? And is there any actual reason that electronics would need a redundant microchip to run this software or is that just rhetoric for people who don't have a degree in computing?

[@4relevants]

1.Creating emotional personal pattern based on material you watch/read could be used by AI for better suggestions. 2.Useful to detecting potential pedophiles not necessarily by police, but by AI for psycho treatment 3 Psycho-health in general ... I can see more advantages for peoples than disadvantages. Are Google is working on it yet?

[@lloydgush]

Christopher Macias I can see more disadvantages, but technology is only as good or as bad as the intended use. If it's not misused, then it would be great.

[@mikel.3470]

Christopher Macias you should watch the anime 'psycho pass'

[@4relevants]

AI psychological tests and treatment would apply to the law enforcement as well. :)

[@mhxxd4]

Open source?

[@LMIHK]

I understand our excitement. An important question, overlooked. What's the App name? ????????????????????!

[@MostafaZaher]

+Daniel Omiyi AffdexMe on App Store and Google Play Store

[@Reemaalhawas]

Smart arab women 🙏🏼🙏🏼❤️❤️❤️❤️

[@nookyzooky5713]

Just I want to know if rana elkalyoby is really an egyptian and how can I download that app

[@MostafaZaher]

+Nooky Zooky Yes she is. You can find "AffdexMe" on App Store and Google Play Store

[@sultankarakas2566]

@@MostafaZaher now it is Affectiva

[@shamanizing]

I dont see the practicality of this in the context of connecting with friends and family via social media, do we really want a machine to tell others how we feel?

[@Bocbo]

***** If a person has no empathy then yup. Of course most of people without empathy are sociopaths and narcissists so do we really want that?

[@shamanizing]

Bocbo I dont see how that has anything to do or related to my comment, but out of context with what i said, yes i agree with what you say

[@Bocbo]

Say someone with aspergers who has little empathy or even the ability to read expressions at all would like to connect with someone. For them the practicality would be that they could gain some kind of insight as to what another feels. The practicality for a person with less altruistic goals might be completely different. Was trying to speak to that.

[@shamanizing]

Bocbo I get you, Yes that would be very practical and helpful, good point!

[@Bocbo]

Great. That way if I'm having a bad day (spilled my coffee, kids were uncooperative in getting ready for school, whatever) I can look forward to a computer singling me out for an interrogation by the TSA. In a job interview it would likely serve to reinforce the status quo and make the truly creative unemployable. Institutions are rarely altruistic and more often than not seek to eliminate those who are, yes it certainly would be an invaluable tool in accomplishing that. The herd seems to feel safer with the shepherd and sheepdog watching over them but rarely notices when one of them becomes dinner. I prefer inherently unsafe freedom over a comfortable enslavement anyday. Let the cowards bask in an ever more watchful security state and homogeneity. This rush to a brave new world is sickening and a profound statement on how inhuman we have become.

[@hugotheboss4545]

I fucking love tech stuff... 1rst world things :( (greetings from Mexico)

[@Tomorrowandtomorrowandtomorrow]

you wanted to share your emotions with your family far away but all you had was an emoji? ever try WRITING A LETTER?

[@elipothesarcosuchus8758]

Lmfao exactly

[@bendandsnatch2683]

5 years down the line 😢

[@LoquaciousApe]

Impressive, if predictable technological achievement. One question she didn't answer: Will glaring at my laptop make my WiFi go faster?

[@spiralsystem4103]

This technology will primarily be used for advertisers to data mine our emotions in order to better sell us products.

[@yassinelkaliouby6369]

Rana is in my family I swear

[@markcusalberto9242]

any one know what the app is called? i gotz to know!!!

[@MostafaZaher]

+Markcus Alberto AffdexMe on App Store and Google Play Store

[@markcusalberto9242]

Mostafa Zaher its been awhile since i've ask this question and still have not found it till now. So thank you very much! ;D

[@tiwoni972mad]

How to download this??

[@xKodxKillerx]

exactly what I'm wondering

[@thefantasticpianoman]

The name of the company is affectiva. It's Downloadable for Mac and Windows. Can't find one for mobile though.

[@mikel.3470]

daka blood the same way you download ram.

[@tiwoni972mad]

Impossible?

[@MostafaZaher]

+daka blood AffdexMe on App Store and Google Play Store

[@JohnnyJenkins]

So I'm guessing this app isn't public yet??

[@MostafaZaher]

+Johnny Jenkins AffdexMe on App Store and Google Play Store

[@lotusdedart]

Name of app?

[@MostafaZaher]

+Sedrick Bernard AffdexMe on App Store and Google Play Store

[@JamesRycman]

#privacy

[@rafaabushaala527]

Interesting research. Struggle to understand her intention of this “reconnecting” humans together. Her personal example of her family abroad not knowing her emotions were due to her not sharing them. It does not seem to be because she did not understand them but rather her choosing not to share her thoughts. If her computer could pick that up, what benefit would that have in this situation? I understand this can be helpful in some situations as the world becomes more digitalised from a commercial and perhaps even medical point of view (AI conducting initial examinations for example and sensing pain/discomfort) but i do not see it having any positive impact on the social scene and connecting people. We need to work on humans becoming more Emotionally intelligent for that and not AI becoming so.

[@MarkMagill]

Fascinating...we are one step closer to AI.

[@user-le9en8yx3o]

1:10 4:30 5:07 6:46 8:18 10:21

[@ege_pekkoc]

What is this bro

[@user-dn1xk6sd8g]

4:29

[@user-uo2br5qw7f]

1:12

[@XxXpokemonmasterXxX1]

العبي يا المصرية :)

[@bookmark8899]

So much unnecessary technology phobia in the comments. :(

[@kinimi5]

What if we remove all this technology and live as humans again? What if?

[@orinpemulus1441]

*condescending smile*

[@apm77]

Those expressions she calls smirks do not look anything like smirks. That is not what smirk means.

[@Marmonery]

What about those who could mask emotions like actors? This has a potential to be a lie detector. Step one to robot domination complete.

[@chaitanyabalanagu626]

express to impress, dont use apps

[@idonthatex3]

A.I.s' are close

[@mehking4078]

First

[@TheMasonator777]

Just what the world needs... FFS.

[@calibnnoora3575]

Good idea but technology won't be able to detect all emotions of human. Humans are complicated than technologies.

[@lloydgush]

She's either really naive, like tesla, or evil like edson. And gosh, I hope it's the first...

[@yannvak998]

lloydgush Get lost, loser!

[@lloydgush]

Yanis Varoufakis lol... So buzzy trolling you have no idea why I said that. Go watch the video. She made something amazing, but something very dangerous. Specially in modern days, where cameras are eveywhere.

[@wonghoward6969]

And then we are fuked

[@adnanal6041]

What about bananas

[@-oooooo]

Like si estás por un trabajo del colegio

[@ZakKohler]

50 bucks says the first thing skynet does when it becomes self aware is read this chicks paper.

[@RainWalking]

The app reads expression not what you feel. your facial expression can be faked

[@sohaibahmed226]

Very weird and nosy type of invention.

[@TheMasonator777]

This woman sounds like she's on the verge of a breakdown at any point.

[@phamtoanmichaelle9410]

sus

[@samersbarakat]

Reality check, the car dealer: Would you like the emotions package with your car. Me: No thank you. Seems like an expert in nothing useful but cool technology. Probably better used in a correction facility? Left husband and broke a family for this? not sure. The moment I become intimate with my laptop and wish it reciprocates please shoot me :)

[@lilypowell1123]

I don't care and this is old stuff I am bored.

[@globalbankfraud]

Hasn't she heard of VoIP or Skype? Poor substitute for having mum at home.

[@DonaldFuller]

All of the different races in the presentation look white lol

[@AugustAdvice]

Sooner or later robots will know more about our emotions than we do, then what science? THEN WHAT?

[@Marmonery]

Then we will apply the three laws of robotics: 1) A robot may not injure a human being or, through inaction, allow a human being to come to harm. 2) A robot must obey orders given it by human beings except where such orders would conflict with the First Law. 3) A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

[@shaokahn983]

Marmonery what about dogs? suppose a dog takes a bite at a robot should the robot whack it off? and if a robot was ordered to smash down someone's car? that did not hurt no human though it fucked up property and hurt and kill animals and wreaked mayhem a la terminator style

[@Bocbo]

Marmonery Yeah cuz no-one has ever hacked technology for evil purposes. We're all gonna get integrity as soon as we get smart enough robots... Suuurrre.

[@Marmonery]

eddie scythe Well, harming a dog can harm inadvertently harm a human because of their emotional attachment to dogs. Emotional trauma is considered harm. As for a car, well, a robot will have to check every place for a human to hide. Then check the data base if the human who owns the car will give permission to destroy it cuz emotional trauma. Then they will consider destroying it. Bocbo Of course, worse case scenario. Nuke everything.

[@AWise3000]

This woman is fucking mad. Why would anyone want their fridge to know how they feel?