This AI Senses Humans Through Walls 👀

Pick up cool perks on our Patreon page:
› / twominutepapers
Crypto and PayPal links are available below. Thank you very much for your generous support!
› PayPal: www.paypal.me/TwoMinutePapers
› Bitcoin: 13hhmJnLEzwXgmgJN7RB6bWVdT7WkrFAHh
› Ethereum: 0x002BB163DfE89B7aD0712846F1a1E53ba6136b5A
› LTC: LM8AUh5bGcNgzq6HaV1jeaJrFvmKxxgiXg
The paper "Through-Wall Human Pose Estimation Using Radio Signals " is available here:
rfpose.csail.mit.edu/
We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
313V, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Brian Gilman, Christian Ahlin, Christoph Jadanowski, Dennis Abts, Emmanuel, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, John De Witt, Kjartan Olason, Lorin Atzberger, Marten Rauschenberg, Michael Albrecht, Michael Jensen, Milan Lajtoš, Morten Punnerud Engelstad, Nader Shakerin, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Thomas Krcmar, Torsten Reil, Zach Boldyga.
/ twominutepapers
Thumbnail background image credit: pixabay.com/en/texture-wall-g...
Splash screen/thumbnail design: Felícia Fehér - felicia.hu
Károly Zsolnai-Fehér's links:
Facebook: / twominutepapers
Twitter: / karoly_zsolnai
Web: cg.tuwien.ac.at/~zsolnai/

[@admiralevan]

So the inevitable hunter killer AI robots will be able to find us anywhere.

[@MrFastfinan]

nah, people is very creative an will find solution to avoid that in short time

[@jabroski9096]

@@MrFastfinan like water

[@jonnynik7626]

The inevitable hunter killer AI robots already exist in the form of autonomous, warhead-carrying drones. And they sure don't care about you being in front of or behind the wall, because the can just vaporize the whole house.

[@lightning_4480]

The exact same idea came to my mind. When 5G is everywhere, there will be no hideout for humans 😀

[@221petros]

@@jabroski9096 Or you can pollute the information by emitting your own RF-signals with just your cell phone.

[@traderofgoods6500]

0:53 "Why yes, my legs are connected to my neck. Why do you ask?"

[@Nothingtoseeheremovealong666]

do those legs go all the way up....Why yes they do

[@sugarbooty]

@@Nothingtoseeheremovealong666 Ahhhhhh

[@quazar-omega]

Mike Wazowski, is that you?

[@7XHARDER]

Best thread 2020

[@Retalak]

Definitely can't see any possible way this could be abused.

[@squeakersthegryphon5338]

China: Give me a second

[@GottZ]

military will definitely skip this

[@vicentevasquezb]

Skynet *doesn’t* want this paper

[@fukgoogol4517]

Most uploads on here are research connected to Google or Facebook labs. Who wouldn't trust them?

[@boyfinn6751]

@@vicentevasquezb lol. The scene where the T800 tracks and shoots a cop through the wall in the original movie comes to mind...

[@helifalic]

The machine burst through the wall, tracking its target with its wifi sonar. As it crushed the man's throat, it extrapolated his last thought by analyzing micro-details in his expression: "What a time to be alive".

[@NoSubsWithContent]

WW2 veterans: "Ah sh*t here we go again"

[@madhououinkyoma]

lol nice one. took me a second

[@IceMetalPunk]

It would be radar, not sonar.

[@kaushalsuvarna5156]

"We know that WiFi signals go through walls" Meanwhile my phone sobs inconsolably in the bedroom

[@Sammm30]

No one: American: This can be reformed to a weapon.

[@Dev-nt9vt]

I get the joke, but the thing is that there has to be wifi in the vicinity and that the AI must have access to it. Without this, it doesn't work.

[@MineshaftSparky]

I thought this was a European company?

[@senhalil]

@@Dev-nt9vt Phones needed cables, computers were room-sized with trays, and there were only few of them at selected universities, companies and military (!) Now think again after watching this robot (kzbin.info/www/bejne/laSlc5SEjsqraac ) Improvement in physics (transistors) turned vacuum tubed computers (1940s) into transistor (1950s) ones which eventually get small enough (2000s) to fit a palm sized device -- before than there were electromechanical analog computers developed by US Navy in late 30s -- even before than a "computer" made out of cranks and handles was used calculate since 1870s till 1950s. With another similar leaps, there is no reason for this kind of algorithms cannot be calculated by the onboard computer of that robot.

[@hhakyt]

Actually I was thinking about that, what would happen if we somehow sport this tech into a sniper scope?My god the finest scope in the world.

[@AK-xe2ly]

d19mc the AI does not need access to it. It is just reading the strength of the waves, and doesn't need to be logged into the wifi to get that information. Anybody with this tech can see through your walls at your house and know where you are and what pose you are in.

[@motosbkbr]

I can think of several military applications.

[@Laezar1]

We must hire pro fps player into the military to counter that. They know how to handle wallhacks already.

[@zoli11]

As I understand it, the network needs to be specifically trained for that position and environment.

[@oscarchampion5842]

zoli11 for now

[@dawnpaoloabes8441]

What if, techs like these were used by the them quite a time ago and are only publicly available if they get another tech that are two steps ahead?

[@willinton06]

Dawn Paolo Abes well in this specific case we can only achieve this because of the computational power now available and the advancements on artificial intelligence development, so it is highly unlikely that they had this specific tech

[@aayushpoudel1836]

Black mirror, here we come

[@robinmathew9029]

Is black mirror a good show ?

[@LamaPoop]

The most episodes are amazing! Go watch it now! :)

[@andyp123456]

I honestly wouldn't be surprised if the writers used this channel for inspiration :)

[@AnonymousUser77254]

Aayush Poudel I study computer science but... Computers were a mistake.

[@aayushpoudel1836]

Sybrand Botes I study computer science too and they are the best mistakes ever

[@commenturthegreat2915]

Real-life xray aimbots here we come

[@hanseldsilva2393]

See through walls =\= shoot through walls

[@blasecorrea8350]

First thing I thought of was the enemy radar attachment from MW2

[@asnek2527]

@@hanseldsilva2393 then they'll make better guns and bullets to do so

[@hanseldsilva2393]

@@asnek2527 wall-penetrating bullets? That'd be cool and devastating at the same time

[@asnek2527]

@@hanseldsilva2393 as is this, but we haven't seen what this can cause unlike the literal meaning of guns This do be cool doe

[@alejandroladreyt522]

"What kind of researchery is that!" 10/10

[@lgab]

He said wizardry...

[@alejandroladreyt522]

Oh my Hearing Neural Network did a bad prediction, ty for your input! I'll now retrain!

[@Mateogon1]

your version is better

[@Caue113_]

Time to T-pose walk to troll AI

[@mugfuglel7793]

UNDERRATED

[@NeoShameMan]

Surveillance tech skills perk +10

[@vijayabhaskar-j]

Combining this Skeleton output with the Everybody can dance technique, you can recreate the entire scene without even a camera? Mind=Blown.

[@gobzanuff5078]

*AI detect humans stacking on top each other* = human are exchanging data.

[@faustin289]

Man, this is so funny! The data is fluid....so advanced

[@averageisekaifan]

Me: oh look there's wifi in this totally remote desert *ai drone lurking in the distance*

[@gotzee6584]

*N A N I*

[@sab611]

What a time for "surveillance", more like.

[@QuincyIsCrispy]

Can't wait for the Government to spy on stickfigure me!

[@Fyloeu]

It almost bothers me to just hear a bright side presented.

[@Apodeipnon]

I'm imagining robocop taking out perps through walls with his wifi vision now

[@Tinfoilpain]

I dropped all my papers

[@gajahahah0872]

Oh

[@dkpsyhog]

Everyone’s saying “oh no this could be used for so many evil things” and you’re right but have you considered the VR applications

[@jabroski9096]

Imagine just messing around with that at your house alone and it picks up someone in the other room

[@midnattsol6207]

I guess privacy was a thing of our childhood

[@kerron68]

"what a time to be alive" - it's the only time my friend

[@Kram1032]

That's quite amazing. I'm not sure if it's ever going to be *computationally* feasible, but *in principle* it ought to one day be possible to just, like, "read" the entire planet (at some useful resolution) at once, just from various subtle signals like these radio waves or the aperture edge effects you showed recently. And mind you, this here is a single signal source. Why not "just" combine signals? It seems that incorporating multiple signals tends to boost performance. Shorter-term, I'm sure this will be immensely useful for, say, autonomous driving. Presumably a simpler version of this is already happening in some autonomous systems that can use radio waves to detect cars before the car before you. Oh and I guess there are like a billion nefarious applications as well. But, you know, which of these recent AI techniques *doesn't* have those?

[@polxhaferi6671]

Yeah man. I have seen some whistleblowers that are put into "conspiracy theory" category that talked about such things being already avaiable. And quite recently I heard some high ranking military people talking about a supercomputer called "The Beast" that collects data through our tech equipment and social media to build an virtual avatar.

[@maksuree]

Put 2 and 2 together on that last sentence man. Where research money goes, the military follows. There are almost certainly plenty of harmless ai improvements we could make, but those don't oil up the gears of war.

[@hanseldsilva2393]

@@maksuree war: the unexpected catalyst of scientific advancement

[@xPorkchops007x]

Imagine the NSA having an application like in The Dark Knight

[@Teddylandclub]

@@polxhaferi6671 Sources or any docs for reference? Couldn't find anything about "The Beast".

[@ToriKo_]

Uh oh

[@1000_Gibibit]

Didn't warn me to hold on to my papers, now I dropped them in amazement

[@phlimy]

That's insane.

[@ZardoDhieldor]

Welcome to the world of AI.

[@phlimy]

I follow the progress of AI pretty closely, and yet with every new paper I'm still blown away. It's an amazing time we live in

[@ZardoDhieldor]

@@phlimy That's exactly how I feel as well. It's just incredible.

[@TheGamerzXChannel]

@@phlimy Well, its just a paper, describing the abstract usage how one would achieve it, though I doubt you would be able to recreate it on your own after reading their paper. Those study cases are many times wrote from people to people with same wavelengths. So this technology will be recognised by the government for the government... What an amazing time to be alive indeed...

[@SnootchieBootchies27]

They haven't taken over yet and we're teaching them how to find us in a dark room and through walls. Not terrifying at all...

[@acr_-kj8gd]

imagine inventing a wallhack irl

[@ohjein]

When Batman used cell phone signals to map the 3d space I called bullshit. This was 10 years ago...

[@beaconofwierd1883]

”Master Bruce, I’m picking up several signatures on the BatFiNet.”

[@CatGuy969]

Press X to enter Detective Mode

[@dakotateears3749]

This is just like Batman's Detective Mode!

[@paultremblay4836]

That's not good. When you think you can hide behind the wall, they got you

[@ZardoDhieldor]

Wifi signals can't reach you in a bunker. Also, they still can't scan the whole world if they don't know where you are approximately.

[@Kram1032]

Baby steps, Lepus

[@Kram1032]

I'm honestly not very worried about robots. Vastly more worrying is *other humans*

[@paultremblay4836]

@@Kram1032 Sure it's a human behind the trigger of a gun, also it will be a human that will unleache a swarm of Robot insect to your direction, or Robot Dogs armed with heat detection with explosive bullet, relentlessly pursuing you everywhere you hide . Yes humans are more dangerous but, in the end, it's the robot that will no all the dirty jobs humans don't want to do. Good luck

[@Kram1032]

If it actually is "just" the dirty jobs no human wants to do, then good riddance? What point is a job if it costs more in live quality than the income it provides gives back?

[@impc8265]

imagine hiding behind cover and get shot directly by robots

[@gamingwithflash7902]

Your videos are awesome(:

[@andeoo]

Imagine seeing another skeleton when you think youre the only ones in the building

[@SPYFFzero]

The authors brought their demo setup to Budapest for the ACM SIGCOMM a few months ago, it was cool, I tried out (indeed works :-) )

[@georgiostsirtsidis1125]

cool!

[@benjaminmiller3620]

Do you happen to know how much training it needs on a new environment?

[@PatrickNgobiro]

Our privacy even behind walls is gone with the wind(AI)

[@harry356]

How quickly could it adapt to a new environment?

[@SPYFFzero]

Almost immediately, but they did not modified the walls too much (they built some walls from empty boxes)

[@josejoaquindelgadopizarro4436]

Holy shit, this is the first thing that one would hope machines not to have in a robotic apocalypse scenario

[@bbqgiraffe3766]

when a terminator shoots a single bullet into a wall and kills me instantly I'll have the people that made wifi to blame

[@ApPillon]

Next, you train an AI to snipe heads from miles away and bada-bing-bada-boom, the first terminator

[@ThingEngineer]

Truly groundbreaking!

[@evanadhipramana6473]

wifi signal vision is the new fictional xray view in movies and stuff

[@-Burb]

That’s not fair, now robots have wall hacks too!

[@OwenSkarpness]

Does this technique utilize existing WiFi networks? What (if any) additional hardware is necessary?

[@SPYFFzero]

Yes, special radio equipment required for the best result but the approach could works with existing Wi-Fi hardware (just more noisy)

[@OwenSkarpness]

From the paper it looks like they used a custom multi-plane array of antennas which analyse reflections those antenna outputs. I'm certain that something similar could be achieved with other hardware, but additional limitations also exist like the need for training from a static position. If this technology could be made portable, it's no stretch to think of how powerful it could be in combat situations.

[@AndroidFerret]

Absolutely amazing but also frightening... Now the through wall seeing camera is absolutely reality

[@OttoFazzl]

This is mind blowing!

[@Donaldo]

"Welcome to a world without rules."

[@eerereps]

This was Icredible! ... ended up in an Asylum 🤣🤣🤣

[@rogerab1792]

goodbye privacy, awesome paper!

[@malmsey1541]

Been fighting wall hackers in Counter strike, now I got to fight them in real life.

[@KirillKovalevskiy]

This method required array of antennae which is not mention in this video and only briefly mentioned in the paper.

[@marverickbin]

We have to train it for each room? And the WiFi source have to be still, right? The reflexions would be totally different even with a chair in a different position or a open door, right? So, for instance, in autonomous car, it would have to train on the fly with images it takes, so still needs the classified images...

[@kickmonlee3390]

This could be super useful for say an app that monitorsand categorizes what you do in your day. While your at home rather than just looking at your GPS location and saying your at home, it could actually know so much of your activities this is awesome!

[@buurton1]

Love how hes kinda dancing behind the wall

[@namehidden8854]

. . . so, you could already do this with thermals. The thing this adds is that you could potentially do it with anything that has a Wi-Fi transceiver. As though Big Tech couldn't get enough information about you in your home already. Alexa may some day be able to record not just your conversations and searches, but also where you were and what you were doing when you had them.

[@buzzmas8068]

This is starting to look like some technology you would use in a video game

[@tomhepz]

If you had many of these antenna arrays in many points of a building you could know where everyone is in a building AND what they're doing without needing any cameras, just using the wifi network that's already installed...

[@Yottskry]

So it only works in the position and enviroment where it was taught, once moved it will change reflection patterns and it will stop working, right?

[@maximalia44]

>> _AI starts detecting presence in an empty room_ >>

[@SpiritedSpy]

oh fuck me, we are totally gonna have x ray implants in the future

[@spiralhalo]

Finally we've attained clairvoyance

[@ashleysheaff421]

Well, this really is cool!

[@DSX1]

Since when did the US Government get those ESP hacks?

[@Marween]

Wall hacks IRL!

[@kintler11]

Robots really be wall hacking.

[@mgetommy]

awesome!!!!

[@vanfigs]

Is there any kind of repo or for the code? Super cool tech!! I'd love to contribute

[@stepwiseurchin5355]

this wil be so good for clearing rooms in the military.

[@nraosec]

Amazing.

[@companyresearch2548]

That's really cool....

[@immortalsofar7977]

This is like a map hack for real life... damn

[@Sushiicide]

So we have wallhack now. irl.

[@lexciobotariu]

Imagine this being used as a security system.

[@createx1751]

I mean, it will be used as a security system

[@Bibibosh]

Please do another video about this topic mr scholar man.

[@Kale-4237]

1:20 this would be great for military personnel who are clearing buildings. you can see targets or hostages through walls if this was integrated into night vision goggles or some sort of augmented reality thingy.

[@KalijahAnderson]

It's not like we aren't being listened to constantly by our phones. Now our wi-fi can watch us anywhere in the house too?

[@LaserDroid]

This is equal parts amazing and terrifying.

[@markosz22]

That's one hell of a wall hack!

[@diggleda2952]

“You can run but you can’t hide”

[@ZEGTHEFISH]

A cool application for this could be pose tracking for vr

[@RileyCourter]

WHAT A TIME TO BE ALIVE

[@leowflow]

VAC Banned from life for wallhacks

[@suri4Musiq]

TSCL is the latest algorithm in deep learning and such applications make way for some great frontiers to open... Btw amazing channel, I owe you a lot :) please do more computer graphics papers :)

[@paulodomingues4179]

Yeah, what a time to be alive! Sometimes I'm even scared.

[@theblacktiger59]

That's awesome, so many implications.

[@obligatoryusername7239]

Theblacktiger, you do realize that one of the implications of this is you being monitored in your own shower, right?

[@skyzip4k171]

AI.... Has turned into a difficult situation

[@Kevin-jc1fx]

Seeing through walls, just one of the billion skills of any superintelligent AI agent. Scaringly exciting.

[@Kuj]

Incredible tech, wow

[@Cardinalbins]

The dark knight handy transmitting Computer becomes reality

[@mackrugeri8257]

Working on it in my final year project of Bs Computer Science 50% done

[@ArKeTiCt]

This will eliminate the last bit of privacy we had before... if we had any.

[@hanseldsilva2393]

Can you provide demonstrative fictional examples of that? This only detects body movement and pose

[@ArKeTiCt]

@@hanseldsilva2393 if we can be seen thru walls as sticks these days... i think in the future we will have a 4k video image of what we are doing.. tv started black and white look where its at now and you can see where im coming from.

[@hanseldsilva2393]

@@ArKeTiCt i highly doubt that as waves (they're spreading wifi waves not laser infrared rays)have a limit on how accurately they pinpoint to a particular location but with infrared what ur saying may be feasible. thx 4 ur time and insight

[@midnattsol6207]

@@hanseldsilva2393 how can you not see this? Anyone could sit outside your house with these things and could 'watch' you. There is no more privacy, you cannot be sure of not being in public anymore. This is the end of privacy in your own house.

[@obligatoryusername7239]

@@midnattsol6207 Yeah, privacy is gone, but hey, we have better VR! :) There are countless people in the video with that sentiment. Look up Deepfake videos, and countless comments are just about how funny it is to see Trump's face on Saul Goodman's body. No one seems to care about how democracy is going to be effectively dead if we don't acknowledge the dangers of this and other programs and AI. If we truly don't give a damn, we deserve to be slaves.

[@TheCobyRandal]

That is some super cool teacher / student machine learning! I love this concept, especially how good that motion tracking looks from video footage. If that could be optimized for hand held use and VR / AR, it would be wonderful for input. People really want to create animation, it's just not so easy to do and not as accessible at the moment. But that is changing fast! Also, keep that wifi and cell phone radiation on the minimal when it comes to your vital organs 🤣! Don''t wanna be slowly cooked alive by EMF (electromagnetic frequencies). I turn my phone on airplane mode when I sleep and try not to keep it in my pockets when it's on. The farther away from your organs, the better. The less EMFs beaming through your body, the better. Consider the noise filtering that machine learning has to do to make proper decisions. How much noise do our cells pick up from our contaminated and harsh environments? But that will change as we figure out better solutions. Perhaps machine learning will be part of some of those solutions to greener, healthier tech.

[@Zoza15]

I really like your Asylum jokes..

[@TiagoTiagoT]

What are the antennas they use here like? It's not just a single normal WiFi antenna, right? How big is it?

[@malicoussteve7924]

Everyone start making their EMP devices

[@User9681e]

Yeah fast as possible

[@jewelvang8242]

Ooh this would be cool to use for motion capture

[@McDonaldsCalifornia]

So theoretically that would work with a smartphone right? Sounds really useful for AR stuff that Apple is developing for example.

[@nthglsn]

What are the papers related to that?

[@ScopeSquad]

Make a laser track a person's head behind obstacles with this AI. I HAVE TO SEE.

[@fahdabdulrahman7932]

Imagine scanning all the wifi data from sattelite

[@firebrickfilmstv]

In b4 someone writes a router virus that can track you in your home using your Wi-Fi