Introduction to the Deep Web

Description:
The Deep Web is comprised of all the web pages that Search Engines do not Index. There are numerous reasons why they may not be accessed, but generally the reasons are far less "cool" then people imagine.
For more Information on the Robots.txt file you can go here:
www.robotstxt.org/
For Classes, Class Notes and Blog Posts:
www.EliTheComputerGuy.com
Join the Conversation at Our Online Community:
ETCGNetwork.com
Visit the Vlog KZbin Channel at:
/ elicomputerguylive
Follow us on Facebook at:
/ elicomputerguy
Follow us on Twitter at:
/ elicomputerguy

[@amaypagrut]

stop arguing with eli , because he's the computer guy :) .

[@Alex-tw8nb]

exactly

[@MERION15]

How do they search engine robots come up with a domain name for that website when they index them? And how does the deepweb sites get their domain name? Do the creators choose which service they should be visible on, like Tor or Freenet?

[@garcemac]

Here's another reason why my boring sites are part of the "deep web". In August 2013, Google rolled out its best update yet. "Best" for media giants with unlimited amounts of cash. Google effectively ended the online careers of close to 80% of independent merchants. My business died on August 13, 2013 because of Google. It just vanished. Poof! Now I make more money (perfectly boring and legal) by NOT using Google (or Bing, etc.) and NOT playing their stupid games and following their arbitrary rules. No more stress from having to use Google;s "webmaster tools" and fucking Adwords or AdSense. People who use search engines for 100% of their information are pretty much being fed bullshit propoganda by whatever major media corporation happens to own the website you are visiting. You are basically watching a 24 hour a day commercial. Well, so am I, because I am on KZbin right now... Damn.

[@garcemac]

garcemac BTW - Nice information. Good to see someone not over-hyping the deep web to generate page views. Are there illegal and nefarious sites not listed by Google, et. al. Sure. Are there brick and mortar businesses in many neighbourhoods selling drugs, or doing other illegal activities (money laundering, tax evasion, littering...) You betcha. (Sorry - my question mark key appears to have stopped working).

[@TheTruthFadeswithTime28]

What does the deep web say about the Mandela effect

[@DarkSterix]

Just out of curiosity, is there copyrights on the information you acquire from the deep web? for example, a piece of text(exact words)

[@sayedkazimi6008]

Two videos in this folder( Hacking) have been removed/deleted . How can I get them to watch ? Thank you very much!

[@pauliusnarkevicius9959]

What is Your opinion about Interactive Vulnerability Scanners - Bots from Ethical perspective: does they must/should be blocked with simple robots.txt's, if they scan from other network or so?

[@miguel1waterpolo1guy]

is there a way to make your own spider that would reverse the file to make your own index database ?

[@ThatGuyJustFarted]

But doesn't Google link to your page anyhow? I constantly see "A description of this site is not available due to its robots.txt" It doesn't provide a description, but anyone may click on the link and find out..

[@codingclubeictcodingclubei9689]

how can i access your videos

[@Karlsmarten]

Why isnt it possible to enter the address of a deep wep page into a normal browser like IE/firefox?

[@TheHordeQ]

Can't take you seriously with that Mac in the background.

[@ivandrofly]

ahah

[@inter_1097]

I have found indexed links on google you normally have to long in for. comes right up if you click the cache.

[@abrhamgebremedhin5285]

Thanks men for doing all this videos i have a question what is the requirements for accessing the private videos

[@jazzfan5000]

Eli, isn't it also true that if I omit META data in the HTML coding for all pages on my website (whatever pages I'm building), that will keep any search engines from indexing my site as well? By the way, love your videos! I agree with you 100% about internet privacy. It's bunk!

[@colefisher4278]

every time he says eli the computer guy I think off bill nye the science guy XD

[@haleyh8799]

duuude lol

[@ivanbogush]

Could you make an introduction to Usenet video?

[@VladStashek]

so how to look for/access unindexed pages?! (like real hacker forums)

[@miguel1waterpolo1guy]

do you mean to say deep web site forums ?

[@elithecomputerguy]

Google ".onion sites" you're talking about Tor sites

[@vadimabrams]

man you are the best computer guy ever, im a computer science student and its a very interesting channel.

[@skandilanka]

great eli, nice presentation and explanation, feels like home when you speak ;)

[@christose9247]

I just learned that brazzers is deepweb, welp

[@nytram42]

Chris Tose I just learned the message board I've been hosting for the last twelve years is deep web. I had no idea. nytramsplace.activeboard.com/

[@Darinrussia]

what about the hidden wiki and tor directory

[@Tanatious15]

What about the mariana web? Does it exist?

[@DebanjanDas26]

What are onion websites?They are the webpages that do not open on normal sarch engines...Why????

[@bleedblackabsnz5158]

.onion sites can only be resolved via a certain application (Tor) = The Onion Router. you cannot access. onion sites from a clear Web browser.

[@za8cun]

facebook is not indexed? really? i googled my mom's name and her facebook link is the first thing i saw on google result so how do you explain that?

[@pingpong1138]

Some things are allowed and some are not

[@DebjyotiMandal92]

try searching Facebook "secret" groups in google search ;)

[@roroCastlesnowpatrol]

Also in my school you have to search for the website where teachers put up homework and stuff up in the bar at the top of the page so it won't come up if you search for it

[@8boyy]

I really want you to teach me in computers and coding im so so into computers

[@mr.webmasterc4585]

do an example of strings to go in the deepweb. like before tor

[@bohemianwriter1]

The "deep web" is like an intranet. Very few web pages in a corporate intranet can be accessed through google. You have to be logged in to access these web pages.

[@bOOMIE67]

You have been in german television three days ago with the first seconds of this introduction :D

[@jorbancaballero]

Club penguin is part of the deep web then LOL

[@HigherPlanes]

My thoughts exactly. The deep web goes a tad beyond sites that just aren't indexed. Good luck getting to sites that are on onion domains like the SR with a regular browser- you'll need to use proxy servers and the TOR network.

[@nightvisionmonocular]

can you do an in depth tutorial on how to put Kali Linux on a USB Drive and boot to a laptop with it? Also, are there advantages to this, what does it do with respect to the privacy on the machine, and am I better just reimaging my machine with Kali Linux? I am probably going to load Kali Linux on one of my machines, but would like to know the differences. Thank you for considering this topic.

[@abadialemadi]

Dear Eli the Computer Guy , Would you complete this track? We need more attacks demos and types of vulnerabilities. Many many thanks to your great efforts, I have now completed Linux & Hacking Tracks, others still there ;)

[@mooman966]

The cool part is using TOR to change your IP address, making you anonymous, and visiting the .onion sites such as Wiki Leaks, the Silk Road (new verison 2.0 after the old one was shut down), and various other hidden and forbidden sites

[@Platnium129]

How do you get on the "deep web" Do you have to download software?

[@Platnium129]

Thank you

[@OrangeOVL]

hendrix Fan No you don't (besides a browser, which you also need to access the indexed web). There are some parts of the deep web u need some plugins for your browser or simply a special browser. How Eli said: In most of the time you simply need to have a password. Many sites for which you used to access with the tor-client nowadays are reachable with the extension .tor2web instead of .org etc. The main problem with browsing in the deep web is, how the hell you should find the stuff you want, but that's a completely different question. But I think Eli missed the Point completely why people are interested in the deep web, besides all the shady things there, you need to know that the deep web, also can be created by censorship (china and google...) directly by censoring websites and indirectly because people want to share information and set up sites for this reason, but fear their government, for which they hide their site within the tor-network or things that, which allows webmasters and visitor to stay anonym. There you need the special software mainly for the way your identity is encrypted and not to see the page itself. PS: Sorry for my bad English, never learned it properly...

[@nikolaswithak]

I think most of the questions you were asked were really talking about the Dark web. They probably wanted to know about the Tor browser, or what the Dark web is used for.

[@RyanCamaratta]

tor and silk road video idea seconded. there's definitely a lot of confusion about those topics.

[@its42Seconds]

I'm just guessing but i'm pretty sure you can as long as you can route that data through the tor network. See the sites with .onion on the end, those URL's are not registered in the normally DNS serves, instead those URLs have to be resolved through the tor network. Not exactly sure how that works. I'm guessing you understand how the DNS (domain name system) works. If you don't i suggest you watch eli's videos on it

[@TopJoo7]

what about TOR

[@bynein-tb6er]

Love your videos, have nothing but love and respect for you brotha

[@guitarwhores753]

I think there is some confusion on deep web. He is referring to a page being deep web, not a site. He's saying parts/pages of something like Facebook or KZbin are deep web, but obviously not the site. I don't think he clarified that. I kinda disagree with that. I think there are better examples. Respectfully of course.

[@AznAlacran]

I've gotten my computer taken over once being on there (my own fault probably), and it crashed everything. Had to do a clean install of windows

[@intellectualhour]

Eli explain to us what the darknet/hidden wiki is.

[@EBlade-rc2ry]

I'm guessing it's like the Do Not Track setting on browsers. It's just a preference but you have no control over what a robot does... it's just a robot :D

[@jasonblissett1866]

wouldn't intranet be considered the deep web?

[@jesusoriginal8907]

well what if i want some torrents

[@shellphil5439]

You save my ass from F in national essay. Not my first time I get trained by you ELI! Keep up sir !

[@nightswim325]

what about everything else?

[@profsat5]

He may be telling the truth.A bunch of these really "cool computer people" were hired by various government and tech companies to discourage the common internet user from nosing around on the web.I know of a program that I used in mid 2005 that would take you completely off the "regular web" into a part of the internet that you rarely used a mouse,just the keyboard to navigate.Kind of like DOS but very different also.

[@nightshadow7585]

You're the man Eli. Glad to subscribe to your channel.

[@JayPhel96]

I think people are talking about .onion domains and the tor browser

[@Putteping98]

we have the same chair Eli

[@OvrcstYT]

Great video Eli, and

[@oualitsenramdane454]

Hi, well I like the way you presented the vid, thank you

[@mikebrennan7045]

I don't agree with the deffinition you gave. I'd consider the Deep Web anything on the onion network. I could be way off base because I'm not an expert, but you can't access the deep Web without an browser add on like tor. Firefox, Internet Explorer, safari, Google Chrome, none of those can access a .onion site by themselves.

[@twhatley45]

Best explanation of the "Deep Web" I've heard yet. Thanks!

[@sujankoju5408]

When does deep and dark web started ?

[@kpopislifeu2620]

Sujan Koju i wonder

[@IonutBypp]

What about TOR?

[@thewallstreetjournal5675]

Wikipedia Tor: " As Tor does not, and by design cannot, encrypt the traffic between an exit node and the target server, any exit node is in a position to capture any traffic passing through it that does not use end-to-end encryption such as SSL or TLS..." Tor can no longer be considered anonymous as governments own many of the exit nodes mentioned above. Tor is based of very sound principles, that would protect one from being monitored by other eavesdroppers but it is off no use against someone who owns the network. You would probably be best served by using a VPN. You would have the same benefits of anonymity and probably a faster connection.

[@robertosalcedo1378]

Thank you for the explanation. In youtube there are many stupids points of view about the "deep web", you don't imagine how many videos speak about deep web like if it would be cool or a mysterious, paranormal sometihing (amazing, no?) That people put together 2 situations that in historia are apart by many century: tecnology and supertition. Again thanks! :)

[@SNOWYD3VO]

Isnt it illegal to look through deep web?

[@seanvanimpe9685]

Depends where you live i guess

[@zone07]

Deep Web is not illegal; Research TOR (The Onion Router) to get started. Once familiar go to this site with the TOR Browser: kpvz7ki2v5agwt35.onion/wiki/index.php/Main_Page You can not go to it with your standard browser.

[@ArsenalDave04]

Here (the UK) it's completely legal to use TOR or be on deep web, but some of the things (child porn, buying drugs, hiring hitmen) can get you in jail lol

[@mikefdorst]

As with most tools, it's how you use it that counts. It's not illegal to download metasploit, but it may be illegal to use it in certain ways. There is nothing illegal about using the TOR browser, so long as you are not buying illegal drugs, viewing child pornography, or doing other things that are illegal in the country you live in.

[@mikefdorst]

As with most tools, it's how you use it that counts. It's not illegal to download metasploit, but it may be illegal to use it in certain ways. There is nothing illegal about using the TOR browser, so long as you are not buying illegal drugs, viewing child pornography, or doing other things that are illegal in the country you live in.

[@Sphenique]

Smart approach, smart enough. Will it hold?

[@jimmeedee3375]

Google just indexes pages based on their frequency in usage and reliability. Deepnet is just a throwback to when internet first started gaining it's notoriety as a household amenity. Personally; I think it's great to have the variety in search options. Tired of googling "HHO cell schematics" and coming up with a ton of shit videos.

[@cookiesliyr2]

down to earth Eli, Down to earth

[@PhilipHousel]

Thank you for such a clear explanation...

[@richardcornell3302]

What is scary is that one hacks into places where the owner who you have hack into seeks blood in turn. 12 year old kid can be found hanging as can a 30 year old.

[@soundousmahamedi4167]

but how to crawl a deep web?

[@rick1475]

YESSSSS!!!! some code at last, keep it coming

[@ANDREASRIAL]

thanks for making it clear!

[@richardcornell3302]

I would still think that all said is still current

[@70rm3n70r]

this is more like basic intro to seo, and while there is nothing really special about the "deep web" , you gave the wrong impression about it and failed to mention that some of those sites are dangerous and will get in trouble real fast, i think everyone knows what am i referring to, you can laugh all you want saying its not a big deal its just a bunch of old sites with no robots.txt or a poorly created website, there is a reason why using TOR is required before going to some of those sites, and that is just very basic security that even grandma can setup and use. i suppose you went farther than just the very basic hidden wiki page to say that those sites are nothing more than old crappy sites.

[@eidolonvector4844]

Somehow I doubt Eli's sentiment of dismissing the deep web as not cool, nefarious or sexy would have consoled me last summer when I spent 3 weeks unable to laugh or smile because of the unbridled human activity I saw using Tor, I2P, Freenet, GnuNet and other networks.

[@natanteam]

He introduced only HALF of the deepweb. He left out the "onion" domains (such as kpvzqvzyooocvs7u.onion), where the actual "cool, creepy or nasty" stuff are.

[@oursours]

Not even mentioning tor and the onion pages ? ^^

[@leealexander209]

It's more info and sites than on the commercial web. Duh.

[@EekADog]

Some tips.. don't download anything, turn off all scrips in tor browser, beaware for honeypots and botnets!

[@ArAbiM0dz]

I read the binary digits and converted it to deep space 9....

[@fabrizoluggerious6855]

thank you. I really appreaciate your videos :)

[@fullkiller2000]

Eli do a draw my life vid

[@42ouncesofPAIN]

Honest to Spaghetti Monster? Seriously Eli... Are you one of those people?

[@adamdundas87]

so why explain Tor when he already did, pay attention. and go back to reading fully on tor project dot org he just summed it up.

[@pierreloubris766]

as usual, un grand merci, well put. pierre

[@AznAlacran]

But yes, surfed properly the deep web is fairly safe, just don't go into the hidden wiki and start clicking random links.

[@beefcurtainz69]

Everything you said about why it's not a big deal that the sites are not indexed by search engines is true. But at the same time there are very weird and strange, or dark/ illegal activity that is in fact not indexed by search engines on purpose! Most of it is just normal stuff not indexed but you needed to mention there ARE in fact dark reasons why some aren't indexed on purpose. It can in fact be a big deal!!

[@irving_8194]

top notch intro

[@TheWalkingdude69]

Too much is sacrificed on the altars of generlalism and apologism...

[@ryanfoley4123]

Awesome great bids man

[@TheM4rxman]

sure, some of it is mundane, but plenty of it is CP, weapons, drugs, and human trafficking

[@tinamclaughlin1991]

Its like they think you dig up ancient web connections that bonk you on the head with an old bone! LOL!

[@AlecVanek]

Eli's voice sounds very strange in this video

[@JohnDoe-yb7ps]

His knowledge seriously makes my brain just turn off when he starts talking that's how smart this guy is compared to me I thought i was smart when I learned to jailbreak my iPod little did I know he probably made the software for me

[@chica476]

People actually payed for web browsers back in the day? Man, how time flies.

[@christose9247]

that wasn't melodramatic, that was plain old dramatic if anything

[@Slic3R1]

3 days before i decide to finally go on the deep web, they remove the most interesting parts of it -_- fml.

[@SidewaysIsDead]

You remind me of John Malkovich

[@Chromegrillz]

You look like Trevor from gta 5.

[@guntermeynen]

It is nice to see that collegues can be as crazy as me... See See U °(@-@)° Inspector G .... ;-) BTW Eli after seen already many many of your videos... way to go m8! Grtz of a Belgian forensic investigator

[@lakecrab]

I have seen the DEEP WEB...it can not be unseen. And I...I am a marked man...slated for elimination from the Matr..........Daisey, Daisey, give me your answer do...

[@anteconfig5391]

"whoa, I wanna be one of the cool guys"