Can I Make A Search Engine From Scratch?

[@rmt3589]

I got so excited for this series! Then clicked on your channel, and nothing. Worst thing that happened today by far. But I subscribed. Hoping you continue it someday! Please...

[@seraphimwiththecheese5880]

Interesting video! I learned a lot about how search engines work. Keep it up!

[@_equalo]

Thanks Seraphim!

[@busterdafydd3096]

6:05 another fact about your search engine is that it will probably only target english pages and not the whole world's languages

[@박민욱-h9d]

Try word embedding. It basically changes strings to vectors and index said vectors. When you search you have to vectorize the search term and compare it with saved indexes. It should be faster than using strings to compare

[@seankim8123]

Hi i have some questions

[@АлексейГриднев-и7р]

Better yet one can use proper database (like MySQL or SQL Server) to increase the search speed. If there's one table website URL and full text and other 2-3 tables with the most frequent words, bigrams, and trigrams per URL (ordered by frequency), that will be much more efficient than always relying on full-text seach, and it would also improve relevance.

[@footiecyclo]

Thanks Pewdiepie

[@Fortnitesucks1-w2d]

Lol you are so funny i wish i was as funny as you🙄🙄🙄🙄🙄 Ur like really not funny

[@burtmcgurt3584]

Awesome start! I am excited to see where you go with this!

[@Foxtrot445]

Him: Hey google, how do you sell a child? Google: We have a Wikpedia article for that! 4:18

[@Phiwipuss]

People also ask: How much is a kid worth on the black market?

[@GamingFemboy]

@@Phiwipuss no just no

[@Phiwipuss]

​@@GamingFemboy I got it from the video. -_-

[@user-oas]

@@luke-bookbear ?

[@silverhoney6969]

Yeah that was a weird example for the creator to use!?

[@StrangerHappened]

The lad is pretty adorable, I must say; an interesting content.

[@manishbhati2722]

I want to know further about indexing. If possible, make next part of this search engine video.

[@alisiddiquii]

Thanks for this interesting video, I've learnt about how search engine works after passing my exam

[@somewherenear3003]

Oh hey! I decided to make my own search engine this year back in 2020 too. Now is the time I'll be doing this project. I'll be sharing my progress on my channel.

[@spreadItWide]

did you start yet?

[@SlappyRB]

in the first 1 minute, i already am enjoying this video

[@vikinggeorge7007]

The second I saw python I stopped the video to rethink my life

[@mrbushy7262]

I watched the video and thought you had 456k subs because it was so good 😅 you earned a sub with notifications.

[@_equalo]

Thanks mrbushy!!

[@moondev369]

I'm working on something similar in machine learning. I'll let you know when i am through! Glad to see you workin do hard on it. You can do it!!!

[@waynefilkins8394]

That's probably the only way to compete these days. It would take so much time and manpower to build something like Google, but if you can incorporate machine learning into it, might bypass a lot of the stuff they had to do the slow way

[@АлексейГриднев-и7р]

Great project! Are you aware of nltk package? It is capable of removing stop-words, stemming, word and word collocation frequencies, and so on. I believe that could help greatly with indexing.

[@_equalo]

Good point! I’ve used NLTK a little, but wasn’t confident enough with it to apply it to this project. Maybe it’s time for me to dig into it

[@Snakeythepuppet]

@@_equalowhat happened to your channel?

[@wickederebus]

so, im guessing this project did not get a follow up video?

[@bruinebeerinhetblauwehuis]

Very interesting project from Michael Falk!

[@myztartupjourney6772]

Equalo you should make a part 2 to this video!!

[@AriJankelowitz]

Great video with excellent music choice!

[@_equalo]

Thanks!

[@vihaankedia8134]

could you send your source code for the search engine

[@nyancat5140]

Yeah, I was trying to do this by myself. A link to the code would be great!

[@busterdafydd3096]

5:10 it wouldn't be a bad idea to chuck the word recursion in there and state that that's what your crawling and parsing is doing

[@ryanmacalandag5279]

I'm also interested. I'm looking into building a search engine for a group of less than 200 related websites only. This is an insightful video. Hopefully you you post the code. Thanks

[@zanjeev8654]

Did you create your own search engine?

[@Holleylifestyle]

This was amazing. Gotta get to work. Thx for the great content.

[@PaAGadirajuSanjayVarma]

Good work bro.try to use hashing of words in a web page and store them in a hash table.I think it might increase it.search hashes instead of word to word

[@_equalo]

That’s a smart option! I’ll try to do a follow up video trying that and a couple other methods

[@prithivirajr7918]

WHATS THE LEVEL OF YOUR SERCHENGINE NOW

[@tiagotiagot]

How about using GTP-style "tokens" to encode both page contents and search keywords?

[@sirrealsam]

00:29 had me crack up, haha :-D

[@JamesScottGuitar]

How’s the project going now?

[@meerachaturvedi9050]

Its dead

[@annuritv4617]

I'm ready to help.

[@krissna9697]

To create a search I'm a coumputer science student beginner .there are lot of fields in computer science major, in all of these which field do I specifically need to take to develope a search engine? please

[@av3stube480]

Was the number of links you parsed from the second batch of pages referring to the total links or the amount of unique links? It's pretty easy to think of an example of a set of Wikipedia pages that all link back to one article, or even two or more pages that all connect to each other and create endless loops. Of course, looking for changes in website contents is necessary, but avoiding crawling over the same pages too often should speed up the rate of expanding the database and reduce the strain on the hardware in the long term.

[@dh2032]

you would have a process. search, in document, duplications, but you would still Identify if the are in deed duplications, and not just similar, and even if it was real duplications, it was still linking for a reason, unless it just the home button or something like that?

[@Carambal81]

Your videos are very informative, I just learned how to sell my child! :P (@4:18)

[@_equalo]

Haha I’m always happy to help. Glad you found that part useful

[@divyanshusah2809]

@@_equalo 🤣🤣🤣

[@mawrahassan1973]

I think this is the guy who has a channel named "what I've learned"

[@mathcloud]

So where is your search engine? No link?

[@FilippoBerardo]

question: The search of pages can be done even with ip addresses, cycling every possibile number? Or only with links? Using links means you must have a list.

[@universenerdd]

From scratch just bothers me for some reason

[@AndrewsLorenzana]

Hey, how is your search engine going?

[@melindamassey14]

Your choice of wiki topic to search????

[@aa-qz2ej]

Just subscribed, great content!

[@snehashisbera8316]

thanks bro, I Learned a lot today by practical way.

[@adamayala3906]

Nice

[@_equalo]

Thanks Adam!

[@coyzee1]

LOL, 7.35 She gushed over him. Sorry about that. Very interesting, thanks for the vid.

[@movocode]

4:19 Did anyone see what he typed in the Search !! 🤣🤣🤣

[@divyanshusah2809]

Lol..🤣🤣🤣

[@Raghuvaran13899]

"How to sell your child"🤣🤣🤣

[@builder481]

Amazing video and also very funny lmao

[@sparrowEP]

2:57 when u open OBS for the first time:

[@marvelousmarvelxx3889]

Subscribed!

[@sebastianjohannes2316]

What coding tool do you use to create the search engine?

[@merrytantrimilleniatobing3740]

Can you give us the tutorial to make that search engine, sir?

[@callofdutymobile1074]

More interested in the coding aspect you share source code or how to get started

[@iamanishkumar]

Why aren't you making another video?

[@Plexversal]

9:10 lmfao that gif

[@SankiShekher]

😎My friends says - You can't compete... 👩My mother says - Never give up... 😇"I follow what my mother says"

[@NickKartha]

Hope the project progressed beyond python scripts.

[@RageBird7200]

What about Bing Users?

[@phillipspodcast]

Good video mate

[@subhakantasahoo9760]

I searched for it after whatspp's new january privacy up-to-date 😃😃

[@busterdafydd3096]

5:27 so now you start indexing. keywords in the websites links to websites

[@jasonfanclub4267]

Good content

[@MoyaNandaoOfficial]

Please upload for me the download link of your search engine. Thanks

[@Zz-ol5bx]

But won't this method be too much time consuming?is there any other way to make it faster or automate it bro

[@legixstudio6713]

7:45 is'nt scott morison the priminister

[@menopriezvisko2232]

try arango database for inverted index searching

[@OfficalOxy]

duckduckgo is getting popular

[@namithshetty]

Bro go on title and headline base because then only you can get the information

[@twansmith2622]

Hello r u still working on this

[@ToniMartiAlbons]

Nice video 👌

[@sprinteroz2239]

Is this on github or you keeping the code private?

[@gspapp]

link?

[@RahulSharma-oj4ik]

PewDiePie's Got A Search Engine😀

[@vhwjpzf1z0fi73a]

Any news on this?

[@makersspace565]

petabytes=too expensive

[@pavannaidu759]

can you share the code

[@Ab-cj6gl]

i was planning to build something similar but ain't gonna happen 😂

[@rylandsquires4886]

Watch at 1.5x speed

[@Randomynous01]

Google no longer operates on the number of links that link back to it, but rather PRIORITIZATION

[@sparrowEP]

"mom can we have google" "we have google at home" google at home

[@ryxn3x]

👍

[@dr.official9852]

Wait a minute

[@apang1831]

"how to sell your child"

[@madabtMSK]

good try!

[@jessetate7601]

Use folder and use letter to me the floder

[@raymondchiwade]

How can I contact you

[@ahrorbekabdullayev2193]

I'd prefer wikipedia api

[@RmbTfitness]

I laughed a lot... watching your video

[@chris_the_nerd09]

Opera is better than Google

[@busterdafydd3096]

You didn't even paritially cover indexing in this video

[@meerachaturvedi9050]

Vedio is just a look

[@meerachaturvedi9050]

Indexing is a big process

[@meerachaturvedi9050]

Want to know

[@saidkauzu7831]

I have an idea do you want listen?

[@meerachaturvedi9050]

Yup

[@ahsanabrar880]

please share update.

[@prudvi01]

duck gang

[@allanbenedict4558]

Like it

[@twistah]

Am I the only one who uses duckduckgo

[@techample]

Yes. Can't imagine someone not using Google😃

[@SlumDawgSaint]

Did you make it, i want to make it and make it public and add free and zero tracking of people good gearh engine add free bias free...;)

[@TF-cn6oj]

Update please

[@marlonlopez4154]

Can you email me really interested.

[@Naderium]

420th like

[@elliotsearchengine8626]

We did something different Check ✔️ Elliot Search

[@prestonjudearnold2814]

how

[@mathquik1872]

Are you on onlyfans?

[@joshclaassen616]

Check out safenetwork.tech there are a few people pondering how to implement a search engine and you may enjoy the challenge.

[@rxkshan]

chuper