Can I Make A Search Engine From Scratch?

[@seraphimwiththecheese5880]

Interesting video! I learned a lot about how search engines work. Keep it up!

[@_equalo]

Thanks Seraphim!

[@busterdafydd3096]

6:05 another fact about your search engine is that it will probably only target english pages and not the whole world's languages

[@rmt3589]

I got so excited for this series! Then clicked on your channel, and nothing. Worst thing that happened today by far. But I subscribed. Hoping you continue it someday! Please...

[@Foxtrot445]

Him: Hey google, how do you sell a child? Google: We have a Wikpedia article for that! 4:18

[@Phiwipuss]

People also ask: How much is a kid worth on the black market?

[@GamingFemboy]

@@Phiwipuss no just no

[@Phiwipuss]

​@@GamingFemboy I got it from the video. -_-

[@user-oas]

@@luke-bookbear ?

[@silverhoney6969]

Yeah that was a weird example for the creator to use!?

[@burtmcgurt3584]

Awesome start! I am excited to see where you go with this!

[@박민욱-h9d]

Try word embedding. It basically changes strings to vectors and index said vectors. When you search you have to vectorize the search term and compare it with saved indexes. It should be faster than using strings to compare

[@seankim8123]

Hi i have some questions

[@АлексейГриднев-и7р]

Better yet one can use proper database (like MySQL or SQL Server) to increase the search speed. If there's one table website URL and full text and other 2-3 tables with the most frequent words, bigrams, and trigrams per URL (ordered by frequency), that will be much more efficient than always relying on full-text seach, and it would also improve relevance.

[@StrangerHappened]

The lad is pretty adorable, I must say; an interesting content.

[@footiecyclo]

Thanks Pewdiepie

[@Fortnitesucks1-w2d]

Lol you are so funny i wish i was as funny as you🙄🙄🙄🙄🙄 Ur like really not funny

[@manishbhati2722]

I want to know further about indexing. If possible, make next part of this search engine video.

[@АлексейГриднев-и7р]

Great project! Are you aware of nltk package? It is capable of removing stop-words, stemming, word and word collocation frequencies, and so on. I believe that could help greatly with indexing.

[@_equalo]

Good point! I’ve used NLTK a little, but wasn’t confident enough with it to apply it to this project. Maybe it’s time for me to dig into it

[@Snakeythepuppet]

@@_equalowhat happened to your channel?

[@alisiddiquii]

Thanks for this interesting video, I've learnt about how search engine works after passing my exam

[@SlappyRB]

in the first 1 minute, i already am enjoying this video

[@mrbushy7262]

I watched the video and thought you had 456k subs because it was so good 😅 you earned a sub with notifications.

[@_equalo]

Thanks mrbushy!!

[@wickederebus]

so, im guessing this project did not get a follow up video?

[@moondev369]

I'm working on something similar in machine learning. I'll let you know when i am through! Glad to see you workin do hard on it. You can do it!!!

[@waynefilkins8394]

That's probably the only way to compete these days. It would take so much time and manpower to build something like Google, but if you can incorporate machine learning into it, might bypass a lot of the stuff they had to do the slow way

[@krissna9697]

To create a search I'm a coumputer science student beginner .there are lot of fields in computer science major, in all of these which field do I specifically need to take to develope a search engine? please

[@somewherenear3003]

Oh hey! I decided to make my own search engine this year back in 2020 too. Now is the time I'll be doing this project. I'll be sharing my progress on my channel.

[@spreadItWide]

did you start yet?

[@FilippoBerardo]

question: The search of pages can be done even with ip addresses, cycling every possibile number? Or only with links? Using links means you must have a list.

[@JamesScottGuitar]

How’s the project going now?

[@meerachaturvedi9050]

Its dead

[@vihaankedia8134]

could you send your source code for the search engine

[@nyancat5140]

Yeah, I was trying to do this by myself. A link to the code would be great!

[@prithivirajr7918]

WHATS THE LEVEL OF YOUR SERCHENGINE NOW

[@tiagotiagot]

How about using GTP-style "tokens" to encode both page contents and search keywords?

[@myztartupjourney6772]

Equalo you should make a part 2 to this video!!

[@av3stube480]

Was the number of links you parsed from the second batch of pages referring to the total links or the amount of unique links? It's pretty easy to think of an example of a set of Wikipedia pages that all link back to one article, or even two or more pages that all connect to each other and create endless loops. Of course, looking for changes in website contents is necessary, but avoiding crawling over the same pages too often should speed up the rate of expanding the database and reduce the strain on the hardware in the long term.

[@dh2032]

you would have a process. search, in document, duplications, but you would still Identify if the are in deed duplications, and not just similar, and even if it was real duplications, it was still linking for a reason, unless it just the home button or something like that?

[@AriJankelowitz]

Great video with excellent music choice!

[@_equalo]

Thanks!

[@bruinebeerinhetblauwehuis]

Very interesting project from Michael Falk!

[@Holleylifestyle]

This was amazing. Gotta get to work. Thx for the great content.

[@Carambal81]

Your videos are very informative, I just learned how to sell my child! :P (@4:18)

[@_equalo]

Haha I’m always happy to help. Glad you found that part useful

[@divyanshusah2809]

@@_equalo 🤣🤣🤣

[@busterdafydd3096]

5:10 it wouldn't be a bad idea to chuck the word recursion in there and state that that's what your crawling and parsing is doing

[@sebastianjohannes2316]

What coding tool do you use to create the search engine?

[@PaAGadirajuSanjayVarma]

Good work bro.try to use hashing of words in a web page and store them in a hash table.I think it might increase it.search hashes instead of word to word

[@_equalo]

That’s a smart option! I’ll try to do a follow up video trying that and a couple other methods

[@ryanmacalandag5279]

I'm also interested. I'm looking into building a search engine for a group of less than 200 related websites only. This is an insightful video. Hopefully you you post the code. Thanks

[@zanjeev8654]

Did you create your own search engine?

[@mathcloud]

So where is your search engine? No link?

[@sirrealsam]

00:29 had me crack up, haha :-D

[@annuritv4617]

I'm ready to help.

[@melindamassey14]

Your choice of wiki topic to search????

[@Zz-ol5bx]

But won't this method be too much time consuming?is there any other way to make it faster or automate it bro

[@mawrahassan1973]

I think this is the guy who has a channel named "what I've learned"

[@AndrewsLorenzana]

Hey, how is your search engine going?

[@sprinteroz2239]

Is this on github or you keeping the code private?

[@vikinggeorge7007]

The second I saw python I stopped the video to rethink my life

[@movocode]

4:19 Did anyone see what he typed in the Search !! 🤣🤣🤣

[@divyanshusah2809]

Lol..🤣🤣🤣

[@Raghuvaran13899]

"How to sell your child"🤣🤣🤣

[@legixstudio6713]

7:45 is'nt scott morison the priminister

[@aa-qz2ej]

Just subscribed, great content!

[@callofdutymobile1074]

More interested in the coding aspect you share source code or how to get started

[@iamanishkumar]

Why aren't you making another video?

[@adamayala3906]

Nice

[@_equalo]

Thanks Adam!

[@busterdafydd3096]

5:27 so now you start indexing. keywords in the websites links to websites

[@MoyaNandaoOfficial]

Please upload for me the download link of your search engine. Thanks

[@snehashisbera8316]

thanks bro, I Learned a lot today by practical way.

[@RageBird7200]

What about Bing Users?

[@sparrowEP]

2:57 when u open OBS for the first time:

[@menopriezvisko2232]

try arango database for inverted index searching

[@universenerdd]

From scratch just bothers me for some reason

[@merrytantrimilleniatobing3740]

Can you give us the tutorial to make that search engine, sir?

[@builder481]

Amazing video and also very funny lmao

[@gspapp]

link?

[@NickKartha]

Hope the project progressed beyond python scripts.

[@OfficalOxy]

duckduckgo is getting popular

[@twansmith2622]

Hello r u still working on this

[@Plexversal]

9:10 lmfao that gif

[@coyzee1]

LOL, 7.35 She gushed over him. Sorry about that. Very interesting, thanks for the vid.

[@subhakantasahoo9760]

I searched for it after whatspp's new january privacy up-to-date 😃😃

[@marvelousmarvelxx3889]

Subscribed!

[@vhwjpzf1z0fi73a]

Any news on this?

[@ryxn3x]

👍

[@phillipspodcast]

Good video mate

[@pavannaidu759]

can you share the code

[@RahulSharma-oj4ik]

PewDiePie's Got A Search Engine😀

[@jasonfanclub4267]

Good content

[@namithshetty]

Bro go on title and headline base because then only you can get the information

[@raymondchiwade]

How can I contact you

[@Viralboris]

😎My friends says - You can't compete... 👩My mother says - Never give up... 😇"I follow what my mother says"

[@jessetate7601]

Use folder and use letter to me the floder

[@rylandsquires4886]

Watch at 1.5x speed

[@ahsanabrar880]

please share update.

[@makersspace565]

petabytes=too expensive

[@ToniMartiAlbons]

Nice video 👌

[@Ab-cj6gl]

i was planning to build something similar but ain't gonna happen 😂

[@TF-cn6oj]

Update please

[@dr.official9852]

Wait a minute

[@busterdafydd3096]

You didn't even paritially cover indexing in this video

[@meerachaturvedi9050]

Vedio is just a look

[@meerachaturvedi9050]

Indexing is a big process

[@meerachaturvedi9050]

Want to know

[@saidkauzu7831]

I have an idea do you want listen?

[@meerachaturvedi9050]

Yup

[@Randomynous01]

Google no longer operates on the number of links that link back to it, but rather PRIORITIZATION

[@madabtMSK]

good try!

[@apang1831]

"how to sell your child"

[@SlumDawgSaint]

Did you make it, i want to make it and make it public and add free and zero tracking of people good gearh engine add free bias free...;)

[@joshclaassen616]

Check out safenetwork.tech there are a few people pondering how to implement a search engine and you may enjoy the challenge.

[@ahrorbekabdullayev2193]

I'd prefer wikipedia api

[@marlonlopez4154]

Can you email me really interested.

[@elliotsearchengine8626]

We did something different Check ✔️ Elliot Search

[@prestonjudearnold2814]

how

[@allanbenedict4558]

Like it

[@twistah]

Am I the only one who uses duckduckgo

[@techample]

Yes. Can't imagine someone not using Google😃

[@chris_the_nerd09]

Opera is better than Google

[@mathquik1872]

Are you on onlyfans?

[@RmbTfitness]

I laughed a lot... watching your video

[@prudvi01]

duck gang

[@rxkshan]

chuper

[@sparrowEP]

"mom can we have google" "we have google at home" google at home

[@yvessambatshefu6809]

Can you create one for the Black Community there is a high demands Blackgoogle.com We have the data of crowdsourcing to put it in

[@bobulousspazz8949]

...

[@porter2024]

why do you need a search engine for the black community

[@domihercegovac]

kinda racist

[@valencefootball9740]

WHAT?!

[@user-oas]

tf