Network of The Witcher | Relationship Extraction & Network Analysis with Spacy & NetworkX

[@Thuvu5]

Join my discord server discord.gg/SK7ZC5XhcS The video many of you were looking forward to! 🤓 It was really fun to make. I hope you enjoyed it and found it useful for your own projects! 😊

[@digigoliath]

Wonderful. TQVM!!!

[@danielq1985]

says the invite has expired?

[@Thuvu5]

@@danielq1985 Hey Daniel, I forgot to change the expiry date of the invite, sorry! 🤦🏻‍♀️ I've changed the link in the comment above!

[@danielq1985]

@@Thuvu5 no worries! Thanks for updating it and replying so quickly! This is an amazing thing you are doing btw, really. This video is very timely. I am doing a text analysis on a completely different subject but this tutorial will 100 percent help me. So thanks!

[@kartikayemadhok]

Can you pin this or better add this to the description?

[@nervous711]

We NEED more of this kind of projects!! I love this series so much... So please, we need the finale of this project...

[@LukeBarousse]

Heck yeah! Loving where you are taking this video series, Thu!!! 🙌🏼🙌🏼

[@Thuvu5]

Thank you so much, Luke! 🤗 It took me forever to put all parts together, I'm so glad to finally put it out.

[@youngzproduction7498]

Graph algorithms are quite useful as well as beautiful in their own right. I’m glad there are some people using them. More importantly, use them with a fun-to-do use case. Thanks for your effort.

[@dragonboy123000]

I thought I love your videos, but now you made a video about The Witcher's universe? Aw...! I didn't think I could love them even more...

[@Thuvu5]

Aw thanks for this haha 😇. I just thought I could do something to fill my time until The Witcher season 3 😜

[@digigoliath]

And I love you even more!!!! MORE please!!

[@santosluiza314]

Your content is great! I found your video because I was lost in my data analysis class when it came to the module of Network Analysis. I'm going to recommend you to all my classmates. Thank you for putting so much thought in this!

[@Thuvu5]

Thank you so much for your support! I’m glad the video was helpful 🤗

[@matteoandriolo1144]

same experience here 💀

[@nguyenngockhanh926]

Thanks!

[@juanrassis]

Seriously, Data Science is just mind blowing! Specially when you consider all the real-world applications for those resources.

[@Thuvu5]

Totally agreed!!

[@KanaanGM]

this was incredible! following thru took me 3 hours, i didn't know data science could be this fun, please make more!!

[@Thuvu5]

Amazing that you followed through the project, Kanaan!! 🙌🎉 I’m so glad you had fun doing it 😀

[@edniraf2407]

Omg, amazing video!!! I am starting with graph theory and visualization and this video has very important information for my project. Special thanks for the hints on extra material. You teach very well! Keep up the excellent work😊

[@Thuvu5]

Wonderful! Good luck with your project 🤗

[@hris2570]

Love the flow of this video. Amazing step by step. Thanks Vu.

[@Thuvu5]

Hey Chris, thanks so much for your kind words! Glad you enjoyed it 🤗

[@a.5214]

Wow, the best explanation of the DS project on YT I have seen! 👏🏻Thank you for educating us!

[@Thuvu5]

Aw thank you! Really appreciated your kind words 🙌❤️

[@Davao420]

Omg this is the best format for learning this topic. love

[@vinni_codes]

I was looking forward to this video. I'm loving the series of video. I can't wait to put this into practice.

[@Thuvu5]

So glad to hear Vinicius! 🙌🏽

[@dakotapearl0]

Really well explained code, it's rare to find such a good description of an algorithm. Thank you!

[@Thuvu5]

Thank you Loren!! 🙌🤓

[@Khormologia]

I really love your work! Good job there, very inspiring

[@davidakinmade3523]

Was completely captivating from start to finish

[@ShivamMiglani]

Glad to see the end product! Nicely executed

[@Thuvu5]

Hey Shivam, thanks for your comment and your help with ideation! 🙌🏽🤓

[@Davidkiania]

Thu, I absolutely love this video series and lost count of how many times I have watched it for tips & tricks. Thank you 🙏 can’t wait for the computation.

[@Thuvu5]

Thank you David! 🙌 This is so amazing 🤩

[@HenockTesfaye]

I LOVE the copy pasting thing you do. No time wasted typing. Thank you! You're awesome.

[@Thuvu5]

Thank you so much for this Henock 🙌!

[@alexvv2053]

@@Thuvu5 Would you mind sharing how you are doing this style of copy pasting Thu Vu? It looks very clean and is great for these videos. Do you have some kind of tool for this?

[@Thuvu5]

@@alexvv2053 No, it's proprietary 😏. Jk, I'll share it in another video 😂

[@SmithaKolan]

This video is awesome! Great job Thu!!!

[@Thuvu5]

Hey Smitha! Thank you so much for watching my video and your kind words❤️. I just came across your channel recently when i started making the ML course review 🙈. You’re doing great with your content, keep it up! 🙌🙌

[@liadapardaa9461]

Thank you very much for these kinds of videos. I am currently working on 2 projects that require these two techniques, and this video has been very helpful to me. Thank you so much!!

[@s900712n]

I smashed the subscribe button as soon as I saw the thumb nail.

[@Thuvu5]

Yaay, thank you! 😍

[@princeganer404]

Hey Thu Vu, this stuff is really very cool!! Watching what amazing things we can do using Data Science excites me. Thanks for sharing it with us.😀

[@davidr007]

Wow Thu, just found your channel and I'm hooked! Thank you!!

[@TheMISBlog]

Love the editing of this video, Great Video Thu

[@Thuvu5]

Thank you! It took me some time to edit so I really appreciated that ❤️

[@SpanishJohn]

This is great!...keep em coming

[@Thuvu5]

Thank you Juan! More to come! 🙌🏽

[@danielq1985]

this is so... COOL! I like your tutorial style, it's right to the point.

[@Thuvu5]

Thank you so much Daniel! 🙌

[@jasonlewis5125]

First! Amazing video, Vu!!!

[@Thuvu5]

Yaaay first comment! 🙌🏽😍

[@SantoRedentor]

Great video, enjoyed it very much. And great choice of subjects, turn what had the potential of being "a very boring lesson/tutorial" into an exciting adventure that had me clinging to my chair thinking "what are we going to discover next?"

[@callumlock8936]

More awesomeness like this please, data visualisation is my favourite 😀

[@reebaconator]

Very cool visualization and awesome topic!

[@Zaycancode]

This project is unbelievably fucking cool

[@Thuvu5]

Thank you Thomas! So glad you liked it 🙌🏽

[@yashpreet4103]

You are really providing amazing content.

[@AljRest]

Bravo! Absolutely a great job, keep going. Best lucks!

[@0MVR_0]

The use of lambdas is impressive.

[@yd_]

Coming from the life sciences, I’ve only used cytoscape for network related stuff. It’s rest api isn’t very good, so it’s a bit difficult to automate, but it has more features than networkx imo. Great tutorial. I did something similar in a side project a while ago for Japanese novels. Was a lot of fun.

[@Thuvu5]

Oh I didn’t know cytoscape but sounds like a nice tool. Interesting that you did the same project for Japanese novels 😃🙌

[@CarlosGonzalez-ll6xx]

a science is a science, what are you talking about karen?

[@kamertonaudiophileplayer847]

Interesting, we think a very similar. I got a patent for the approach you described. I should include you in the inventors list for next patent.

[@mateusbalotin7247]

This was so entertaining to watch, never knew you could do that with nlp, thanks for this amazing video!!! i'll try latter with different fantasy books. Hope you have an amazing week!!!

[@Thuvu5]

Aww thank you so much! You too, have a great week! 🙌

[@kaustavdas6550]

Love the haircut!!! Great video will try this for my learning project!!!

[@Thuvu5]

Aw thanks Kaustav! 😇 Have fun with your project!

[@Pakman909]

Love this!! I love the format you use for explaining these concepts. Super helpful :)

[@Thuvu5]

Aw thank you for this, Kyle! 🤗🙌

[@TheRazgr1z1]

My partner will love this! Thank you :)

[@felixmack8620]

Such a great video. Thank you so much for sharing this work and insights.

[@stevevong1797]

Thank you thank you. I love learning by doing projects so this is perfect. Thank you! 😀

[@dipanshuhaldar4239]

Hi I loved this video and lot of it is familier with my current project on static graphs on player interactions playing pc/console games. However, my current research takes it a noch higher on the same lines but with dynamic graphs. Currently I amtrying to implement the same with networkX + dynetX, with a keen eye at pathpyG as well. I would love to see a future video on dynamic graphs!

[@cerealport2726]

This is such a cool project! I had not heard of Spacy or NtworkX before. I have only seen the TV series, so please don't hate me!

[@Thuvu5]

Oh oh of course I hate you for this 😜. Thanks for watching Cereal Port! 👋

[@lunapapa2024]

I love your posts very much!

[@ahmedabushama4024]

A good intensive lecture , hope you spilt it to absorb more valuable insights . Thanks

[@Thuvu5]

hey Ahmed! Thanks for your comment. Yeah.. It's probably better to split the video 🙈

[@SimbarasheWilliamMutyambizi]

Absolutely wonderful, thank you

[@troy_neilson]

Great channel!!! I'm really enjoying your content.

[@Thuvu5]

Thank you so much Troy! I’m so glad to hear you liked the content 🙌

[@HARSHALTELRANDHE]

What a great video!! Keep up the good work.👍 Btw this haircut looks great on you😬

[@Thuvu5]

Haha thank you so much Harshal! Thanks for your help with the visuals ❤️

[@MonkeyZen]

Very well done!!

[@JohnNeville-b8y]

3:48 Where was "Season of Storms"? 😂😂 Seriously though, I really loved this vid! It's such a great way to learn - doing something fun.

[@lorenzoleuck5936]

really cool! do more social network analysis

[@Licht1212]

Very interesting content. Thank you! 🙏🏻

[@MinhNguyen-deadwish]

Wow, The topic of this video is that good. I hope you can create many good videos. 😍😍😍

[@mischievousachiever7896]

Great vid! Very interesting! Btw nice hair Thu Vu! Looking more cute haha

[@Thuvu5]

Aw thank you! Glad you liked the vid. Maybe this hair is too cute? 😂

[@mischievousachiever7896]

@@Thuvu5 haha yeah. Btw can you help me? Can you create content about a simple data analysis using R? There's not enough good content about it here on youtube. Also to give people out there some idea about R. Thanks Thu Vu! You're the best for me! Numba wan fan from ph!

[@Thuvu5]

​@@mischievousachiever7896 Hey, thanks for suggestions. I have some earlier videos about data analysis in R on my channel, please feel free to check them out. Hope it helps! Maybe i should create some more haha

[@mischievousachiever7896]

@@Thuvu5 yeah, I think that would be a great idea. And just let me know whenever you need some suggestions about contents my friend. 😊 Hoping we can stay in touch in discord

[@Thuvu5]

@@mischievousachiever7896 For sure! There's a channel on Discord for new video ideas. Please feel free to post your ideas there! 🙌🏽 Thanks a lot for your help :)

[@andrewign5806]

This is so fantastic. So so cool. 👏🏻👏🏻👏🏻

[@Thuvu5]

Thank you so much Andrew!! So glad you enjoyed it! 😄

[@bagussendigiru1071]

i like the way you explain, keep it girl

[@Thuvu5]

Aw thank you so much Bagus! 🤗

[@alecd8534]

Love your videos. Is it possible to make a video regarding to the data cleaning, such as how to treat outliers, etc? thanks

[@EsperanzadeLeon-xk7bp]

this video was sooo helpful!!! thank you.

[@c016smith52]

Amazing project and presentation, thank you!

[@Thuvu5]

Thank you so much, Chris! 🙌

[@KaraboMoremi]

Oh my Goood, those animations in the intro 🥺🥺😭😭 Turorial please 🙏🏾🥺

[@VietNameseBoyz6192]

Really proud of you. Cuz you are a vietnamese

[@el.chuckyy]

awsome, good material, and let me thinking were can i used it for my life!

[@Thuvu5]

That sounds great!! Thanks for commenting Agustin! 🙌

[@jackychan4640]

Thanks. Your videos are really helpful

[@Thuvu5]

Glad to hear Jacky! 🙌🏽

[@clementapelian2746]

Amazing video and amazing channel ! Thanks a lot !

[@000000000000479]

Excellent video. Thank you

[@jbs3144]

Love it!

[@leomechnikov6790]

Thank you very much!

[@digigoliath]

Wonderful. I will try with LOTR & GOT.

[@Thuvu5]

Oh that sounds awesome!! 🙌🏽😍

[@JohnnyTwoFingers]

This was great, when do you plan to do the 3D network graph visualization video though??

[@gagantipparaju8103]

Love your content. It's easy to follow. Can't help but feel sad for the hair though

[@Thuvu5]

Thank you! Haha it will grow back in no time 😂

[@rafikadamayantisn348]

omg this is so exciting

[@NormanWasHere452]

Phenomenal!

[@The_MM]

Great video. Loving your content!! I've a question, how to display the graph into panel dashboard please?

[@justinhuang8034]

Omg awesome!!!!

[@Thuvu5]

Thank you Justin 🙌😍

[@Pinkeseinhorn]

11:21 char_unique another way to perform this would be char_unique = list(set(char_list)) # create a set of the entries and then convert it back to a list which ensures uniqueness

[@thevoiceofb]

Hey! Great video, thanks a lot! Awesome to see these libraries applied to an interesting problem in a cool way! I would just have one question: what is the value of using NER and spacey in this case? If I understand correctly, you already had all the entities (characters) so perhaps the tokenisation of sentences so that you can calculate the rolling window? At the same time, wouldn't it be easier to make an assumption about the avg wordcount of 5 sentences, scan the document for your characters and their position, calculate their relative position and get the weights? I'm curious if there is something I missed (feel free to point out if what I said doesn't make sense) 🙂

[@Thuvu5]

Hey Balazs, very good question! 😄 I was thinking the same when I was making this project. But in the end I think using NER will make it more accurate in identifying the entities. Because sometimes if we only match words by words we might accidentally identify non-entity words as characters, just because they have the same spelling. But I can imagine the method you described could work as well.! It may worth double-checking the output if it's working as expected.

[@thevoiceofb]

@@Thuvu5 Thank you for the reply! Will share my results if I have the time to code this up

[@nXqd]

keep up your good work :)

[@bigdatavn]

cool quá em 😍

[@Bao-cb4dx]

Thanks Thu Vu, really enjoy your informative videos! Would you be able to do a video on how you document and organise your data science projects as well? E.g. there was a snippet of how your created a separate python file in the utils folder to store your functions. It would be really helpful to see in greater detail how the whole project folder was organised. Thanks again!

[@Thuvu5]

Hi Bao! Thank you for your watching!! You can find the code structure of the project in the Git repo (in the vid description)

[@Pinkeseinhorn]

12:13 would i make sense to permutate all the characters in the given window? If we have A, B, C, why wouldn't you want to have a relationship between A -> C if you would do that you could use from itertools import list(permutations(char_unique, 2))

[@LuizaAikawa-q3i]

great video. thank you!

[@yeiferrodriguez3434]

Great Method!, one question: Which cam model do you recorded this video? , Thanks!

[@thelawgameplaywithcommenta2654]

I'll watch another time.

[@Pinkeseinhorn]

16:16 for the lazy ones you can run terminal commands within a jupyter cell with exclamation mark. e.g. !pip3 install scipy

[@wongright]

Hey @thuvudataanalytics you may want to re-check home of your play ▶ lists 📃 don't have accidental 3rd party entries, ie the DSci Playlist has some yoga 🧘🏻‍♂️ & other unrelated posts. FYI. PS awesome tutorials!

[@miracleaniakor5393]

Hi, how can we make it more interactive. For example, If a node has multiple properties how can we visualize these properties by hovering over the nodes. Are there such functionalities associated with the graph visualization tool?

[@beerus553]

amazing

[@abimbolaobadare6691]

This is an awesome video. Thank You so much for this. Pls can you recommend books on Social Network analysis for me. I want to get started.

[@Thuvu5]

Hey Abimbola, thank you for your comment, I really appreciate it! I mostly learned through projects and haven't actually read Network analysis books, but this one seems very good rb.gy/ahjqgu

[@mrchief3383]

Please make a tutorial about association analysis!!

[@ethanblackthorn3533]

Cool video

[@Thuvu5]

Thanks Ethan 🤓

[@gersonadr2]

Very cool !!

[@BehraamBaqai]

I wonder how someone could come up with a way to parse Ciri vs. the false Ciri from the text.

[@Thuvu5]

That’s a very interesting question! 🤔 I actually don’t know how to distinguish the fake Ciri. I was really mad at her at the end of season 2 as she killed so many witchers 🤦‍♀️

[@BehraamBaqai]

Honestly you'd have to use context clues and use outside information to know. I wonder if they'll even put her in the show. The books are a more elegant story than the show 🫣

[@RatafakRatafak]

Why was the whole NER (NLP) part necessary, if the character names were already identified via scraping? Wouldn't it suffice to just loop over the tokens of the book and select for each sentence the token if it is found in the list of characters?

[@mert8984]

Hi, your video was awesome, but i have question to the pyvis graphics. I have the problem that the nodes moving extremely fast and i cant fix that😢 can you help me? I use exactly the same code only another dataset.

[@rockcaesarpaper291]

Thank you very much Madam.

[@Joorin4711]

Maybe I misunderstood something but if [A, B, C, D] appear as characters in the window, shouldn't you create the relations A->B, A->C, A->D, B->C, B->D and C->D? In you example there are fewer pairs.

[@Thuvu5]

Hi Peter, no it's actually A->B, B->C, C->D. But you could also argue a different way to define the relationship :)

[@namanluthra7253]

Is the next video on graph analytics out?