Sentiment Analysis with BERT Neural Network and Python

[@sahilsmohanty2663]

These kind of content is what most budding ML enthusiasts need. Thanks for this

[@NicholasRenotte]

Anytime, so glad you enjoyed it @Sahil!

[@madhu1987ful]

@@NicholasRenotte Hey, pls do a detailed video on Beautiful Soup. Also my request is pls make a video on other NLP usecases - text summarization, topic modeling, NER, text generation, Q&A with pretrained models (BERT, ROBERTA, GPT and so on)

[@abrh2793]

I love how you take your time to explain each sentences and what they do! Absolutely love it! Very helpful as a beginner! Keep up

[@jlsfjl]

Really my compliments (sentiment score=5!). I started this video with fear, because I had never done sentiment analysis and suddenly we need to do that now for a school project😠. But man, so easily and well explained, I feel amazing right now, happy to work on my project!😃

[@satoshinakamoto5710]

Thanks again for this tutorial Nick. My challenge is to 100% finish all your tutorials. 3hrs, 5hrs, 8hrs, 100hrs. all of it.

[@sebastianzapata9368]

amazing video! I mixed the content from your code with a csv file that I got from extracting tweets and now I can do a sentiment analysis on so many subjects! Thank you!!

[@JcOnAFieldtrip]

hi im trying that as well, did you convert your file to a data frame like in the video?

[@superrelaxation508]

brother I wanna say that your videos are very easy to understand and along the way to follow practically in our computer please make complete course on NLP and OPENCV And Machine learning because you are very good teacher I very like you god give you long life with a lot of happiness

[@bhavikdudhrejiya852]

Your channel is a treasure for Data Scientist.

[@hemalshah1410]

BERT with multilingual benefit is great advantage for analysis of text (especially with large-diverse dataset ) . This is enlightening ! Thank you Nik

[@raznyrazeek]

You are a life saver man. i was stusked with my research. you saved me.. i understood the basics. Thanks

[@MugdhaKshirsagarDS]

This was a really helpful one. Thanks for the step by step and detailed explanation.!👍

[@thaGkillah]

Hey Nik! I've been looking left and right for a guide on how to interpret the logits from BERT and thank god you've uploaded something that explains it well! I liked and subscribed. (Maybe you could refer me to a source, where you happen to learn it? - looking one for the FinBert variant) Also, your crash course on that scraping part is straight on point and I love that you executed each line from it to show you how it gets transformed. You are truly blessed with an out-of-this-world tutoring skill!

[@NicholasRenotte]

Thanks sooo much @Capt_Kaplan! I'm kinda just doing a lot of googling to learn it atm, there's heaps of examples of custom models in the HF model repo though, check this out: huggingface.co/ProsusAI/finbert

[@Michael-dl4sj]

Awesome video! If its to the extend of your knowledge, a subsequent video about fine-tuning a pre-trained model to a particular dataset would be very interesting. So train, test and validate the accuracy of a model pre- and post-training. I have read some articles which showed accuracy of a model can be improved significantly when trained on the particular dataset.

[@NicholasRenotte]

Definitely, plus the models become a lot more practical when tuned to your use case. Definitely will have a series of tutorials or one mega tutorial coming on it soon @Michael!

[@khouloudsafi1445]

@@NicholasRenotte did you make a tutorial about this issue already ? I couldn't like your video more,, it's simple, informative, short and just straight to the point :) Thank you

[@Aynold]

Hello Nicholas Reynolds, I am a college student, I like your video very much, I keep learning, you are my half teacher, thank you very much, look forward to more videos

[@NicholasRenotte]

Thanks so much! Stick around, plenty more mega courses to come!!

[@rolsondeleferme6825]

Very good pal. You keep it simple and at high level. I would be happy to see those two negative votes to elaborate further why they are not satisfied though..

[@seherkanwal245]

I love the way you teach. I'm going to do my final year project on sentimental recommendation system. This will help me a lot

[@pauliusjanuska4090]

Amazing video! Simple, structured, keep up the good work !!! P.S This helped me so much on my course lol

[@arjumann5480]

You made it sound so simple! This is apt for beginners like me. Thank you ^^

[@JohnM-ch4to]

Great vid! Not one of the more popular requests here but would be interested on a deep dive in building scrapers. It's kind of a niche topic since it's not the most exciting part of ML or Data Science but at least I get to throw my hat into the table. Haha. Looking forward to more vids =)

[@NicholasRenotte]

You got it @John, was planning on doing a live stream on it! But might put it into my Python for Data Science course that's coming!

[@sagara5982]

I'm a new subscriber.., loving ur videos already... Cheers man all the best

[@NicholasRenotte]

Thanks so much @First Attempt, welcome to the fam!

[@luizkrein]

Awesome video, now I need to find a Brazilian Portuguese trained model asap to test it. Thanks!

[@GauravKumar-xg4sw]

This is best content on bert .. loved the explanation ..

[@daniel_partida]

Excellent video explaining multiple concepts. Thank you for the great content!

[@madhu1987ful]

Awesome video, so neatly explained step by step --- thanks a lot

[@joe8ones]

Yes, i think a bigger web scraping tutorial would be beneficial

[@sebasgutierrezjuansgutierr3666]

Did he make a tutorial about it?

[@stefan6825]

Love this video! You have an amazing skill in teaching others and make it look so simple. I'm subscribing you and I guess on my journey learning python I will watch a lot of your videos. Thanks a lot!

[@francescue8128]

Awesome video. Simple and easy to follow. Thank you.

[@christophercrager1925]

Great video. Would love to see a scraping tutorial. Especially one where you could pass credentials and log in first

[@metinunlu_]

Incredible work, love your explanations. Thank you!

[@santiagobardelli5675]

Great job, Nicholas!

[@snehallande6718]

best video, very well explained

[@liamalam]

An excellent tutorial. Thank you much for this.

[@KDB17thaGoat]

Awesome stuff man, helping me on my project

[@PriteshRPatel-lr5uh]

really loved your video. Would like to see if you can do same video but for stocks such as NVDA or TSLA. Thanks.👍

[@rizf800]

exactly what i was looking for thank you you made my day🥰🥰🥰

[@Hamster_Off_Wheel]

Good conceptual video. I was your 1k'th like

[@dheerajchoudhury]

Love your videos bro 😉 Feel like lot to learn

[@NicholasRenotte]

Thanks a bunch @Dheeraj! Definitely always something new!

[@shabirahmed6510]

Great video! simple and quick to get good results thanks a lot!

[@muzammelmokhtar6498]

Very good explanation and content

[@NicholasRenotte]

Thanks so much @Muzammel! So glad you enjoyed it.

[@peterkhoo9606]

Fantastic explanation on all videos. just wondering whether you can do a video on sktime - installation, introduction, processes , etc. Hope to hear from you. cheerio

[@NicholasRenotte]

Haven't heard of it before, is that a timeseries lib for scikitlearn? Sounds awesome if so!

[@69nukeee]

Sweet video, loved it!

[@bertranddol]

Great content, great delivery .... overall great video

[@heisenbergwhite5845]

Would love a video on fake news detection. Thanks for teaching us!

[@NicholasRenotte]

Ooooh, yeah that'd be sick, I'll add it to the list!

[@heisenbergwhite5845]

@@NicholasRenotte Thank you Have a nice day

[@NicholasRenotte]

@@heisenbergwhite5845 you too!

[@dec13666]

Nice vid. It's an application of BERT, does not quite add much new science... But good enough for some hands on with it. Keep it up 👍

[@NicholasRenotte]

Yah, kept this one super high level. Can definitely get way further down into the weeds!

[@ameerazam3269]

Again best explanation

[@NicholasRenotte]

Ayyye, thanks so much @Ameer!

[@nimishbansal4752]

Great work bro..pls make a video on activity recognition using mediapipe

[@NicholasRenotte]

You got it!

[@krishnamore2281]

Thank you for making a video on this

[@NicholasRenotte]

Anytime! So glad you liked it!

[@ameerazam3269]

Appreciate your work sir

[@NicholasRenotte]

Thanks for checking it out man!!

[@celynraquel5982]

Amazing video!

[@subratasaha8820]

awesome explanation. however i have some questions, is text preprocessing included in the BERT model? and what is the thing with 'x[:512]' limitation?

[@leonvanpersi8044]

Thank you for the video. Can I run a content analysis on short Customer Feedbacks that's releable?

[@morningstar618z8]

Great tutorial thanks

[@sebasgutierrezjuansgutierr3666]

Awesome as always!! I really appreciated this. Did you finally made a web scraping for data science super tutorial!??. Please tell me you did!😃

[@ritajohn5102]

can you explain the advantage and disadvantage of using pre-trained model in our data?

[@RS-vu5um]

Excellent Video. Can you point me to the changes to be made if TensorFlow is used?

[@JC-xl5ti]

Awesome video! But, I was wondering if text preprocessing (removing punctuations, stopwords, lemmatization, etc) is needed before encoding the reviews? Appreciated if can get an answer

[@faizanyounas4799]

Yes, in the preprocessing we remove all the noise from the data.

[@asrikinantifebriany6228]

hey what a great videos, can you make a tutorial for sentiment analysis deployment to a simple web?

[@merakshitrading9216]

scraping a web page and using that data as training data within a chat bot would be very interesting.

[@DeliHunV]

Hey Nicholas Great Video!!! I was wondering if I could change the url in the code and give the class name of another website's comments other than YELP will it still work...

[@akshatkhanna2517]

Please make a video tutorial on Web scraping as well.

[@diveshbhagooli6631]

You’re the best around!! Thank you for this!! One question: is it possible to extract comments from a Facebook post? Thank you.

[@NicholasRenotte]

I think it's pretty tricky, FB is notoriously hard to scrape. Can probably get your own comments via the API?

[@rainymornings]

Hmm this is helpful for reviews but not for pos/neu/neg sentiment analysis, which is what I was actually trying to get some examples of regarding score interpretation.

[@owenhochwald506]

instead of using a lambda function for adding the review scores to the dataframe, would it be equally as good to use list comprehension to get a list of the scores then creating a new column out of that in the dataframe?

[@harryfeng4199]

What’s the logic behind setting the slice up util 512 when we were making our predictions?

[@RedCloudServices]

Love mito but had them on a zoom call - it does not work with streamlit app. Perhaps it does not work with any app outside of a Jupyter notebook not sure 🤷‍♂️

[@lowwwleechi]

Hi Nicholas, thank you for the video! It's really helpful for my work. Also, I have a question that is it a must to do text pre-processing by applying NLP model using deep learning? because it seems like you didn't apply any text preprocessing method for the raw text you've scraped.

[@NicholasRenotte]

For these models they're able to handle raw unprocessed input as they have a pre-processing pipeline built in @lowwwleechi. If i got sucky results I might add some additional pre-proc to improve the results!

[@lowwwleechi]

@@NicholasRenotte Got it! Thanks a lot!

[@naresh22081989]

Hi Nichola, thank you for this video. Good information 👍 I have a doubt, can it handle sarcastic reviews? Also don't we remove shop words from text data?

[@NicholasRenotte]

Ooooh, I doubt it tbh. You can definitely do stop word removal, I was just being a little lazy in this.

[@ajithnaidu6978]

Hi Nicholas , can you explain me how can I scrape rating of particular user from the webpage you mentioned

[@rolandohernandez6627]

Muy util. muchas gracias por la informacion. Saludos desde Mexico

[@ey5722]

Thank you so much. Your video is so helpful. Is it possible to make another one about how to do sentiment analysis with BERTweet for covid -19 tweets? Thanks again.

[@NicholasRenotte]

You got it! Working on a bunch of NLP stuff atm.

[@ey5722]

@@NicholasRenotte Did you make a video about BERTWEET? I didn't find it.

[@NicholasRenotte]

@@ey5722 nope, not yet.

[@fahnub]

Cool and informative.

[@henkhbit5748]

Multi-langual and Dutch too... A double Heineken for u🍻 Maybe another vid of text classification for different classes/categories based on Bert ( Bert-base, multilangual cased) Not specific sentiment but categorizing sentences/text into subjects like cars, beers,soccer...

[@NicholasRenotte]

You got it, actually started work on a mega NLP tutorial. Zero-Shot Classification would be perfect for that!! Can't wait to drink that Heineken this weekend, still hoping Hamilton beats Verstappen though 😂.

[@henkhbit5748]

@@NicholasRenotte Looking forward👍 Until this new season the F1 races were dominated by Mercedes. It is like running tensorflow with gpu versus tpu 😁 If Verstappen or other talented drivers got the same racing car as Hamilton then the competition would be more interesting .... But of course I hope Verstappen will win!

[@NicholasRenotte]

@@henkhbit5748 you almost had your wish this weekend 😂 if those tyres didn't blow Verstappen was on a dream run!

[@henkhbit5748]

@@NicholasRenotte Yes the anomaly detetection algroritjm of Red Bull could be improved and I think Hamilton has not trained with the rigt AI Gym RL algorithm 😎

[@NicholasRenotte]

@@henkhbit5748 😂 😂 😂

[@nandankakadiya1494]

Another great tutorial thanks man Have one question in this video we are able to extract reviews from page 1 only so how to extract reviews from all the pages? Thanks once agian

[@NicholasRenotte]

Could loop through the subsequent pages as well @Nandan! Would need to build a more sophisticated scraper for that however.

[@sitiauniamaram3422]

How to validate the output of the sentiment?

[@yussefleon4904]

Hello, instead of doing the first 512 tokens, aren't you just taking the first 512 characters? Lov your videos btw :)

[@interlightstudio1645]

Do you currently have a video that covers how to do this? ->> "Can't be bothered building a model from scratch?". i would like to learn how to build or fine tune BERT. thanks

[@diegotestdireco3494]

Great video, Is there a package for Spanish or only in English?

[@molmock]

Thank you so much !

[@wsr005]

Hi, I'm just learning NLP and it's totally new to me. Just want to know how to know how tokens / text can be passed for particular nlp pipeline? Thanks in advance

[@ashaoluayanfe7474]

Hello Nicholas, many thanks for the vidoe, how can one implement this code in tensorflow or what advantage pytorch has over tensorflow in Bert implementation?

[@monicaaraneda7462]

I have a problem: RuntimeError: Failed to import transformers.models.bert.modeling_bert because of the following error (look up to see its traceback): No module named 'torch.utils'

[@ghpkishore]

Can you make one on mT5 or m2m100 for language translation models and how they can be trained from huggingface. Would be super helpful for techies across countries where content is limited.

[@NicholasRenotte]

You got it! Got a ton more HF stuff coming as well.

[@nandakadibrayogasta3719]

the video is good, very petrified for ordinary people like me. but how to test the accuracy of the bert that is used?

[@ravikshdikola6089]

Can we add fully connected layer on top of that model to use it for other text preprocessing tasks 🤔

[@NicholasRenotte]

Could probably pass through the logits to a subsequent layer!

[@ghost_assassinz1877]

How would I fine tune this because right now im getting some inaccurate reviews. For some some reviews it is giving me 3 when it should be 4 stars or it is giving 5

[@pahadiasd5992]

@Nicholas Renotte can u help me or tell me how to apply word embeddings in BERT for text classification

[@melly-by8tm]

May I know if this support a multi-language in one sentences or in one review?

[@shanthiathisayaraj7833]

Awsome buddy

[@NicholasRenotte]

Thanks a bunch @Shanthi!

[@atharvagangil4860]

Hey! When I change the website to another one (like Amazon), it doesn't go with it. Please help me with it

[@AmirRoyaee]

Tnx for your useful video

[@Michael-dl4sj]

Hey Nicholas, is there any way of changing the bert sentiment score from 1-5 to a floating value between 0-1, similar to for example the vader sentiment score? Or do I need another bert sentiment model for this? Thanks in advance :)

[@NicholasRenotte]

Need another BERT model @Michael, this one is specifically trained to give you a binary value.

[@owaisahmad8336]

Amazing!

[@subhanbasha8813]

Hello Nicholas, Is it recommend to code all the machine learning algorithms from scratch so that I can learn math behind it or just understand and start to code?

[@NicholasRenotte]

I don't personally think so, I think it's more important to know how to use them as a Data Scientist. If you're looking to get into research however you would probably need a deeper understanding however!

[@msvirat143]

Nice video.. easy to understand many new term.... but I cant understand line 4, why we use this particular URL? And use them with data...how that useful?... Please reply

[@NicholasRenotte]

Which line? The installation line?

[@msvirat143]

@@NicholasRenotte No, Instantiate model lines!!!

[@NicholasRenotte]

@@msvirat143 oh those aren't URLs that's the reference to the model we want to load from the Hugging Face repository.

[@squadgang1678]

Can you do sentiment analysis using apache spark - pyspark mllib

[@mysticallybeautiful2368]

I am stuck as i want to add an input which will be predicted. So basically i want to add an input ( a user would write a line for which the sentiment should be predicted) but i am unable to write the code for it. Can anyone please help me.

[@adamarief5665]

how do i apply by using a dataset i collect from kaggle? like excel dataset. Do i just change the link or it has to be from YELP

[@chiranshuadik]

bert is too big (1GB for the one with good quality). What would be the best way to deploy it with my django back end? Any recommendations?

[@NicholasRenotte]

Deploy it as an API or use a pre-hosted instance (they're available direct through HF Hosted)

[@chrisfig2387]

Hello Nicholas!, i got a question is there any ML that can extract keywords from a text?

[@NicholasRenotte]

Could use Named Entity Recognition to extract keyword types. If you're just looking for specific keywords you could just use a find function!

[@chrisfig2387]

@@NicholasRenotte Thank you, love your work!

[@eliasgodifay8703]

How can you make a sentiment analysis on languages other than English ?

[@yeast1103]

Thank you