Getting Started With Hugging Face in 15 Minutes | Transformers, Pipeline, Tokenizer, Models

Learn how to get started with Hugging Face and the Transformers Library in 15 minutes! Learn all about Pipelines, Models, Tokenizers, PyTorch & TensorFlow integration, and more!
Get your Free Token for AssemblyAI Speech-To-Text API 👇www.assemblyai.com/?...
Hugging Face Tutorial
Hugging Face Crash Course
Sentiment Analysis, Text Generation, Text Classification
Resources:
Website: huggingface.co
Course: huggingface.co/course
Finetune: huggingface.co/docs/transform...
▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬▬
🖥️ Website: www.assemblyai.com
🐦 Twitter: / assemblyai
🦾 Discord: / discord
▶️ Subscribe: kzbin.info?...
🔥 We're hiring! Check our open roles: www.assemblyai.com/careers
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Timestamps:
00:00 Intro
00:40 Installation
01:02 Pipeline
04:37 Tokenizer & Model
08:32 PyTorch / TensorFlow
11:07 Save / Load
11:35 Model Hub
13:25 Finetune
HuggingFace Tutorial
HuggingFace Crash Course
#MachineLearning #DeepLearning #HuggingFace

[@xade8381]

eyebrows are talking in there own language

[@yami007]

😅

[@violentfox]

You mean German?

[@socialtraffichq5067]

Actually the eyebrows are communicating and Morse code and the messages I'm being held hostage help me escape exclamation

[@johnjay2455]

Hahaha I love KZbin comments

[@Paperbutton9]

yeah what the hell going on here

[@yangsung]

I love the fact you're smiling like a genuinely happy individual. Good vibes. We need more that in the world.

[@10xFrontend]

That is because you cant see the gun behind him....

[@canyahandle]

@@10xFrontend Cuz he is using Happying Face,,,

[@clintl326]

Thank you for this introduction! The Finetuning part at the end was a little fast, so I'll be checking out your other videos to learn more. Thanks again.

[@theonerm2]

I've been trying to figure this out for days and in the first couple minutes of the video you helped me a lot.

[@sarapicciau8906]

Thank you for this quick tutorial! It's exactly what I was looking for :)

[@erfanshayegani3693]

Great and concise explanation! Thank you so much!

[@joseluisbeltramone599]

Awesome summary / introduction. Thank you so much!

[@sumowll8903]

This is a very helpful introduction! Thank you so much for putting it up!

[@AssemblyAI]

Glad it was helpful!

[@echofloripa]

Thanks for the tutorial! In only 1 year we came from 34K models available to almost 300K models, almost 10x increase! 😮

[@ThomasPrivat]

What an awesome introduction! Thanks a lot mate! 💪

[@SebastianSastre]

Thanks for making this task more inviting. Now I definitively want to know details on the hot-to do the fine tuning over custom content

[@jyim0310]

I like your clear voice, easy explanation and smile.😄

[@kahwatv]

This is awesome. Thanks for the excellent walk through transformers library

[@akshpatel1321]

He covered each details for a beginner and its great.

[@knkn5049]

I cant invent by myself, how to save history of chat for conversation

[@CezarVasconcelos]

Amazing explanation. Thanks for sharing your knowledge!

[@bernds.2986]

Very helpful tutorial! Many thanks for it! By the way, you speak very clear English and that is extremely helpful for me as a 'non-native speaker' 😊

[@rayfincle2466]

Excellent tutorial. Cannot believe only 3.7k likes for this. I recommend typing the code out in vscode or other and running in parallel while watching the video.

[@ElNachoMacho]

Exactly what I was looking for. Thank you for sharing!

[@satyamm9901]

Man such a cherpy guy. I loved your energy. Thanks for the video.

[@sergiofigueiredo1987]

Simple and straight to the point!

[@being-awe-some]

Thanku so much for putting together important things in an easy way. Waiting for more of such videos from you.

[@user-ms3nf6tv6h]

Thank you so much for the tutorial. It was very helpful. The explanation was precise and concise!

[@user-jm6pi1en7g]

Thanks for clearly explained tutorial !

[@EricSchroeder-cc4hf]

Totally appreciate this, thank you - had to install tensorflow==2.13.0 and kares==2.13.1 - worked great

[@ykoy1577]

Great lecture. Thank you for sharing your knowledges

[@user-yh4mk4sd8y]

It's the best tutorial I've ever see. Thanks!

[@harsh9558]

Awesome tutorial, to the point 🔥 Thx a lot man!!!!

[@bendev6807]

Thank you very much for the very informative video and the great examples.

[@peterdonnelly1074]

This is a superb tutorial. Many thanks.

[@saibharathwajsaikannan3783]

This is amazing! Thanks :)

[@vanshshah8352]

What a sweet guy. Amazing work

[@ferdaozdemir]

This is fantastic I hope you can make more videos covering other pipelines for HuggingFace transformers package.. Many thanks.. 😀

[@nagibgonzalez5645]

Great video! Do you know how I would be able to view a classification report and confusion matrix of a sentiment analysis pipeline?

[@brillosan08]

really useful intro, thank you!

[@razdingz]

love ur vids man

[@Amir-ee8mc]

Nice summary! Thanks!

[@alternbits]

complete and short. awesome.

[@juliank7408]

Thanks! Clear and informative

[@abhijoysar]

Thank you very much. It has been super helpful. Huggingface is the best thing I discovered this year.

[@kahwatv]

What are you working on ?

[@abhijoysar]

@@kahwatv I am building an AI system that can code itself.

[@kahwatv]

@@abhijoysar That's interesting (and ambitious). Would be interested to learn more by if possible.

[@JoshuaFurman-nd1os]

Great explanation, danke!

[@BDEvans]

This is a brilliant video!!!

[@metamatt7257]

Hey! Thanks for the great tutorial. How can you make the AI remember the full convo, so it remembers the outputs it gave? For example it says my name is Andrew, but then will say that it's name is Anna when asked again Sorry if its a dumb question:D

[@user-dn1uh5zq7u]

I love this video, very useful!

[@ChikereEzeh]

brilliant!!!

[@manisharya2138]

you are eye blinking that's awesome 😊😊

[@mauroinde]

thanks for using VSC, it is a better good feeling for me

[@krinodagamer6313]

THANK YOU!!!

[@TheRealKitWalker]

Dude I so love you❤ for making such useful videos😊😊😊

[@debatradas1597]

thank you so much

[@skyforever1000]

this is way more better than what AWS guys do ...

[@JaimeZX]

I enjoyed the video but perhaps need a "100-level" one with specific use-cases and how you would plan out your development and configuration to get after that use-case. :)

[@MuhammadKhan-ok3hf]

outstanding, Thank You

[@ahmedelsabagh6990]

Great video!

[@shahab7363]

great video! Thank you

[@matthiasdenhamer3925]

Very helpful, thanks!

[@AssemblyAI]

Glad it was helpful!

[@giovanniguerreiro8640]

Great intro video!

[@ferdaozdemir]

Hi, I want to use tokenizer along with some other AI models(not decided yet). I have a set of files of text (source code). They are already classified for multiple attributes. Such as file A has x and y true, file b has x true y false.. Regarding that I have two questions. 1- I want to tokenize the file contents but in my case not single words but groups of words (such as groups of 3, 4 tokens) makes sense. So, I want to tokenize in a way to group those sets of words if that is possible. 2- Each file would have different lengths, thus different number of tokens. How can I use these sets of mergedtokens for prediction. I mean what is the best AI technique to use afterwards to prepare a model for prediction?

[@antonioanerao]

I'm watching this video in October 2023 and it's so cool to see that now there are 376,348 models

[@stanTrX]

3:01 i understood up to this point,the first example 🤗

[@_virtualbeings_]

Still the best intro to HF in my opinion! PS: would love to know which theme is used in VS Code, it's great.

[@Shahrose-Khan]

I think it is Night Owl

[@zoyaa9759]

The best explanation

[@AssemblyAI]

Glad you think so!

[@rajkumar3433]

This should be on hugging face

[@ajaykryadav]

Too good 👍

[@naedeezy8967]

Bro gives off good vibes

[@allgoodstufftoknow7000]

greate video! thanks!

[@razdaz5306]

Ur best teacher

[@AssemblyAI]

Thank you :)

[@fernandofrias8322]

muchas gracias!!!!

[@macaunutritionassociation]

im running windows on my PC is there any problem downloading Linux and the other codes you described?

[@Shiny_Mewtwo]

Nice

[@generichuman_]

Do you know how to use the BPE tokenizer and have it keep the spaces? I've tried every combination of parameters imaginable and my transformer always outputs a string with no spaces.

[@josephpareti9156]

do you have a repo for the code shown in the video?

[@hernandosierra8759]

Gracias

[@meirgoldenberg5638]

Is there a pipeline for translating a text into a dense vector representation?

[@caiyu538]

Great. 🎉

[@steveopenn]

Do you run this and visual basics?

[@fahadasif638]

your smile is so cute😍😚

[@Blooper1980]

NOICE!

[@arachnaut2432]

what app did you switch to one minute in?

[@mellio19]

what software are you using i love the interface so streamlined i'm using jupyter notebooks

[@mellio19]

its ok i found it visual studio thanks 🙂

[@rzl1025]

What is the best natural language model for answering multiple choice questions in mathematics? CHATGPT is not so good at this..

[@huseyinsenol1769]

I hope one day you will fix your pip install problems.

[@daveckw]

for other models, sometimes i get something like below: pytorch_model-00001-of-00002.bin pytorch_model-00002-of-00002.bin How do I make them into safetensor format so it can be loaded into the webui?

[@jbperez808]

How do you get VS Code to show the completions (in a python virtual environment)?

[@knkn5049]

2 questions : i get some warning about "right padding", dk how to fix it. I was trying to use conversational pipes but why they are such trash? 50% of times they just repeat, and cant do anything about it. Send help.

[@aeigreen]

it took be entire day when i read doc and implement ,, while i sould have learn the same in 15 mins.

[@meirgoldenberg5638]

It says that no model was supplied and it's using a default model. Did it actually download that default model or used an API to connect to it remotely? If it's the latter, is that free of charge?

[@ashj1165]

thanks for this video. But towards 11:32 timestamp, why do we save tokenizer as well? Isn't it a static module that we can simply import again?

[@crassflam8830]

Tokenizers can be rather complicated; in many cases they're learned/trained; you'd want to save after fine-tuning them (and just to have them offline i reckon)

[@user-wr4yl7tx3w]

How come I didn’t see any labels data used for training or fine tuning in your examples?

[@tanusri11a84]

can i use these transformers for commercial use

[@alvarobyrne]

one level of abstraction inside 6:07 tokenization 8:22

[@user-bg1ef9xc9v]

Can you please help explain what to do if you have a Mac OS and your Jupyter Notebook keeps crashing when you try to import pipeline from transformers? The kernel keeps dying.

[@CodySmiley]

Tutorial for peoples already know Transformers, Pipeline, Tokenizer and Models :)

[@balrajvishnu]

What is the app you are using to code

[@venes3713]

Is it safe to send proprietary data on hugging face APIs?

[@MyMusicNow23]

외국어로 듣는데 왜이리 잘들리지.

[@yinghaohu8784]

I like your smile

[@haralc]

How to do text generation without the pipeline? I'm not sure why everyone everywhere is doing sentence classification.

[@peepdaslan984]

So you not going to show us how to install the pytorch, tensorflow, or flax? #ijs

[@ravipaliwal4041]

I am using a gated model and I am getting authorization error in JS can you please suggest me some resources to add authorization

[@nat.serrano]

ModuleNotFoundError: No module named 'transformers' how can I fix this?