FASTER Inference with Torch TensorRT Deep Learning for Beginners - CPU vs CUDA

[@lukajeliciclux3074]

Great video as always. One advice: in the newer versions of Ubuntu apt-get is replaced with apt because apt-get is deprecated and apt has better performance. Everything stay the same while installing things but instead of apt-get you will use apt.

[@PythonSimplified]

Thank you so much for the tip and for the lovely comment Luka! 😀😀😀

[@abdallahessam4671]

I have a graduation project in which we will use Pytorch and NLP, so I want your support because your videos are so amazing and simple, we want more

[@PythonSimplified]

Thank you so much Abdallah! 😁 NLP is absolutely fascinating! I think I have a repository on Github that might help you with your project: github.com/MariyaSha/StoryTeller It's a Pytorch Word Embeddings model that was trained on children books/fairytales and it predicts an entire story once you select the first 5 words 😉 It's a fairly stupid network, I must admit hahahaha, but if you're having issues with some of the processes - you might find a solution there. I also believe that's the network I cover in this tutorial: kzbin.info/www/bejne/o6vFe5dmg82KaKM (It's one of the first videos I've filmed so my apologies in advance hahaha 😅) Best of luck with your graduation project! let me know how it turned out! 😀😀😀

[@abdallahessam4671]

@@PythonSimplifiedThank you very much, I really watched the whole playlist and benefited a lot and we want more of your wonderful videos and it is my pleasure to tell you about my project

[@americovaldazo6373]

I love Python Simplified. All the tutorials are very well explained and the content is super interesting. Excellent work. Thank you very much.

[@PythonSimplified]

Thank you so much for the beautiful comment! 😀😀😀 I'm super happy you enjoy my tutorials! Will keep em' coming! 😊

[@buithanhlam3726]

This approach is much more simple than development in Anaconda environments. Thanks!

[@CoopmanGreg]

Every time, I hear you say "Holy Smoke", I have a little laugh (the only one I ever heard say that expression was my wonderful father and he was born in 1924). Your videos are great! ... very comprehensive and entertaining. Thanks so much!

[@trtlphnx]

Another Fantastic Preesentaion ~

[@PythonSimplified]

Thank you so much dear! 😁

[@freezoulou]

Nice Fantastic import video ..thanks again :) you have the best channel for learning

[@PythonSimplified]

Thank you so much! I've put some extra work on the installation portion in case some folks run into Docker issues 😉 How did you find Docker compares to Anaconda? I'm so used to Anaconda that I rarely try new stuff hahahaha 😊

[@freezoulou]

@@PythonSimplified me too I much prefer anaconda ...sometime you have to try new things ....it could be better :)

[@udbhav3760]

I don't use computer and laptop because I don't have xDDD But no longer it will happen I will purchase one! :) But yeah I'm liking it now coding from phone! Great video 💪🙌🤠

[@PythonSimplified]

Thank you so much Udbhav! 😃 I did mention your supreme phone coding skills during the livechat! 😉 Good luck with your PC/laptop search, let me know if you need an advice with hardware 😊

[@ardavaneghtedari]

Thank you so much for these videos. Is it possible for you to make another video on how to run the opener Whisper model in TensorRT for near real-time transcription of voice-to-text?

[@MrMolekula]

Thank you so much! Your video helped me to manage with TensorRT!

[@clashclan7549]

Thanks for providing best contents.

[@PythonSimplified]

Thank you so much! 😊

[@legendarystuff6971]

This is awesome! Thanks ❤️

[@return_1101]

Love you very much! Like your content! Its great!

[@PythonSimplified]

Thank you so much for the lovely comment Andrei! 😁

[@verdirossi21]

Não entendo nada do que fala mas adoro ver você falando.

[@PythonSimplified]

hahaha obrigado! Eu gostaria de poder falar português... por enquanto tenho que confiar no Google Translate 😅

[@verdirossi21]

@@PythonSimplified Parte do que disse foi brincadeira, apesar de não entender o que fala, eu sou programador (Python inclusive) e aproveito bem seus exemplos. Obrigado.

[@khetimachinery1336]

Thanks for making this video. I was looking for this information. Excellent presentation.. keep posting new videos. please make one video on jetson with torch-tensor RT. Do we need to follow different commands or simply this tutorial will work with jetson.

[@diwakar_tsn]

Lol! I missed yesterday 😅 🔥❤️❤️

[@PythonSimplified]

Hahaha no worries, attendence is only recommended 😉

[@Mr-Double01]

I'm in Love 😂❤️

[@Joaogtv]

Excelente conteúdo. I love you

[@PythonSimplified]

Thank you so much Jose! 😁

[@DJDozyDoh]

Very nice content well explained and perfect for beginners

[@sushrutikarthik2540]

Thank you for great video. Really appreciate this. What is process you follow for shooting/editing videos? Also please suggest the gear you use for shooting videos.

[@PythonSimplified]

Thank you so much Sushruti! 😀 If you're just starting with making videos - I recommend to only get a nice microphone and some lights. You can start with your phone camera and connect it to your computer with Android's IpWebcam (I actually used it in a tutorial a while back: kzbin.info/www/bejne/i5WmhJyQh52rj7s ) Then I use OBS Studio to combine the screen capture with the IpWebcam stream. You don't really need a green screen at first - but it's definitely nice to have one somewhere along the way 😉 To use a green screen, just add a "chroma key" filter in OBS and set it to green. And of course as you move along you can invest in a fancy camera and go from there - but the key note is to start with the tools you have and keep expanding 😜 In terms of video editing, I use the Adobe Creative Suite (a combination of Premiere, Illustrator and Photoshop). And you can find open source alternatives as well (Kdenlive instead of Premiere, Inkscape instead of Illustrator and Gimp instead of Photoshop) which may be a better starting point. My first few videos were edited with Windows Movie Maker (which was unfortunately discontinued when Windows10 has arrived) Best of luck on your new video making journey, let me know how it turned out! 😁

[@siddharthagrawal6990]

One important thing is that simply tracing also improves inference speed by 2x often. So I am unsure if the TensorRT is actually adding much additional speed for how much more of a nuisance it is to install.

[@kesavguru415]

Can you make video on how to create Windows Application with Python?

[@fosskingdom]

It is already out.

[@PythonSimplified]

I already have a bunch of videos for that, Kesav 😊 1. A Simple Greeting App with Kivy: kzbin.info/www/bejne/j3XTaGaNn7N8icU 2. A trivia game with PyQT5: kzbin.info/www/bejne/b5q9fXekjMSprbc 3. A simple SMS Spam filter with DearPyGUI: kzbin.info/www/bejne/aIPSlIuBhbWratE 4. A PDF Reader with Tkinter: kzbin.info/www/bejne/n6W1fYWcqrGShrM All these are Python Desktop Application tutorials, so you have lots of things to investigate now! 😉 Good luck and have fun! :)

[@ardavaneghtedari]

Thank you for this excellent video. Do you have time to make another video on how to convert WhisperAI models to TensorRT for faster (i.e., near real-time) conversion of voice to text?

[@imai_official]

This first video about trt tutorial. Could you try convert yolov5 models, will be good

[@PythonSimplified]

I haven't had a chance to work with yolov5 before, but if I see a few more requests on it - will definitely film a tutorial on the subject! 😉 Thank you so much for your suggestion! 😀

[@fadl999]

You nailed "Habibi"😂

[@collinslife7021]

Very Helpful

[@PythonSimplified]

Thank you so much Collins! Super happy to help! 😃

[@collinslife7021]

@@PythonSimplified absolutely your lessons have saved me a lot of time and I have learned so much, very grateful

[@MohnishP-t6n]

You have my subscribe!!

[@tonyc2227]

Which instance type are you using ?

[@seyeeet8063]

Do you think you can make a crash video on how to from scratch install and use docker on a deep learning simple project and then how to provide it for the user to use it? I never got it how to set and use and deliver docker....

[@PythonSimplified]

Sounds like a great idea! 😀 If I see a bit more requests on it - will definitely film a Docker dedicated video (similar to the Anaconda one 😉) Thank you so much for suggesting! 😊

[@dantec.dagandanan3732]

very nice, but maria what version is your ubuntu?

[@Nurlan_Turganov]

Thanks!! Clear!

[@rustybolts8953]

Why zero predictions for Mafia cat?

[@MustaqimAdha]

Is it applicable for NVIDIA Jetson Nano? What machine and GPU are you using?

[@yeswanthgowd6102]

Can you share a video on inference of large transformer model from huggingface on Multi-GPU with TensorRT

[@arturovalle5990]

what a big monitor you have

[@ajithkj5253]

Hi. I tried doing second approch of installing tensorrt. Jupyer notebook is not launching though i changed from hostname to localhost. Its still saying this site cant be reached. Please can you guide me what to do here????

[@hamoudimaghoul3407]

👍😉

[@Agronomistapolo]

Could you do a tutorial using Jetson Nano?

[@carljames9654]

Hi there, gr8 video! can i ask what gpu server you are using please? because i have a project that grabs a frame from a video, then sends the image as base64 to a ubuntu server with tensorflow serving server using flask. The problem i have is that it takes 30 seconds to inference the image and send the data back. The server is just a CPU server, but looking at renting a GPU server seems to be way to expensive. Do you have any thoughts how I can speed this up?

[@LegitKev.]

You so good at this. How long have you been coding for ?

[@karann6010]

Facing cuda out of memory issue when I call the model which is loaded in GPU memory. The GPU doesn't free memory

[@PythonSimplified]

Try restarting the kernel and then give it another go. Otherwise - are you trying to load the entire dataset at once? or are you loading it in batches? if batches - decrease the batch size. If not - load the data batch by batch instead! 🙂

[@karann6010]

@@PythonSimplified thanks for ur help. The issue was there was no context manager torch.no_grad() used when doing foward passes to the model. With this change it released memory.

[@MohnishP-t6n]

Can you please make a tutorial on DOCKER? Thankyou

[@sharkyigor]

@pythonSimplified, Thanks for your great videos! would it be possible to make a video about openvino? what it is, and what benefits it brings?

[@olzh6285]

Perfect

[@WebWise_Wallet]

when will u work on django

[@artyomkolas6850]

3% - carton because your image has brown color subject like box and a lot of straight lines. it's 3%🤗

[@learnwithmunir9291]

Make a tutorial on hand written Character recognition

[@ChristianRodriguez-ou2qy]

Mariya thanks for everything, you are great!! please if you can do the same but with Windows I would appreciate it very much!!! :p

[@codewithyouml8994]

Better to get wsl on windows and do the same

[@Kennethlumor]

Please and please I request you make video on how to use multiple databases in flask

[@hrishikeshkrishnakumar1443]

Can you make a Rust tutorial? 🙏🏽

[@PythonSimplified]

I haven't had a chance to work with Rust yet, so I'm probably not the best person for the task... 😅 But I've just stumbled upon a Rust tutorial recommendation on Discord, you might find it helpful: kzbin.info/www/bejne/sHeWZZeIntt_hdk

[@mohamedlaminekartobi5732]

Hey ! Thank you for video ! I really appreciate your tutorials. I'm just thinking that maybe the title of the video doesn't sound totally correct in fact that TensorRT is based on CUDA and it runs only with NVIDIA GPU, so for comparaison you can say Torch CPU vs TensorRT GPU Both of PyTorch and TensorRT are deep learning framework, CUDA is a parallel programming language for NVIDIA GPU's and ofc CPU and GPU represents hardware for training or inference

[@renanmonteirobarbosa8129]

we need Transformers

[@mohammadjavadebrahimi5895]

yeah Im just starting machine learning if your beauty let me to concentrate

[@nowgamertv4148]

А что там в Канаде случилось ?_?

[@PythonSimplified]

Ludi hotiat svobodu - provitelstvo ho4et rabstvo 😢 Neskolko dnei nazat oni zaiavili voenoie polozeniie iza tovo 4to dalnoboishiki bostuiut v Ottawe... oni sei4as v turme. takovo ne kogda v kanadskoi istorii nebilo, voenoie polozenie eto tolko dla voini protiv drugih stran - ne protev nashih ludei... tak 4to vse v shoke! Interesnie vremina... eto to4no! 😅

[@Yachid]

Mariya~, (?) RU caught up near thoze Trucker 'eventz'; &, (?) what R y'r thought'z on that... ShoutOut from @ Michigan

[@PythonSimplified]

You know I can't talk about it on YT... 🙃

[@Yachid]

@@PythonSimplified Ya, I get that... who'da thought 'in the West' we'd loose 'FREE Speech' & have to bight our tounge'z!

[@PythonSimplified]

Good always wins evil, even in the darkest of times! Stay positive, determined and don't let them drag you into hatred. We're all on the same side - it's just that not all of us realize it yet 😉

[@Yachid]

@@PythonSimplified Deep,

[@Yachid]

@@PythonSimplified unReleated, could U do a video show'ng how to covert between number bases, w/Lg numbers, & w/'fractional-number-parts'; in my prj I waz us'ng Excel { base() }, but it iz limit'd to integers & to a certain range of values { I think (2^53)-1 }, I was just think'ng perhaps Py may be a better choice; specifically, I want to go from base 10 to base 24. & of course, y'r ML video waz great, az alwayz

[@Mouazbrai]

I'm late back, looks like you've been busy with the Ukraine crisis, I hope you're fine

[@PythonSimplified]

There's actually an exponentially bigger crisis in Canada... 😅 (and I wouldn't trust the news for reliable information in any shape or form, ask people who you personally know and live there - you'll get a very different angle, trust me)

[@Mouazbrai]

@@PythonSimplified We always wish the two countries well, however welcome back

[@nowgamertv4148]

Привет у тебя Вк есть ?_? Ну в контакте ?_?💖

[@PythonSimplified]

Nea... u menja bil kogdato dovno, no uze ne pomnu parol i "username" 😊

[@unknownfacts3716]

Mam love your content, but I have one question. You are already so cute and beautiful then why do you put that extra makeup

[@PythonSimplified]

why not...? does it really matter?😜 You would very rarely see people who go in front of the camera without makeup... even guys! (especially when filming in 4k quality... every little flaw is captured by the lenses)

[@unknownfacts3716]

@@PythonSimplified yeah that's true even we boys also put a lot of makeup but I must say that I have never seen a teacher as beautiful as you are, God bless you and may you accomplish all your goals 😇♥️

[@angvuhai964]

how the hell she could remember all the command :v

[@faresbadr2624]

hi my sister. please I want to learn how to scrape full data from Facebook like email, phone number and convert code to user interface please............. please......... please............ thank you

[@KatySei]

Love this channel. I have a little question, why in kzbin.info/www/bejne/n3ekdaaIea-beq8 the dim=0 and not dim=1?

[@mmhshazin6155]

What is your name dear??

[@adilkhalid6625]

The attendance program through facial recognition was working without any problem, but suddenly it started giving the following error how can i fix ? module' win32 com has no attribute 'CLSIDToClassMap AttributeError: module 'win32com.gen_py.00020813-0000-0000-C000-000000000046x0x1x9' has no attribute 'CLSIDToPackageMap