Deep Learning Frameworks 2019

[@motog9464]

Never fall in love with a single framework. I used keras, tensorflow, pytorch and deeplearning4j because in enterprise it matters. Thanks Siraj for this comparison.❤️👍

[@nagendrapp2213]

How to start learning deep learning can u suggest me the correct path

[@motog9464]

@@nagendrapp2213 Siraj shared a very good path on his channel.Just follow it and if have any problem then let me know :)

[@wayneisthebestable]

Did you learn all of these frameworks before you find a job?

[@nkhullar1]

@@nagendrapp2213 Only one book is suffice deeplearningbook.org/ if you are good in Mathematics period. Frameworks are just sugarcoats on actual concept. Also, if you want to start something easy yet informative: Deep Learning with Python by my favorite Author François Chollet. As regards to Videos and Online courses, I believe books are boring 'initially' but they provide solid foundation (so start with books).

[@ZombieLincoln666]

deeplearning 4 jews

[@WillStewart1a]

Best 13 minutes I've spent all week, kudos on zeroing in on a number of the key points!

[@wolfisraging]

I loved tensorflow, keras and pytorch. But now I am loving mxnet. And the reasons are: 1. Extremely handy and flexible for research due to its imperative nature (like pytorch), which is so much essential for prototyping and debugging, even for optimization. 2. Insanely faster than any other framework most of the time. Especially when batch size is above 64. 3. Also supports declarative approach (like tensorflow and keras) for light speed execution. 4. It's the only framework that supports data parallelism insanely and easily like no other framework. It's just so so beautiful. 5. And the most important reason why it's the best framework on the planet is that "you can convert your imperative code to declarative" which makes your execution 2x faster. 6. And obviously it has unbeatable aws support So basically the road map is you can debug and prototype in imperative nature which is awesome and very handy, and when you are ready to deploy just convert your code to declarative by hybridising it. The most important challenge for mxnet is tensorflow, which has already captured the market. I used to be a dead tensorflow fan, but since I used mxnet................ You know what I want to say

[@WillStewart1a]

7. Gluon! (touched on tangentially in 1, 3, and 5)

[@humanintheloop_official]

As a ML engineer I love using PyTorch both for development and production 🔥

[@Frankthegravelrider]

It's honestly pure supprising the number and depth of ML libraries. It's an astonishingly the productivity of people in this field!

[@bobsalita3417]

fastai is an unfortunate omission. It's benefits are; intended to be an AI practitioner's dream framework; more powerful than Keras, easy to use, concise for teaching ML modeling, internally uses pytorch libraries, great momentum, Apache Software 2.0 license. Disadvantages are it's new.

[@seanspicer516]

uhhhhhhh. fastai is a course? @least when i took it (iteration2), it was. used tensorflow and pytorch (or keras, switched from 2to3).

[@seanspicer516]

@Onward hmmmm. well whatever the case may be. i had to check up on that and indeed you are correct. fastai is a unique resource. unique in how practically helpful it is. really cant think of anything that uses a similar method. students from the class get top ranks in _real_competitions_. there is an active effort to communicate well (i.e., the "teacher" actually values skills in "teaching"). you get this library. but its just the effort going into making the resource valuable thats so different. e.g., i did not know swift was good for machine learning. if you had said that to me before, i'd say "thats random". just random.

[@shalabhsingh5007]

So finally I was able to watch a Siraj's video at 1.5x today. So proud of my achievement!! Old subscribers of Siraj's channel can relate.

[@mcgil8891]

Same bruh, same

[@alberjumper]

Coming from TensorFlow (and Keras) and then debugging DL models with Pytorch feels like magic. I love dynamic computation graphs but static are tough as vikings 💪🏻

[@perlindholm4129]

Chainer is very unique in that it you can code with it even from a mobile natively. Uses numpy so you will always get it installed on any newer or older hardware. You don't need expensive new hardware. Thats important as an educational tool for schools. Basically If you want to spread AI spread chainer. Or get the others to use numpy

[@KaushalyaMadhawa]

Yes, his description of Chainer is completely wrong. Chainer is the only framework which strictly follows numpy syntax. BTW, PyTorch's autograd started as a fork of Chainer :-).

[@perlindholm4129]

Just want to say that I think Siraj is really good anyway. Machine learning is important to the future

[@phanuchoomsit2762]

I'm very successful with ChainerCV.

[@asiddiqi123]

Even Rani Mukherjee would never have thought of labeling as TENSORFLOW!

[@bayesianlee6447]

who thinks 'pytorch' is the most nice one? thumbs up!

[@rakeshsinghrawat99]

👍

[@maudentable]

Pytorch is awesome.

[@ChowChow414]

It's really convenient. I do really like Vanilla Tensor flow once I have a prototype hammered out, though.

[@kellyfj]

I prefer Keras

[@piby1802]

GO Fk URSELF KERAS ALL THE WAY BITCHES!!!! CHECK OUT ITS FUNCTIONAL API AND THEN TALK TO ME

[@ravishankar2180]

If you are a beginner and expert in python, use pytorch.

[@bloodaid]

Are you a mindreader? I was just googling for what framework or online service to use. I'm finally starting my very first AI project. I'm a music producer and I want to make my life easier as a music producer so I want to create a tool that would help me tremendously. You've inspired me a lot, Siraj.

[@mediocrecoder6184]

I've been playing with PlaidML owned by intel, accepts either Keras or ONNYX front end and most importantly works with AMD GPU's and integrated GPU's on windows for those that own an Nvidia or no GPU at all. Defo worth a look

[@teetanrobotics5363]

Best Deep Learning Frameworks Comparison video

[@mariogalindoq]

I has been using MxNet, until I found some dangerous bugs. Now I am very happy in Pytorch. Python is really easy (easier than MxNet) and extremely powerful.

[@ZarreenNaowalReza]

True label: Rani Mukerji Predicted label: Tensorflow Difference: infinity ;-

[@pimpthelimp]

Wow! I understood basically everything you said! I'm exploring adding DL into my product line.

[@Abhishek_GS]

If you're about to start your project using framework for the first time go with TensorFlow... after some days you will able to know what framework you want according to your needs😁...

[@aasimbaig01]

My fav - Tensorflow and keras..

[@souravkumar-ue8uj]

i have used pytorch for a while as a beginner and it was cool atleast for me.

[@ObinnaUgbor]

Thanks Siraj, you make very complicated topics such fun to learn. I'm a beginner, I'll get my hands dirty with Keras then I'll move on to prototyping with PyTorch and someday deploy using Tensorflow

[@rednafi]

After reading "Deep learning with python" by Francois Chollet (The author of Keras), I fell in love with tensorflow and keras again. I work in production and working with raw tf is a mess.

[@nagendrapp2213]

It's a book how cost ?

[@rednafi]

@@nagendrapp2213 It's probably the best book written on deep learning for the intermediate practitioners. Check it out on amazon or look up on piratebay..wink wink..

[@billykotsos4642]

Pft.. Excellent as always Siraj Seriously your videos have no equal, you are special.

[@andremendessousa]

MATLAB is the easier...with all models ready to implement. A graphical tool to create new architectures. In 2 days I did in matlab what took me weeks to do using Tensorflow.

[@alefratat4018]

My own evaluation on the DL frameworks I used: - TensorFlow: honeslty, one the sh.ttest DL frameworks I used. Lots of counter-intuitive design choices, bad documentation, huge community but actually a lot of non-skilled people try to use it and at the end, it produces a lot of noise which make it difficult to find the right answer when you face a specific problem. Just look at the number of opened issues on the github repo. Actually, if you don't work at Google, you should not use it. - PyTorch: To me, the best for prototyping and experimenting new models / ideas. Sucks in a production environment though and caffe2 is not that easy to use. - Caffe: The best for Computer Vision tasks, relatively easy to deploy. Still too many useless dependencies which sometimes make it annoying to deploy on un-common systems. - Keras: For learning only, would not even consider to use it in a production environment. - MXNet: Probably the best trade-off between research vs production in 2019. - Darknet: I really like its simplicity and low-level. It is sad that most of the famous DL frameworks are actually a pain to deploy in a real-world contrained environment like embedded system for example. I am pretty sure a lot of people don't realize at which point these huge, fat frameworks are completely useless and over-dimensioned for 90% of real-world use-cases. At the end, we talk about a bunch of stacked matrix-matrix and matrix-vector additions / multiplications. Why does it have to be such a complicated mess ?

[@bapatchaitanya]

What did you use MXNet for? How was the experience?

[@javierfernandez6327]

What's a good framework for resource constraint devices? Not mobile devices, but more like autonomous machines where C and C++ reign.

[@Deadbeatdad666]

Javier Fernandez If you just want to run inference on the machine, I would recommend tensorflow c_api. However, if you want to train too then you want Caffe or Darknet. Darknet is the only one Im aware of that you can do everything in pure C. However, the learning curve is very, very steep

[@funtimenetwork]

The fastai library is quite nice. It sits on top of pyrotorch. I’ve been using that to get up to speed on deep learning

[@Nehmaiz]

thanks Siraj, great video for clarification on different DL frameworks

[@atama01]

wow you're great - the go to guy if I get my project.......

[@CHIRAGPATELthelifesailor]

I usually go with Keras and TF..!

[@wolfisraging]

Mxnet is the most unnecessarily underrated library which can outperform tensorflow just "yooo it's done".

[@bapatchaitanya]

Have you used it? What's your take?

[@vivekkalyanarangan9629]

Hi Siraj Thanks for using my tensorflow environment diagram!

[@tsegaynegasi3696]

I really appreciate the passion you have, to share a lot's of information about this amusing field. your inspirational words and scientific words to explore and dig out much more information regarding this technology is very fascinating. I will follow you forever until you are playing with this field.

[@wolfisraging]

0:01, tensorflow is sexy

[@narutosaga12]

Rishik Mourya Pytorch is ironically more sexier imo...

[@computervision557]

@Z3U5 Pytorch1.0 is better now, unless it offer c++ api for us to use the model. mxnet provide high level api like gluoncv, this make mxnet great for production and fast prototype. tensorflow, if the customers did not ask me to use it, I will run away from tensorflow as far as possible, their api are ridiculous poor compare with pytorch and mxnet. api of tensorflow, they looks like designed by scholars who don't have much experiences on real world projects In the contrary, pytorch and gluoncv, their api are designed by seasons programmers who know deep learning

[@wolfisraging]

@@computervision557 so true bro, I used to be a tensorflow fan but after using mxnet it changed my mind and now I use it for all my projects.

[@ajay6225]

I will use pytorch 🔥

[@ArijitBiswasGooglePlus]

I like CNTK because it's fast. But it seems like not many people are using it. Now, using PyTorch.

[@AbhishekKumar-en2vf]

Your videos are awesome for a data science enthusiast

[@jugsma6676]

i am with Tensorflow & Deeplearning4j (Dl4j) :)

[@marcellosteiner6427]

Hey Siraj! Great video :) The only thing I'd say you miss is to mention is that TF is just a single facet of TFX. I believe that tools like TFDV, TFT, TFMA are extremely important once you start to get serious with ML and, to the best of my knowledge, these can be used only with TF.

[@tanismar2979]

Hi Siraj, great video as always! Any words about fast.ai as a (sort of) Keras for PyTorch?

[@franfdk17]

Probably the best one: Easy to use and great performance with the latest SotA ideas outside the box

[@SirajRaval]

i'll make a separate video about that

[@tanismar2979]

@@SirajRaval Great! Looking forward to it :)

[@PremKumar-yz1qm]

Welcome to the siraj-side.

[@mariusbogdanN]

Which one would you recommend to be implemented on a Raspberry Pi for camera feed object recognition for best performance?

[@alefratat4018]

Better use a optimized inference engine for ARM.

[@AdityaGupta-sm4gj]

Siraj love your dedication and hardwork for the wizards

[@nipunbhaskar2475]

My research is in optimizing NN for low latency and low power applications. So I have my own NN written in CUDA C++ (both forward and back propagation using different techniques). Which of these frameworks allow to easily integrate, test and compare customized NN written in CUDA C++ with the traditional ones available in their library?

[@alefratat4018]

Why do you want to do exactly ? Bench-marking your implementation against those frameworks ?

[@sinaasadiyan]

really great video, i've wasted too much time to choose one already

[@wiz7716]

I have a small question related to one of your videos @3:45 you are saying here that "backpropagation is defined by how the code is run" I am not quite sure that I understand what you mean, could you or somebody elaborate a bit further?

[@lavgupta1706]

Always... The best of the best..... Most informative.... Thankx for every single video man 👍🏻👊🏻

[@JimMorrison915]

Glad you finally shouted out to Sonnet! Highly customizable TF is the best! Though still gotta give some love to PyTorch as well XD

[@AlexSantos-yr8xp]

Hi Siraj, I’m new to Deep Learning and I have a few questions. 1 - Do you know any good documentation to learn Deep Image Matting? 2 - Do you know how can I create my own Image Matting Dataset? 3 - Do you know if there is a good to pretrain my models? I’m new to this so trying to understand a few pieces. I really like your channel. Thank you

[@sendofuji12]

you are beyond amazing!

[@_mvr_]

Which one should I use for training an AI to play a multi-agent (cooperative), imperfect information turn-based game?

[@ramch20]

I also dont see any commercial frameworks like MATLAB on the list. Just curious if you have looked at how it compares to these major frameworks?

[@tpulley]

Any ideas about ML Kit? Is it comparable to Core ML, or is it just a fancy name for TF packaged for Firebase?

[@r1pfake521]

Do you have any videos about any kind of Deep Learning or Networks with C#?

[@ngelae]

R, caret, forecast, recipes, broom, tsibble, fable, and more!

[@marcosraphael3390]

NIce, thank you, you clarified a lot

[@Wonderbrains]

I used FANN a lot. Wich framework can do the same in an equal easy way?

[@machinelearning4376]

What do you guys think of autokeras?

[@sjs5256]

I use keras and tensorflow 👍

[@mohammadmohammadian27]

man thank you for this work BEST INTRO

[@oskarrask9413]

ill go for pytorch

[@sytec99]

anyone know the link to the unofficial tensorflow documentation at 1:20 ?

[@junfenggao5403]

if I wanna deploy trained model into Nvidia JetsonTX, which framework is better to use ?

[@clausradloff9250]

A very good overview, thanks. My favorite framework is DL4J.

[@ThousifAmeerkhan]

Amazing Video Siraj

[@raaghavsharma378]

Do i have to use cntk always for azure ?

[@zx6305]

Thanks! This info what i needed right now.

[@sonatjamesnew3679]

Please do some example video about google automl and how use them in android application.

[@younghwanchae1422]

great summary! thank you Siraj

[@michalziobro7890]

Tensorflow uses Swift so I use tensorflow ;)

[@adnanzahid8936]

Instant like for the Rani Mukherjee song :p

[@mkelly66]

Great overview! I particularly liked your suggestions at the end.

[@techandlifestyle7767]

Did not expect that at 2:00 LOL!

[@debankurrocks]

Pytorch... hands-down....

[@ODAC25thKA]

Great review! Never used anything other than Keras so this is great!

[@technobabble7702]

I'll make my own god damn framework.

[@VickylanceMedia]

That's exactly what im doing

[@kamilnamyslak3906]

...with blackjack and hookers. In fact forget about the framework.

[@EugeneVlasovca]

there you go buddy )))

[@chrismorris5241]

lol

[@YamiZee]

I did that but I need to learn existing ones for jobs.

[@0xccd]

Any recommendation for deploying in IBM?

[@VishalRaoOnYouTube]

Awesome, information packed video. I especially liked the "Conclusions" section.

[@bocadelcieloplaya3852]

Kuch Kuch Hota Hai.......my first Bollywood movie. I'll marry this basketball.

[@pspicer777]

Fantastic list - really useful information. Thanks!!

[@ArupDas-lj8xe]

Siraj just tell me that can i implement my yoloV3 model in android phone or not..?? Please just yes or no....

[@MoutasemMohammad]

check Knet which was written by Julia i'm taking the deep learning course this semester and we're implementing a scientific paper with it

[@awwe007]

Nice work, always enjoy the quality content!

[@jimbobbillybob]

Keras has MXNet as a backend now too.

[@deepanshusehgal1199]

Keras for Life !!

[@aayushadhikari3848]

Tensorflow is best for me.

[@ibrahimbon5]

I've started learning Tensorflow but my favorite is keras because of lesser amount of code

[@DaveTD]

wow keep itup !!!!!!!!!!!!!!

[@berndrichter1549]

Hi siraj great work, can you tell me the github of the unoffical docs for tensorflow on 1:20 ?

[@biglile]

Here you go: github.com/aymericdamien/TensorFlow-Examples

[@mervynetienne]

Outstanding.

[@marcphilippe7417]

Positively surprised by what you can achieve with Keras alone - GANs, autoencoders...lots of decent stuff.

[@santoshrajmane2398]

Great information. Good work with collecting all stuff under one hood. keep it up Siraj

[@anshchugh991]

But which one can implement skynet well?

[@cu7695]

Hi Siraj, any upcoming videos on computer vision domain & newer GAN's ?

[@darkside3ng]

Very, very nice video. Thanks :)

[@fakhredineatallah6732]

xD 2:03 best troll face ever Pytorch POWEEERRRRR !!!!

[@VishalSingh-on6rx]

1:19 does anybody know that github link?

[@chrismorris5241]

Minimum required knowledge of machine learning when using preferred framework?

[@richardcoppin5332]

Thanks, this was really informative .