Machine Learning Model Training
9:52
Data preparation for ML (2/4)
11:44
How to build an ML product (1/4)
7:12
Docker Compose for ML Engineers
4:19
The 3-pipeline design
2:24
6 ай бұрын
Inference pipeline for LLMs
10:18
6 ай бұрын
6 steps to land an ML job
3:09
7 ай бұрын
04. Train ML models
4:45
10 ай бұрын
Пікірлер
@XEQUTE
@XEQUTE 18 күн бұрын
dude why does this assume that I would be running it on a linux based machine???
@user-xn1ly6xt8o
@user-xn1ly6xt8o 20 күн бұрын
bro great video, i really enjoi it, thank u, but bro, at 1:40 my heart told me bye, why it so scary there uh
@giordanosouza3722
@giordanosouza3722 26 күн бұрын
Amazing guys!!
@vipulsarode2722
@vipulsarode2722 Ай бұрын
So how would you suggest we follow this video or the course. Should we just clone the repo and keep running the code? Should we create a new repo and start adding all the files from scratch? I am confused and lost, please help!
@soy2471
@soy2471 Ай бұрын
Great format. You have. Niche here. The 6 minute format is perfect for consuming and gives enough detail for me to know enough and follow up myself
@realworldml
@realworldml Ай бұрын
Glad to hear it!
@abc_cba
@abc_cba 2 ай бұрын
Hi, Please monetise your channel, I turned off the adblockers just to view your video, thanks. Do you have any course on Spark, Flume, Beam? Please do let me know.
@realworldml
@realworldml Ай бұрын
I dont plan to monetize it. I want the content to be accessible to everyone. I dont have any course on these technologies
@abc_cba
@abc_cba Ай бұрын
@@realworldml you're a real hero. It would be awesome to have you as a mentor. How can I do that?
@nobir98
@nobir98 2 ай бұрын
This video is good no question about it and thank you for this awesome video but I humble request to the author of this video that please do not do the transition video sound like 1:22. IDK but it hurts my ears.
@realworldml
@realworldml Ай бұрын
Thanks for the feedback
@franklinnwankwo9442
@franklinnwankwo9442 2 ай бұрын
Boss 💪🏾
@alifadnan1492
@alifadnan1492 2 ай бұрын
Thank you for inspiring. I have zero experience and knowledge in coding. What is your advice in where to start?
@dinoscheidt
@dinoscheidt 2 ай бұрын
Practical FYI: One of the largest challenges is to actually get meaningful data streams from products and the often naively written CRUD products by full stack engineers. There is an open source project called “Debezium” that allows to create change and event data from database changes. For the other way around, where a complex Kafka stream system already exists, there is a project called “Materialize” which makes feature engineering (combining many streams) much easier than writing it imperatively in code. For finding interesting relationships in event streams, there is also a project called “Memgraph”. Maybe this info helps for the most common challenge to actually get to meaningful data ❤️ subscribed
@pavankumard5276
@pavankumard5276 2 ай бұрын
Good video but it would be great if you could type the code and explain what the code is actually doing, instead of just showing snippets. I would hate to watch a longer more elaborate 20 min video. Hoping for more content like this this
@hamidoshaat
@hamidoshaat 2 ай бұрын
Please please please make an end to end project video or course to explain in practical. You are great in explaining. If you will not, please recommend resources or courses to learn MLOps
@hamidoshaat
@hamidoshaat 2 ай бұрын
Can you do one complete project for MLOps ( development and deployment) ?
@realworldml
@realworldml 2 ай бұрын
Yes, here it is -> realworldmachinelearning.carrd.co
@shrawankumarkumawat1380
@shrawankumarkumawat1380 2 ай бұрын
yaa, really helpful content about production for beginners , thanks a lot
@tahamansoor599
@tahamansoor599 2 ай бұрын
Great explanation, But would be alot better & helpful for beginners if u show a working demo as well.
@realworldml
@realworldml 2 ай бұрын
Great suggestion! Here is the full source code of a demo I prepared github.com/Paulescu/real-time-data-pipelines-in-python
@vikram-aditya
@vikram-aditya 2 ай бұрын
thanks..but you should have shown the process practically, good info though
@realworldml
@realworldml 2 ай бұрын
Ok next time. Thanks for the feedback
@muhammadsamir2243
@muhammadsamir2243 2 ай бұрын
please add all videos about ML production in one playlist, thanks for awesome real world content
@realworldml
@realworldml 2 ай бұрын
Will do soon, thanks for the suggestion
@mochalatte3547
@mochalatte3547 2 ай бұрын
This is great.. but I wonder why ppl still insist on using docker. These folks changed their business model years ago. Even the free model has limits: 200 image pulls per 6 hours. Now as far as poetry is concerned I use it everyday!
@jasonpaq1210
@jasonpaq1210 2 ай бұрын
learned a lot from your videos Pau. Do you have a starter course I could take in order to learn MLOPS and deploying machine learning models into production? I already know how to train an ML model, and deploying it to production is quite a headache for me. Thanks :D
@realworldml
@realworldml 2 ай бұрын
I am very happy you found value in the videos. I do have a hands on course that will help you bridge the gap between ml model prototypes in notebooks and fully working ML systems realworldmachinelearning.carrd.co
@jasonpaq1210
@jasonpaq1210 2 ай бұрын
@@realworldml Thanks Pau. I'll definitely check this out. more power to you!!
@pondupondu9131
@pondupondu9131 2 ай бұрын
Why not Google Colab?
@realworldml
@realworldml 2 ай бұрын
Same code structure applies whether you develop in a colab runtime, your local laptop or a paid AWS instance
@dinoscheidt
@dinoscheidt Ай бұрын
Jupyter is a one dimensional document. Software has teste, code coverage, functions and methods share between different parts of the system etc etc Jupyter is great for presenting runnable results. But not maintainable code bases.
@dvquys
@dvquys 2 ай бұрын
Thanks Pau and Paul, great tutorials! May I ask why we're using this setting "PYTHON_KEYRING_BACKEND=keyring.backends.null.Keyring"?
@HootanHM
@HootanHM 2 ай бұрын
Suggestion: a video on how to read the metrics and understand the model behavior, and how to fix it by going back to your data And how you really decide which model should go to production, Before you really go to production!
@realworldml
@realworldml 2 ай бұрын
👍🏿
@HootanHM
@HootanHM 2 ай бұрын
Very precious video, 3 years of experience in less than 10 minutes! I hope juniors find this gem.
@realworldml
@realworldml 2 ай бұрын
I hope so too!
@realworldml
@realworldml 2 ай бұрын
Thanks for the feedback
@NikunjSharma-ge9do
@NikunjSharma-ge9do 2 ай бұрын
Hi, thanks for pathway btw can we modify pathway with google AI API key
@realworldml
@realworldml 2 ай бұрын
Yes, you can. Pathway is a real time data processing engine that you can integrate with external APIs like Google’s. What do you want to build?
@NikunjSharma-ge9do
@NikunjSharma-ge9do 2 ай бұрын
@@realworldml I want to build a chatbot for my college which can answer local question such as what is MA101 credit etc
@smrutirockstar6
@smrutirockstar6 3 ай бұрын
Time series data was not generated in the previous video, only the problem was framed. Am I missing something?
@realworldml
@realworldml 2 ай бұрын
Correct. This series is an overview of the key steps. The whole hands on course and code is available as part of the Real World ML Tutorial www.realworldml.net
@user-we1ph2dw2o
@user-we1ph2dw2o 3 ай бұрын
nice job! my KTH
@Joseph-js3mk
@Joseph-js3mk 3 ай бұрын
'PromoSM'
@antonjav123
@antonjav123 3 ай бұрын
Thanks for your videos! Great stuff. I'm looking forward to more.
@realworldml
@realworldml 3 ай бұрын
More to come!
@greatmilestone
@greatmilestone 3 ай бұрын
could you please provide the link to the dataset, I will be grateful
@realworldml
@realworldml 3 ай бұрын
Link to the raw data -> www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
@unisonrul1171
@unisonrul1171 3 ай бұрын
Very good information. Thank you bro!
@realworldml
@realworldml 3 ай бұрын
Glad it was helpful!
@rodneyleiestrada8423
@rodneyleiestrada8423 3 ай бұрын
I love you content man, keep it up! Really concise and living up to the name of Real world ML🎉 Hoping to have and watch your end-to-end project tutorial playlist
@realworldml
@realworldml 3 ай бұрын
Thank for your kind words Rodney 🚀
@miteli1410
@miteli1410 3 ай бұрын
Your explanation is clear and useful, keep making this great content please!
@realworldml
@realworldml 3 ай бұрын
That's the plan!
@kyalosevens1268
@kyalosevens1268 3 ай бұрын
Really appreciate the content you're putting out on MLops...it's so rich thanks a lot...i am big fan
@realworldml
@realworldml 3 ай бұрын
Thanks for the feedback. I really appreciate it
@nikhilsastry6631
@nikhilsastry6631 3 ай бұрын
Awesome
@user-co9gd2wi5b
@user-co9gd2wi5b 3 ай бұрын
Thank you for your videos! Waiting for more. Good luck on your journey.
@JoaoGabriel-hf7zc
@JoaoGabriel-hf7zc 3 ай бұрын
Excellent. Thanks so much! Greetings from Brazil.
@realworldml
@realworldml 3 ай бұрын
You are welcome!
@katlehomahlelebe1401
@katlehomahlelebe1401 3 ай бұрын
If I were you, after seeing my lookalike, I could've said "I've never seen this man in my life"😊
@datafreak9846
@datafreak9846 3 ай бұрын
This is great. Would you mind in explaining the full tutorial so that it will be easy for the learners/beginners to understand the context.
@realworldml
@realworldml 3 ай бұрын
Thanks for the feedack. What part was not clear for you?
@kaytech8153
@kaytech8153 3 ай бұрын
Please if you can do a step by step code or make it a playlist where this is the whole overview …..subscribing to your channel ✨
@jjpp1993
@jjpp1993 2 ай бұрын
If you’re beginning I can tell you that the learning will come from trying to carry out the steps at the same level of detail explained at the video. This will require you to do some research and fill in any gaps by yourself. In a common job this is the kind of instruction (even less detailed) you’d get from a sr or lead engineer.
@recs8564
@recs8564 3 ай бұрын
Amazing video brother!
@realworldml
@realworldml 3 ай бұрын
Was it helpful?
@affilinskyy
@affilinskyy 3 ай бұрын
Hey, thanks for the idea. I want to implement this but am a bit concerned about the sentiment extraction step. Could this just be assigning a 1-10 value representing how positive/negative each news data point is? What kind of LLM setup can I use to do this very cheaply?
@Rookie_AI
@Rookie_AI 3 ай бұрын
is there another way to deploy docker images other than quix cloud?
@realworldml
@realworldml 3 ай бұрын
Of course. Any platform that supports docker does the job, the most popular one being Kubernetes
@OmegaStyler
@OmegaStyler 3 ай бұрын
Great video, thanks! Quick question: why would you want containerize this streamlit app? Streamlit already supports free hosting for example over github. Whats the benefit of docker here? Second question: is there a free docker container hosting service? So i can share it with others and run it somewhere else?
@realworldml
@realworldml 3 ай бұрын
Good question! Streamlit cloud provides hosting yes, through some standard container. However, if you wanna deploy somewhere else, or your Python code depends on non-standard c libraries (like talib) you need to build your own container. Does that make sense?
@Rookie_AI
@Rookie_AI 3 ай бұрын
But how can we deploy that docker image, and assure it runs live,how can we add CI/CD to it as well?
@realworldml
@realworldml 3 ай бұрын
That is a great question. I deployed the dashoard to quix cloud (find link im the video description) which is essentially a managed Kubernetes cluster. At the moment quic cloud does not seem to support ci/cd very well. Once the support is there I will add a second lecture with ci cd in this case
@aravindram1480
@aravindram1480 3 ай бұрын
Hi. You don't seem like native English speaker. What is your native??
@realworldml
@realworldml 3 ай бұрын
Spanish and Catalan
@aravindram1480
@aravindram1480 3 ай бұрын
@@realworldml really loved your videos brother. Keep continuing. We'll support you.
@uazik-kamazik
@uazik-kamazik 3 ай бұрын
you look like jesus of IT community
@realworldml
@realworldml 3 ай бұрын
I will take that as a compliment
@ingloriouspancake7529
@ingloriouspancake7529 3 ай бұрын
I think its a good thing
@user-xs5kt8lf9j
@user-xs5kt8lf9j 3 ай бұрын
Thanks for sharing Pau.
@realworldml
@realworldml 3 ай бұрын
My pleasure 😊
@ananthakrishnank3208
@ananthakrishnank3208 3 ай бұрын
Thank you! Your website from description is cool as well.
@realworldml
@realworldml 3 ай бұрын
Glad you like it!
@user-sz3dq5el5o
@user-sz3dq5el5o 3 ай бұрын
Dude amazing content! have you tried the new uv python packaging that uses rust? Wishing you the best!
@realworldml
@realworldml 3 ай бұрын
Thanks for the feedback. I havent tried uv yet, but looks promising. Rust tooling is like fresh air in thr Python world
@ArifMarias
@ArifMarias 4 ай бұрын
Wondering, do you have any video on that where you have applied all of these 3 tips with end to end small project? If you've, can you please share the links with us. Btw, you're contents are always awesome! Thanks a million.
@realworldml
@realworldml 4 ай бұрын
Thanks for your feedback. I am working on a new hands on course on real time ml that will cover these 3 tips, among other things.
@letgoofwill
@letgoofwill 4 ай бұрын
Amazing tips !! Thank you!
@realworldml
@realworldml 4 ай бұрын
Glad it was helpful!