Пікірлер
@РамильСафин-ы6ш 5 күн бұрын
Great demo! Guys, a very dumb question - how to start with MLOPS for a devOps engineer?-)
@abdulaziz-vm7yh 16 күн бұрын
ahh man i dont how to follow these tutorials in 2025 since many things has changed and getting many errors . some how i dragged myself till here
@satish1012 Ай бұрын
Great Presentation! It is all about storing meta data of the actual files
@surf_skate_snow Ай бұрын
GOOGLE blocks the files. Plus you forgot to mention pip install first.
@zapy422 2 ай бұрын
Can I add a param/value to new experiment and propagate them back to old experiment (that were without logging that new param/value)
@zapy422 2 ай бұрын
Nice Do I need DVC init in that or can I just go with DVC Live?
2 ай бұрын
Cute 🥰
@fj7318 2 ай бұрын
Nice video! If you want to work on your personal device but do the execution in your server how can you do it? Thanks!
@nikhileshsaggere 3 ай бұрын
Superb and brilliant explanation of the concepts as well as the getting started projects!
@awakenwithoutcoffee 3 ай бұрын
unfortunately it is still unclear what datachain is able to offer : are there any benchmarks available ? what benefit does it have over writing our own async data-uploaders ? We are looking for a scalable data-parsing solution for our Postgres back-end (B2B SaaS).
@tonynolan9428 3 ай бұрын
Amazing thankyou so much. I've been having a nightmare getting chroma into my stack (inexperienced) but now that i can use my postgre as vector I'm away
@tonynolan9428 3 ай бұрын
I'm only half way through and have learnt so much. Thankyou. Now returning to the next half
@rahulguptargrg3 3 ай бұрын
Great offering. Thank You. How can I do the whole thing locally? I have a workstation with appropriate capacity. Please guide 🙏
@Sam56891 4 ай бұрын
How are you zooming a particular area in cmd
@dvcorg8370 3 ай бұрын
This was done with post recording editing. But there are tools now that enable this when recording such as CleanShot of Screen Studio.
@azimrose6926 4 ай бұрын
Awesome tutorial!🎉
@jeremykusnadi5148 4 ай бұрын
how do you get around the " `GLIBC_2.28' not found " error?
@dvcorg8370 3 ай бұрын
This error typically occurs when trying to run a program that was compiled with a newer version of the GNU C Library (GLIBC) than what's installed on your system. Check that version requirements match up and you should be all set!
@MacAdamNorman-n6q 4 ай бұрын
Lehner Oval
@BenthamDebby-n7q 4 ай бұрын
Chasity Route
@ThomasWiese-l8t 5 ай бұрын
Kuvalis Trace
@TomSherry-u4l 5 ай бұрын
Cheyenne Glens
@Akwjbwbqm 5 ай бұрын
can someone help me? i sent a json with the credentials to gcs. i would like to remove it from there
@useless_deno 5 ай бұрын
well explained. Can you also make a video this much explained on how to make a pipeline using dvc?
@dvcorg8370 5 ай бұрын
@pratyakshagarwal-iw Please take a look at this Pipeline video and let us know what you think! kzbin.info/www/bejne/bWKseK2vfZ5oi7ssi=xMty7q4YbJmI7f8G
@useless_deno 5 ай бұрын
@@dvcorg8370 Thanks
@maxtaubert3044 6 ай бұрын
Missed the opportunity to say "Do not get lost in your machine learning sauce". I totally get experiments though too lol fits the "experiments" y'all offer.
@betonniere8202 6 ай бұрын
Il est dur de trouver des ressources qui apportent vraiment des informations pertinentes sur youtube, dans le domaine des systèmes LLM. Merci, c'est beaucoup de valeur que vous partagez
@curlrain 7 ай бұрын
I've never been able to authenticate i always get a 400 invalid request.
@saeidseyfi 7 ай бұрын
I want to use a Linux server as a remote server for storing and managing my datasets and models using DVC. How can I set this up?
@iPondrio 7 ай бұрын
Do you have any video showing how to configure the token ? I’m having a hard time with that config
@albertkim1809 7 ай бұрын
Thank you so much for this tutorial. I was struggling to understand how exactly DVC connected to cloud services, and your Google Drive example was extremely clear and simple.
@thewaterborne8 7 ай бұрын
Curious why AWS OpenSearch KNN is not on the list :O
@mehrdat 8 ай бұрын
thank you very much. but why i have errors. i couldn't run after first commit. i tried nearly everything. it is deom the the line of the importance plot. what it could be?
@basicmachines 8 ай бұрын
It says in the description that the command dvc run has now been replaced with 'dvc stage add' but as far as I can see stage add does not actually run the new pipeline stage. Would 'dvc exp run -n' work, or is the current procedure to do 'dvc stage add -n' followed by 'dvc exp run'?
@stopznak86 8 ай бұрын
Great stuff, I'm learning
@istvandarvas3372 8 ай бұрын
@25:20 I think DSPy optimise only the prompt not the weights of the model, but feel free to correct me. Anyway this was good. Thanks! - you could do more!
@efexzium 8 ай бұрын
Love your work! Elle and Deevee
@salsabilaaurora99 9 ай бұрын
sorry is that in cmd?
@dvcorg8370 9 ай бұрын
Yes! You use the command line for DVC, just like Git!
@awds121 10 ай бұрын
Thanks for the tutorial! If you want this to work today, make these changes in your train.yaml file: change "--show-md" -> "--md" change "cml-send-comment" -> "cml comment create" add "permissions: write-all" at the same level before "runs-on: [ubuntu-latest] add " git config --global --add safe.directory '*' " after "dvc repro" Hope this helps!
@dvcorg8370 9 ай бұрын
Thanks for the tip!
@crazyidiot101 10 ай бұрын
I’ve read that weaviate and pinecone are the only commercially viable databases. From a legal and compliance standpoint, which database is more ready to be deployed for use cases outside of tech, such as operational efficiency apps for other industries?
@curdyco 10 ай бұрын
isn't there a way to perfom retraining in pipeline using google colab or kaggle?
@dvcorg8370 10 ай бұрын
You can use DVC in your notebooks to rerun pipelines but ultimately for production you will want to convert your code. Check out this video next:kzbin.info/www/bejne/bKmZeKqqg8qMmqs
@curdyco 10 ай бұрын
these things are easy , Are there any tutorials about deploying deep learning models with large datasets with retraning with feedback on custom host like a kaggle notebook?
@dvcorg8370 10 ай бұрын
We see you found Alex Kim's Best MLOps Practices for Building End-to-End Machine Learning Computer Vision Projects. You're in good hands there. In general, using notebooks for production environments is generally considered not the best practice (outside resource: kzbin.info/www/bejne/aXfEZ6iwfd2HobM). There are tools like jupy text that can help with versioning and getting proper diffs in your notebooks, but still not the best for real-world ops.
@curdyco 10 ай бұрын
@@dvcorg8370 but Google colab is cost friendly if I need GPU access for training, using local PC is not worth it because of no GPU and sagemaker kind of services burn a hole in the pocket. What is the alternative according to you?
@trainer9948 10 ай бұрын
It looks like all the metadata is stored in git? Is it true that the studio app is just reading and writing to the git repo? Very cool
@dvcorg8370 10 ай бұрын
That's correct. It enables you to use your existing Git infrastructure while being able to adequately view and use your ML models and experimentation flows.
@NLogSpace 11 ай бұрын
8:23 I like that the remote storage is called "Someone's PC" :)
@Buhassan5656 11 ай бұрын
I was searching for tutorial videos on how to set up this tool & use it in vscode, I tried it & it was a bit complicated hope to see one soon
@dvcorg8370 11 ай бұрын
@buhassan5656 Please check out this video: kzbin.info/www/bejne/bHzXeoWMm9dpZ6c It should be more helpful! We welcome feedback! Let us know how we can make it better!
@Buhassan5656 11 ай бұрын
I'm new to this product, trying to learn it from scratch. Please share a tutorial or series of videos on how to set up, run, experiment with this product .
@dvcorg8370 11 ай бұрын
@buhassan5656 There are a few options. Best MLOps Practices for Building End-to-End Computer Vision Projects with Alex Kim is our most recent, highly liked video: kzbin.info/www/bejne/e2OZepR6bMeBjsk We also have an free online course that can help you get started at learn.iterative.ai We are in the process of updating that course as somethings have progressed since it was created over two years ago. And as always please visit our docs here: dvc.org/doc Finally if you get stuck, you are welcome to join our Discord server where you can ask questions: discordapp.com/invite/dvwXA2N
@riftsassassin8954 11 ай бұрын
South Africa. Played with the one built into Gemini python SDK, but want to learn more to use it in open source projects.
@macildur95 11 ай бұрын
Thank you for making this so clear! 😁
@Eriddoch 11 ай бұрын
Elle, you were the OG DevRel before that role got popular :D
@dvcorg8370 11 ай бұрын
So true!
@babakhos 11 ай бұрын
Hi Elle. Is there a possible way to add a new file to dvc via python script? Currently I run "DVC add <sample.file>" using subprocess in python when I want to track new data with dvc.
@dvcorg8370 11 ай бұрын
For python you could use: from dvc.repo import Repo repo = Repo(".") repo.add("abc.csv")
@babakhos 11 ай бұрын
Really interesting feature. Does it mean now we do not need to use mlflow for model and experiment tracking when we already have dvc in our project?
@dvcorg8370 11 ай бұрын
Yes. That's correct. You can manage all of that with DVC and it will be Git-based.
@babakhos 11 ай бұрын
Thank you for sharing these usefull hands-on tutorials about DVC. I wondered how we can compare DVC to MLflow or airflow? DVC performs pipeline orchestration and some sort of experiments tracking. Can we say one wouldn't need MLflow or airflow anymore if he/she uses DVC?
@dvcorg8370 11 ай бұрын
@babak21x You could replace MLflow with DVC, but they can also work together. DVC provides more thorough reproducibility. You can see info about that in this video (precise time provided): kzbin.info/www/bejne/e2OZepR6bMeBjsk Regarding Airflow - usually DVC cannot replace this tool except in cases where it's overkill and not really needed (like in the case of running everything on a single machine, then DVC can)
@urimtefiki226 Жыл бұрын
which vectors those of my matrix since 2019?
@dvcorg8370 Жыл бұрын
Hi @urimtefiki226! Can you provide more context on your question? Adding a reference here that came across our radar recently and will likely be in our February newsletter. Vector datbase comparison: vdbs.superlinked.com/