How To Do Basic CI On Your ML Model With Sagemaker and Github-Actions

  Рет қаралды 1,867

Gus Cavanaugh

Gus Cavanaugh

Күн бұрын

Here's a quick CI demo using Github-Actions and Amazon Sagemaker. While I'm using a toy example, with large data volumes and expensive compute instances, this is where Sagemaker really shines. It spins up my compute, trains and saves my model, and shuts everything down automatically.
Rather than run from Studio, Studio Lab, Canva, or the other myriad noteboook/IDE tools within the Sagemaker UI, I just use my local machine and my CI server to launch Sagemaker training jobs.
-- I develop and test locally, using the Sagemaker Python SDK.
-- On each PR, Github-Actions starts a CI job that builds my code and runs my basic model training step (also using the sg python sdk)
Next I'll layer on an explicit set of CD steps using different environments, as this another area where Sagemaker really helps.
This isn't to say that this process is painless - after all Continual needs to come in somewhere - but as an illustrative example of using a CI tool with Sagemaker (and not getting caught in the web of Sagemaker notebooks), I hope this helps

Пікірлер
YOUR CODE! AT SCALE! Amazon SageMaker Script Mode
30:13
mikegchambers
Рет қаралды 10 М.
Новый уровень твоей сосиски
00:33
Кушать Хочу
Рет қаралды 5 МЛН
Nastya and balloon challenge
00:23
Nastya
Рет қаралды 69 МЛН
How To Get Married:   #short
00:22
Jin and Hattie
Рет қаралды 23 МЛН
Running With Bigger And Bigger Lunchlys
00:18
MrBeast
Рет қаралды 117 МЛН
AWS Summit ANZ 2022 - End-to-end MLOps for architects (ARCH3)
23:02
How to design a modern CI/CD Pipeline
9:59
DevOps Journey
Рет қаралды 135 М.
Deliver high-performance ML models faster with MLOps tools
1:01:08
AWS Developers
Рет қаралды 13 М.
Automate Your AI/ML Workflows with SageMaker Pipelines
29:52
Generative AI on AWS
Рет қаралды 27 М.
Deploying applications to AWS EKS using GitHub actions
1:02:49
Primus Learning
Рет қаралды 14 М.
Новый уровень твоей сосиски
00:33
Кушать Хочу
Рет қаралды 5 МЛН