Getting Started with Metaflow
42:29
Getting Started with Ray Clusters
21:59
How to Reorder Columns in Pandas
3:54
Getting Started With MLFlow
16:27
Жыл бұрын
Part 2: SSHing to AWS SageMaker
11:16
Part 1: SSH-ing to AWS SageMaker
6:34
Setting Up JupyterHub
4:35
2 жыл бұрын
Saturn Cloud Webinar: R in Parallel
54:45
Saturn Cloud Webinar: Intro to Julia
36:09
Getting Started with Saturn Cloud
2:38
Dask Basics Explained
6:30
3 жыл бұрын
Пікірлер
@andresmuzlera1619
@andresmuzlera1619 Күн бұрын
I got what I need. You have my thumps up
@anvicom
@anvicom Ай бұрын
Great video, how about setting up this on a local cluster instead of AWS
@murielmoyahabo6078
@murielmoyahabo6078 Ай бұрын
Nice explanation David
@aditiphadnis5303
@aditiphadnis5303 3 ай бұрын
Hi @saturn Cloud I am getting an error message import pandas as pd import numpy as np import boto3 from sagemaker import get_execution_role conn = boto3.client('s3') bucket = 'sagemakerkaggle' content = conn.list_objects(Bucket=bucket)['Contents'] dataset = 'montocarlo/train.csv' df = pd.read_csv(f"s3//{bucket}/{dataset}") FileNotFoundError Traceback (most recent call last) Cell In[7], line 1 ----> 1 df = pd.read_csv(f"s3//{bucket}/{dataset}") File /opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py:948, in read_csv(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, skipfooter, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, date_format, dayfirst, cache_dates, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, doublequote, escapechar, comment, encoding, encoding_errors, dialect, on_bad_lines, delim_whitespace, low_memory, memory_map, float_precision, storage_options, dtype_backend) 935 kwds_defaults = _refine_defaults_read( 936 dialect, 937 delimiter, (...) 944 dtype_backend=dtype_backend, 945 ) 946 kwds.update(kwds_defaults) --> 948 return _read(filepath_or_buffer, kwds) File /opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py:611, in _read(filepath_or_buffer, kwds) 608 _validate_names(kwds.get("names", None)) 610 # Create the parser. --> 611 parser = TextFileReader(filepath_or_buffer, **kwds) 613 if chunksize or iterator: 614 return parser File /opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py:1448, in TextFileReader.__init__(self, f, engine, **kwds) 1445 self.options["has_index_names"] = kwds["has_index_names"] 1447 self.handles: IOHandles | None = None -> 1448 self._engine = self._make_engine(f, self.engine) File /opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py:1705, in TextFileReader._make_engine(self, f, engine) 1703 if "b" not in mode: 1704 mode += "b" -> 1705 self.handles = get_handle( 1706 f, 1707 mode, 1708 encoding=self.options.get("encoding", None), 1709 compression=self.options.get("compression", None), 1710 memory_map=self.options.get("memory_map", False), 1711 is_text=is_text, 1712 errors=self.options.get("encoding_errors", "strict"), 1713 storage_options=self.options.get("storage_options", None), 1714 ) 1715 assert self.handles is not None 1716 f = self.handles.handle File /opt/conda/lib/python3.10/site-packages/pandas/io/common.py:863, in get_handle(path_or_buf, mode, encoding, compression, memory_map, is_text, errors, storage_options) 858 elif isinstance(handle, str): 859 # Check whether the filename is to be opened in binary mode. 860 # Binary mode does not support 'encoding' and 'newline'. 861 if ioargs.encoding and "b" not in ioargs.mode: 862 # Encoding --> 863 handle = open( 864 handle, 865 ioargs.mode, 866 encoding=ioargs.encoding, 867 errors=errors, 868 newline="", 869 ) 870 else: 871 # Binary mode 872 handle = open(handle, ioargs.mode) FileNotFoundError: [Errno 2] No such file or directory: 's3//sagemakerkaggle/montocarlo/train.csv'
@AnaCarol1402
@AnaCarol1402 4 ай бұрын
Wow... I loved this presentation... so useful🤩 Thank you so much
@andreiladyka3287
@andreiladyka3287 4 ай бұрын
Ngrok is not secure!!!
@KardinoIas
@KardinoIas 7 ай бұрын
Sveiki 🙂
@faiyazhasan4797
@faiyazhasan4797 8 ай бұрын
Anyone get any warning saying could not modify ulimit?
@chineduezeofor2481
@chineduezeofor2481 8 ай бұрын
Excellent tutorial!
@ravindarmadishetty736
@ravindarmadishetty736 9 ай бұрын
Do you have a continuation video for it?
@wizardaka
@wizardaka 10 ай бұрын
My dear this is a brilliant intro to Shiny in terms of concepts, has opened my eyes and massively improved my understanding
@fabsync
@fabsync 10 ай бұрын
fantastic video! Love your teaching style! It will be great to see a video on how to set ray on docker for local development.. probably chat with your pdf tutorial?
@valour.se47
@valour.se47 11 ай бұрын
why did you miss the IAM roles and Permissions part ?
@philipchuks2427
@philipchuks2427 11 ай бұрын
Well, your video just saved my day!!! Thank you
@fkeb37e9w0
@fkeb37e9w0 11 ай бұрын
I am running mlflow server with local host inside a vm and using the same as tracking uri, but when I do start_run() I get an error of 400 or 403. How do I resolve this.
@caty863
@caty863 11 ай бұрын
I wanted to see how you added that logo and top banner text and photos. I felt cheated to watch all the video and not see what I came for.
@AdamWork-c3x
@AdamWork-c3x 10 ай бұрын
Likewise. Hoped for a repo in the description but alas. It's still an awesome vid tho.
@yaseenbaba3389
@yaseenbaba3389 11 ай бұрын
Excellent
@ccqf4694
@ccqf4694 Жыл бұрын
Great video ❤❤❤ thanks
@rodolphobabatounde6711
@rodolphobabatounde6711 Жыл бұрын
It's really sad that I didn't share the code or the link to your blog. We need at least the yaml file
@benjaminosawe181
@benjaminosawe181 Жыл бұрын
how you used the ip address and script to bring up Jupyter was not made clear, not very helpful video
@Anton_Sh.
@Anton_Sh. Жыл бұрын
But how do you get one ? :)
@arguscesus
@arguscesus Жыл бұрын
We’re you able to run tensorboard for ray machine learning task?
@PompiBasumatary-s4g
@PompiBasumatary-s4g Жыл бұрын
Takes a lot of time for the cluster to be set up .
@saif3r
@saif3r Жыл бұрын
Great video, thank you very much!
@srikanthdongala6922
@srikanthdongala6922 Жыл бұрын
Good Job!
@electricweegie9125
@electricweegie9125 Жыл бұрын
Excellent demo! Would be great to share the code.
@josephmiano2006
@josephmiano2006 Жыл бұрын
Great video, thanks. I did have one question; is there a way to also version control the data that the model was trained on? It is super useful to be able to track several versions of the model in production, but in my usecase I also may want to also track the dataframe that each version of the production model was trained on. Can MLFlow do this or do you know any other tools that can easily integrate with MLFlow for this?
@marioseguraiglesias6038
@marioseguraiglesias6038 8 ай бұрын
DVC is for data version control
@铁板大队长
@铁板大队长 Жыл бұрын
it helped me a lot
@zahabkhan6832
@zahabkhan6832 Жыл бұрын
where is the blog post
@Pooh991
@Pooh991 Жыл бұрын
Thaks for the video! It worked for the most part and then I had an error: ParamValidationError Traceback (most recent call last) - any thoughts would be appreciated! thank you!
@sidmehta1905
@sidmehta1905 Жыл бұрын
So good. Your enthusiasm & relatable communication made this easy to understand. Thanks for putting this out there!
@brittnyfreeman5908
@brittnyfreeman5908 Жыл бұрын
Couldn't have said it better myself. Your passion for this subject matter is contagious.
@guilhermeuchoa1147
@guilhermeuchoa1147 Жыл бұрын
How did you set the password? Very helpful video, thanks!
@javiergutierrez2958
@javiergutierrez2958 Жыл бұрын
If you still need it, there is a default password for jupyter hub is : jupyter
@reneporto-ai
@reneporto-ai Жыл бұрын
Very helpfull bud, thanks a lot.
@LeoUfimtsev
@LeoUfimtsev Жыл бұрын
I can't use Ngrok for company security policies. Was looking for a native solution.
Жыл бұрын
Maravilhoso! Estava procurando alguma coisa parecida! E se meu bucket tiver milhares de pastas e arquivos? Como pego somente uma pasta para fazer análise no sagemaker?
@shathishwarmas1243
@shathishwarmas1243 Жыл бұрын
I had Issue on Waiting for oidc-authservice pods to be ready ... running command: kubectl wait --for=condition=ready pod -l 'app in (authservice)' --timeout=240s -n istio-system error: timed out waiting for the condition on pods/authservice-0 Waiting for oidc-authservice pods to be ready ... running command: kubectl wait --for=condition=ready pod -l 'app in (authservice)' --timeout=240s -n istio-system error: timed out waiting for the condition on pods/authservice-0 Waiting for oidc-authservice pods to be ready ... running command: kubectl wait --for=condition=ready pod -l 'app in (authservice)' --timeout=240s -n istio-system error: timed out waiting for the condition on pods/authservice-0 is there any additional volumes to be attached ?
@MukeshRawat-k3v
@MukeshRawat-k3v 24 күн бұрын
Hey, when you run below command eksctl create cluster --name ${CLUSTER_NAME} --version 1.25 --region ${CLUSTER_REGION} --nodegroup-name kubeflow-ng --node-type m5.xlarge --nodes 5 --node-min 5 --nodes-max 10 --managed --with-oidc just after that, you need to run this (below) command too eksctl create addon --name aws-ebs-csi-driver --cluster kubeflow -region ap-south-1 -force This command create and install the AWS EBS CSI Driver, this driver allows EKS workloads to use Amazon EBS volumes as persistent storage.
@prashanthb6521
@prashanthb6521 Жыл бұрын
Flew over my head :(
@Tbone913
@Tbone913 Жыл бұрын
Excellent, thanks
@abhishektrivedi7291
@abhishektrivedi7291 Жыл бұрын
Video was good, why do not you share the yaml file or the blogpost to get them
@karenschmalbach5985
@karenschmalbach5985 Жыл бұрын
Your vid has been really helpful to me, thanks
@kc_ayem4961
@kc_ayem4961 Жыл бұрын
thanks so much !!! it is so clear. I have a question though how much does the bucket, with cognito service and the the UI hosting costs you per month or week? And is there any options to reduce the costs in any manners ?
@franciscocreatorstargazer6165
@franciscocreatorstargazer6165 Жыл бұрын
Hi can you make a tutorial on how to deployu to prod already trained models?
@zcliu-uy1ze
@zcliu-uy1ze Жыл бұрын
不错不错
@killerthoughts6150
@killerthoughts6150 Жыл бұрын
Thanks for the video, looking forward to more!
@deidy2005
@deidy2005 Жыл бұрын
Do you hava something related to inference?
@badraboufirasse433
@badraboufirasse433 Жыл бұрын
Very helpful. Thanks
@javierturcotte
@javierturcotte Жыл бұрын
😎 "PromoSM"
@daycentmodel9086
@daycentmodel9086 Жыл бұрын
Thanks for a very intuitive demo! Where do I find the blog posts that you mentioned?
@DavitKhachaturyan-u6b
@DavitKhachaturyan-u6b Жыл бұрын
hey, could you please give some explanation for the dockerfile. thanks.
@esthermatara9005
@esthermatara9005 Жыл бұрын
Thank you