Cloud Computing AWS -Upload,Read And Write And Download Files In And From S3 bucket Using Python

[@supervickeyy1521]

I came back to Krish Naik videos after 2+ years and he again saved the day! I've been struggling to upload files to S3 for around 2 weeks (I work fully on Azure) and this video helped me solve the challenge in few mins! Thanks!

[@maiga4244]

I had a lot of problems with the other videos I watched and this went smoothly. Thanks

[@asutoshnayak1391]

Krish please make a playlist upon the AWS cloud for the data analyst/scientists. Please

[@adarshjamwal3448]

Nice , sir plz make the vedios of social marketing

[@jeremynx]

Thank you. happy that this youtube video exists

[@a_wise_person]

Hey krish i am having great trouble learning data structures and algorithms . Please guide me sir

[@priyadarshi3212]

Wonderful session. It will help us lot

[@chetanmundhe7899]

Can you create video on how to call pkl model to .py file for batch scoring?

[@prachinaik6695]

please upload video for IAM and EC2

[@rajgopalmanoharan]

Nice Session, thank you

[@CataM1988]

Thanks so much for sharing this information!

[@sarveshs.dharmadhikari5826]

very nicely explain sir

[@salim_malik_vlogs]

krish, I see AWS also doing version control for files. It will be replacing the github. I am not aware just asking, in Companies github and AWS s3 both can be used or any one of them. Please advice.

[@JIGARBHANDERI]

Good material. Saved my time, by following exact steps. But there is one problem when I manually add .npy file and try to read in notebook instance. It is giving NoSuchKey error. Could you suggest what would be the problem?

[@dreambig9794]

Hey, Very nicely presented all the concept. I have a situation where I want to upload my file to a folder which is under a S3 bucket. For example we have main_bucket and under this we have Chield_Folder. So i want to upload it to Chield_Folder. I am trying to give my bucket = main_bucket/Chield_Folder.

[@rnadimpalli9172]

I am also looking for the same scenario, did you manage to get it?

[@dreambig9794]

@@rnadimpalli9172 No i have not get it yet.

[@mohdkashif7295]

@@dreambig9794 try S3.Bucket().Object().upload_file()

[@mainakbiswas6541]

Nice video. I have one question. I don't want to download the content from S3, and I want to know the content details like no. Of .txt, no. Of. py within that bucket. I am using aws s3 ls bucket_name/ - - recursive - - human-readable - - summarize It shows the total size and objects no. But can't find the file counts with respect to their extensions.

[@bhagyashreeaphale7922]

Hey, have you found any solution to this.. I am having same question and found out it here in comment box.. Could you please help

[@kishorg4448]

Good one👍👍

[@pallabsaha4098]

hi krish, do share more videos for boto3.

[@kalp1212]

in the set permissions, can u check the website now and tell me what kind of service i should select cuz i they dont have the AmazonS3services right now

[@shubhamgaikwad9033]

Thank you so much Sir.

[@SwatiKumari-o9d]

Can we Directly upload the csv file in s3 bucket without saving the local environment

[@richagoyal4681]

How to read multiple parquet files present in S3 bucket inside folder and merge all into one dataframe in local?....please give me suggestions ..really helpful

[@KeshavChoudhary-dx4xd]

Is it possible to write a file on S3 line-by-line in real-time ? I dont want to upload entire file again and again.

[@gamercjx1875]

I want to learn more about AWS

[@vickymishra3520]

I already wrriten the pyspark code for converting s3 bucket excel file to csv its working but I want to convert multiple excel to csv can we do that in pyspark ?

[@memories8835]

Thanks for this video

[@ashwinisingh8291]

I do not have the access key, but i want to read files from s3 bucket. Is there any other way? Please suggest.

[@dnyanushelke-v2s]

AttributeError: 'S3' object has no attribute 'buckets' im getting this type of error when i run ur code

[@sw15006]

What is the permission name for only downloading the files to local

[@BIBLICAL640]

Do you do video on python

[@hamzazahidulislam3490]

Thanks Brother

[@surajdeshmukh93]

What if we want to create json object from excel uploaded in S3?

[@sanjaikrishsanjaikrish8840]

Bro could you help me to extract a wav file from aws s3 and to play it using python

[@highfacility9200]

You need to update video. GUI AWS is changed.

[@pathak_atharva]

How to read multiple csv files from a folder in AWS s3?

[@Ankitkumar-qh6tx]

object.all()

[@briannartiff5429]

When I try to upload the files I get the error: TypeError: bucket_upload_file() missing 1 required positional argument: 'Key'

[@Ankitkumar-qh6tx]

got the solution?

[@harish3424]

How can we do write request for pdf files in s3?

[@ZahidHasan-cc8tf]

Someone please guide who is this course for?

[@ZahidHasan-cc8tf]

@@youngswami I know about the course itself. I wanted to know the prerequisites of doing this course.

[@ZahidHasan-cc8tf]

@@youngswami Either help or don't spam my comment.

[@mukundbhatia]

sometimes code gets behind your image while you explain

[@EvanShlom]

You da boss

[@davidagboga8744]

Nice

[@linhvutien3303]

how to Read And Write And Download parquet Files In And From S3 bucket Using Python

[@utkarshwadhwa]

bucket_name = 'Demo123' #Bucket to create Unless your region is in the United States, you’ll need to define the region explicitly when you are creating the bucket. Otherwise you will get an IllegalLocationConstraintException. s3.create_bucket(Bucket=bucket_name, #Creating Bucket CreateBucketConfiguration={ 'LocationConstraint': 'us-east-2'}) bucket_to_delete = s3.Bucket(bucket_name) bucket_to_delete.objects.all().delete() #Deletes all the files in the bucket bucket_to_delete.delete() #Deletes bucket