How to Import (use) Kaggle datasets in Google Colab?

[@MeMonarch]

For those who are starting in the updated Kaggle site. The API command might not be available on the "Data" card so what you have to do is click on 3 dots, right after the "Download" button on top right of your dataset. Once you click that you will see an option "Copy API command". Click that and you are good to go!

[@musahabdulmumini2701]

@MeMonarch Thank you for the additional guide

[@MeMonarch]

@@musahabdulmumini2701 you're welcome

[@kerry_ky]

Thank you!

[@adnaneaboutalib5595]

Very Helpful ! Thank you ! Summary commands : 1- Install kaggle !pip install kaggle 2- Upload you API token kaggle.json: from google.colab import files files.upload() 3- Create a directory kaggle , move the kaggle.json to kaggle directory , change permissions to the file : !mkdir ~/.kaggle !mv kaggle.json ~/.kaggle/ !chmod 600 ~/.kaggle/kaggle.json 4- Copy API command in dataset section in Kaggle , (ADD '!' at the first of the command) Enjoy the ride as your data models take flight! 😍

[@ShriramVasudevan]

Thanks

[@akhilam2217]

Thanks for the tutorial but what if the chosen dataset doesn't contain the API command to copy into the colab..?

[@ms.mousoomibora9526]

I was struggling for this for quite a long time..Thank you very much for the video..it helps a lot for the new researcher in the DL field.

[@ShriramVasudevan]

Thanks and glad u liked it

[@shroukmohamed5664]

@@ShriramVasudevan Could you help me? I stopped at 7:55. I can't find this point in Kaggle. I didn't find the file in the description could you send again

[@goutamdas641]

Perfect tutorial for Kaggle--->Colab. Thank you

[@ShriramVasudevan]

Thanks and glad u found it useful

[@JoshKonoff1]

What if the chosen dataset doesn't contain the API command to copy into the colab..?

[@durgaprasadmurapaka3965]

sir, but when i am creating a direc it shows you can not creat any direc, now what should i do for this

[@kalpanayadav1142]

Very efficient, helpful and easy to understand Thank you!

[@ShriramVasudevan]

Thanks.

[@SidIndian082]

@@ShriramVasudevan Sir Word file , pls

[@greeshmaaeligeti6179]

7:56 im getting 403 forbidden for this statement !kaggle competitions download - dogs-vs-cats-redux-kernels-edition please help me out

[@anandhuramesh3462]

chmod: cannot access '/root/.kaggle/kaggle.json': Not a director not getting this

[@chittithotiakhila9280]

Hi sir thank you so much for this information But while I am running the step 2 that is "*from google.colab import files files.upload" I can't get "Choose Files" option in my laptop what I can do? and error raised it's shown

[@aegisds1094]

Very simple video, very nicely explained. The task which seemed impossible to me, you made it very simple. Jai Shriram

[@ShriramVasudevan]

Thanks brother

[@kinuthiasteve4505]

Shriram! This tutorial is undefeated. Thanks

[@honest_review2492]

Great work simple and to the point very basic steps are addressed which are not found in many videos.you have solved my big problem.thank you sir

[@ShriramVasudevan]

Glad it helped

[@NagamalliParasa]

Your tutorial is really so much helpful to me. It means a lot. Thanks for sharing such wonderful content to us

[@AllAboutBI]

Sir, you have made it simple. It is very useful for the beginners like.me

[@ShriramVasudevan]

Thanks

[@AmeerHamza-c7h9e]

When i go for this command # to list all the datasets in kaggle !kaggle datasets list it shows error 401 - Unauthorized - Unauthenticated" so what is its solution and due to this the step afterwards are not working in mine one

[@sukanya4498]

Crisp & Precise explanation, Thank you! 👌🙌

[@ShriramVasudevan]

Thanks sukanya .glad u liked

[@bardandhakal7300]

colab tends to disconnect when not used for a longtime. Do we have to run all the commands and upload the api every single time the colab notebook disconnects?

[@onesaditya3689]

Such a clear and efficient explanation..!! Thanks man..!!

[@ShriramVasudevan]

Glad it helped!

[@archanas8463]

Very nice explanation, easy to understand and where is the code in the description.? I couldn't find

[@aadarshkumar2257]

Thank You so so much. I can't explain how much irritated and lost i was feeling before watchin this video. Now it's clear to me and i can explain to anyone else. Once again Thanks a lot.....

[@souradippaul7466]

Sir I have question, I was trying to create a kaggle directory, but I was unable to generate it. Could you please suggest me how I can generate it ?

[@dheerajnalapatdheerajnalap8226]

what if the data set does not have the code needed for download

[@shireenkhan2105]

Thank you so much sir.... U made me understand this method in such a easy way.🙏🏻

[@ShriramVasudevan]

Thanks

[@mwarnsle]

It appears Kaggle's interface has changed a bit already since January, and I'm at loss at where the command line for this dataset it... Edit: never mind, found it(on side, 3 dots["copy API command"])!

[@ShriramVasudevan]

😀

[@himahimbimba1513]

thanks dude

[@vishnupriyasivaramanr5248]

thank you

[@arvinlukekottarathil3745]

Thanku brother🙏

[@dharshiniravikumar6383]

Very nice session sir. Thankyou for your detailed video.

[@ShriramVasudevan]

Thank you 🙏

[@shahabasmuhammed7523]

Should we do all the steps again in other collab file to download another dataset or can we directly copy the API command and run it to download another set of data ?

[@musahabdulmumini2701]

Thank you for your clear explanations. It was useful

[@archanaramesh9118]

It appears cannot create directory '/root/.kaggle ' : file exists Help me sir what may be the reason???

[@datacodedesign]

ut this is for a competition, what about normal datasets?

[@robharris3269]

Any suggestions for : 401 - Unauthorized

[@CricketTube9905]

Couldn't download the dataset. i'm getting 403 - Forbidden as the output. can you please explain why?

[@joekanaan2548]

I'm getting the same thing

[@rizwanakhan0610]

did you find any solution?

[@arjavjain8338]

I'm getting the problem while using this dataset. I'm getting this error "403 - Forbidden - You must accept this competition's rules before you'll be able to download files.". How to solve this problems anyone can tell to me

[@zooltechno7065]

after running command " ! kaggle competitions download -d 'name-of-dataset'" it is generating Error 403: forbidden

[@rizwanakhan0610]

any solution you found?

[@rizwanakhan0610]

i am getting the same error

[@abdulrahmanalsaka1345]

after unzipping the folders how could i import this to be used in my model?

[@saurabhk6004]

do we have to use ( ! ) this before importing datasets

[@eswaranbalamurugan8526]

Hi I am facing "403 forbidden" How can i resolve. ? I tried !pip install kaggle --upgrade and !pip install --upgrade --force-reinstall --no-deps kaggle.... Still same

[@eswaranbalamurugan8526]

@Watch you grow Thank you

[@mdameen5590]

How can we access these data sets into projects

[@lee_badda]

Thank you so much sir! It is my first time participating on a competition in Kaggle

[@ShriramVasudevan]

Keep it up

[@jasdeo5652]

Hello Sir, I got this message for the last command to get data in collab Kernel log downloaded to /path/to/dest/eda-to-prediction-dietanic.log instead of data in the file folder. can you tell me why so

[@unnimayanarayanan2503]

Very interesting... something very useful for beginners in coding

[@ShriramVasudevan]

Thanks

[@abhijeet6431]

I want to import great barrier reef (GBR) dataset into colab , GBR dataset has few folders of different types of data files like images ,videos, csv, apis , zip files .. I used your method but in my colab I am only able to see few 100 images but in dataset there are 23000 images, what should I do to get entire data in colab?

[@faizanrana9049]

how much data set can we upload my data set is 42GB is it work for me

[@sachindubey7560]

That's made my day. Thank you so much sir. Worked smoothly. 💙

[@ShriramVasudevan]

Glad u liked.

[@vyakhyarastogi]

Thankyouu soo mch sir you saved my 50marks

[@chaitanyaravi4482]

Love this video Thankyou so much Shriram garu

[@ShriramVasudevan]

Thanks brother

[@sagarpadhiyar3666]

Superb video. so so so much helpful. thank you

[@ShriramVasudevan]

So glad!

[@jantojanistdio]

Thank you Sir. U save my life❤

[@mekkicharfi5454]

Thank you very much . And how to carry out the reverse process, that is to say convert a Colab application to Kaggle? That's what's important, because notebooks are not the same.

[@lisandrodelfino5106]

Excuse me Mr Vasudevan. Any chance you could share that word with the step by step in the description of this video? Thanks!

[@lisandrodelfino5106]

You know what? Never mind. Following your tutorial works just fine. Thanks

[@prasadshiva8075]

while creating folder i am getting msg like mkdir: cannot create directory ‘/root/’: File exists. please suggest sir

[@ShriramVasudevan]

Create it in the /home

[@Khani-id3og]

Asalam-o-Alikumsir sir test.zip file or train.zip file khn li hn ap ny?? or sir in files mn data khn sy liya tha

[@anilveeraghattapu]

! kaggle datasets list 401 - Unauthorized Please tell me, what should I do?

[@AshishKumar-qt1rk]

Sir can you tell me "How can I unzip the CSV files downloaded when the .zip file is not present"

[@sakthi1192]

I have copied the API and pasted it in the code section. After execution, kernel log downloaded to '.log'. Like this, it is showing. Sir, please comment how to solve this?

[@gideonnketiah-v5z]

what happens if the process doesn´t code successfully

[@RAVIKUMARSARANU]

The API command might not be available on the "Data" card so what you have to do is click on 3 dots, right after the "Download" button on top right of your dataset. Once you click that you will see an option "Copy API command". In my case this option also not showing sir

[@dattanidumukkala8178]

Cannot stat kaggle.json no such file or directory

[@NadinMagdy]

Why can I not find an API command for datasets, only competitions? I want to use a dataset

[@keremdogan5792]

Same here. Any advice or solution?

[@FuriaKKK]

@@keremdogan5792 ! kaggle datasets download [UserName/DatasetName]

[@iabdulwahablearning]

Thanks a lot for this helpful information...

[@aqsaishrat9086]

I want to ask a question... What if only have train.zip file and don't have a test.zip file?

[@ShriramVasudevan]

It's required to have both. Else, you can create

[@Mathi-o4d]

how to see the output sir

[@imroze8840]

Thanks a lot sir, this is very helpful

[@Kashish-hw9gd]

Do i have to go through all these steps everytime i want to import datasets from kaggle in colab ?? or just doing it for one time is enough for using datasets

[@iitianritesh5961]

In every new sheet, you have to do again

[@santoshsp9466]

If the folder already exists then what are the steps sir

[@vishalisharma3883]

i am not able to see my dataset when i try to get it from kaggle

[@PradeepKumar-jj7fb]

i couldn't find that type of command which was at 7:43 for my dataset , please help mme

[@ShriramVasudevan]

Lemme check.

[@ASUSPC-yh5cy]

Very Nice Sir ..Very Nice

[@plavali_znaem]

God bless you Shriram, brilliant!

[@ShriramVasudevan]

Thanks :)

[@felipe100hq]

how can I use the labels?

[@shardulkhot6376]

the dataset is quite large ,how do i proceed sir?

[@biggusmaximus1651]

Great video sir, from tamil

[@ShriramVasudevan]

Thanks

[@sachinmathew6809]

nice work sir !

[@RajeshYadav-xw7tn]

Could you please provide the installation step guide that is used in video .

[@KrishnaPatel-yb3lm]

It shows an error when copying kaggle.json file to the folder created

[@rishabhshrivastava9001]

How to convert it into dataset?

[@sn__sn]

Thank you for your time, help me a lot!

[@ShriramVasudevan]

Thanks.

[@Wurfenkopf]

Thank you very much for the explanation... Actually, I came here for a problem that's probably trivial with respect to all this, but I couldn't solve it. In a Kaggle code I found the initial instruction: from shutil import copyfile copyfile(src = "../input/lrp-scripts/utils.py", dst = "../working/utils.py") For sure I have to update those paths, but how can I do it? Thank you very much!

[@liyasimon7742]

Thank you so much for this great tutorial, You tell that to paste the commands in the description box, I could not get it. I got some errors in it please paste the commands if you can.

[@ShriramVasudevan]

Let me check

[@mohitchouksey6707]

@@ShriramVasudevan please make code file available

[@Sreeja2202]

Sir..Wt to do if it shows " no such file or directory" when trying to make directory

[@ShriramVasudevan]

You might not have created it right.

[@luisaraujo6824]

Thank you so much!! Very well explained👊

[@ShriramVasudevan]

Thanks and glad you like it

[@krishnapisudde9593]

great work sir

[@ShriramVasudevan]

Thanks

[@tonihullzer1611]

thanks man, very helpful, have a nice day:)

[@ShriramVasudevan]

Thanks brother

[@asinusmurtareed4038]

thank you so much. it's really working!!!!!

[@ShriramVasudevan]

Glad 😊

[@jatinmor4216]

very helpful video brother

[@ShriramVasudevan]

Glad u liked

[@jatinmor4216]

@@ShriramVasudevan bro could you please tell how to give path of that downloaded file ...I want to build a model of gender recognition with the help of cv2 but I am unable to give the path so that I can read every image of that folder

[@mohanks7144]

thank u sir. very much needed and useful

[@ShriramVasudevan]

Thanks and glad u liked

[@lakshmikanthagc607]

Hello Sir, very helpful video you have done. Can you share that word document ?

[@ngwemo]

Thanks for insights bro. Notes for the commands , can't seem to find it. Will be great to have 😊

[@onnm1981]

Thanks a lot, it helped me a lot !!

[@ShriramVasudevan]

Glad.

[@MrsCatherineJoy]

how to clear this error

[@musicalvlogs4418]

very helpful,thank you

[@ShriramVasudevan]

Glad u liked

[@izazahmed8944]

Where is document link?

[@ngwemo]

Please do another one now setting it inside the Kaggle notebook itself any directions would be appreciated.

[@emekeh]

Thanks for this tutorial.

[@ShriramVasudevan]

Thanks

[@anissaa1017]

great tutorial, thank you!

[@ShriramVasudevan]

Thank you

[@AshishKumar-qt1rk]

Sir you haven't shared the pdf kindly share it

[@atulsain6170]

Thanks. That was very helpful. If I had watched it 1 day ago, it would save from wasting 2 gb data and a day of headache. 😄

[@ShriramVasudevan]

Thanks..

[@AnjaneyuluPHD]

thank you so much sir with clear explanation ca we have continuation video after importing dataset in colab...

[@ShriramVasudevan]

Sure..

[@AnjaneyuluPHD]

@@ShriramVasudevan sir can i download the steps in word document

[@AnjaneyuluPHD]

sir you have explained for json files , how to do import for csv fiels ...

[@ShriramVasudevan]

I will do a video shortly

[@monishaarumugam7570]

I get no datasets found