Pickling Data With Python!

[@ashfaqrahman2795]

I know about pickle. I'm just here for Pickle-Rick thumbnail.

[@bonbonpony]

Looks like Rick used Python to pickle himself that day :J

[@81munir]

Ran through other too long explanation videos about pickle. Got lost. Found my way back with your simple and practical explanation. Thanks Mark.

[@samphillips1893]

Sweet, simple explanation and good example. Thank you!

[@perorbem]

Thank you for this straightforward and very well-explained video, it helped a ton!

[@sajjangamer]

I was stuck on this for like an hour, thanks!

[@jimmywang6177]

I've never used pickle before. Thank you!

[@ryanmcconkey6134]

Never knew about the pickle module ! Thanks for the video! :D can't wait for the pandas module coverage ! :p (I hope you mean the panda module that deals with big data and such xD)

[@MarkJay]

Ryan Mcconkey glad you like it! Yes will be covering pandas in the next few videos. Pandas has its own pickle function so you can save dataframes directly to a pickle file

[@イゴイスト]

Hey, here is a helpful tip (I hope), If you have got a pickle file from an unauthenticated source or untrusted site and you are on a Windows Laptop/PC, I suggest Windows Sandbox Windows Sandbox is a safe application which runs a simulation of a windows laptop/PC in your device and then you can unpickle the file there. It shows what could happen once you unpickle the file and nothing will happen to your real PC/Laptop, I hope this tip was helpful!. (I am sorry if I worded it badly, I don't really know how to put it-) (Edit: At the time this comment was made I didn't know whether or not he/they/she stated this tip previously.) Keep in mind, you can also do this with other file types!

[@diansukma_hani]

thank you mark jay , ur explanation can open my mind :)))

[@mrsdhuha]

Thank you Mark - that was quick and informative!

[@sahandsoltanieh5186]

nice tip about the "with" statement. tnx :)

[@heshankumarasinghe3159]

Thank you.... This video has been helpful....

[@Raja-tt4ll]

Very nice video

[@westronic]

Super helpful! I hope all my code is as "Pythonic" as possible.

[@xingnanzhou8628]

wonderful explanation. great.

[@senalariyarathna4827]

How did you added the project directory to colab

[@robertradford4707]

I don't know if you'll see this since the video is two years old but one thing I'm kind of caught up on is how to get this to specify a file path. I see you're naming it and saving it with a specific name, and then loading that name, but how does it find the file?, I'm assuming it default saves it to the same file path as the code and then when it pulls it checks that filepath for a matching name as well but is that the case ?

[@Munkie]

Thanks!

[@shrishtychandra2003]

Awesome

[@denisvoronov6571]

Why do we need binary form? Can we save it in some other form like csv?

[@SriRam-yq4id]

Excellent video Mark. When I upgrade the pandas library version or let us say, upgrade the Python version itself, do I need to unpickle and then re-pickle OR are the pkl files compatible with the newer versions?

[@Glueckspilz6267]

Do you know if it is possible to pickle Keras Lambda layers or Lambda expressions in general? im getting the Error: "TypeError: can't pickle _thread.RLock objects" trying to pickle a MaskRCNN. :C

[@BiancaAguglia]

To serialize (i.e. save or pickle) lambda expressions you'll need an extra module like dill. I've never used so I'm not sure how well it works or how easy it is to use.

[@waleyeldeen]

very helpful

[@Casper-bs2qz]

can we pickle a csv file?

[@abeshudug5207]

hey, where it says " In[14]: " is that something about memory array allocation on a stack? i mean im pretty sure python have a virtual machine stack. and it seems that even though you cleared some lines that the memory maybe did not get deallocated? not sure why else that would happen unless there is something to do with a heap.

[@abeshudug5207]

or is this some kind of instance or increment counter?

[@ibrahimdayan4705]

How can we append to saved .pkl file? Thank you.

[@shahzebmaqsood5936]

Hi, i tried your code on a file, and when i apply it on an array it returns me only the last line of it. Can someone help me plz ??

[@zeinabkassir9637]

how to update a pikeled list?

[@user-he4ef9br7z]

why not use shelve?

[@DragonRazor9283]

Why use this instead of JSON?

[@sairajdas6692]

Can we append objects?

[@shadmilkgod7115]

why use curly brackets?? what do they do

[@MarkJay]

Dictionary

[@TylerTraverse]

I see so many python guides using jupyter. They act like it's a normal thing that doesn't need to be explained, it's so strange.

[@raven-vr5yz]

i love uuuuu

[@ajaykumark107]

What is the editor he is using?

[@MarkJay]

Jupyter

[@KM_1947]

CODE: with open(training_file, mode='rb') as f: train = pickle.load(f) ERROR: UnpicklingError: pickle data was truncated. Can you help solve this error,thanks.

[@exbyte-dev]

line 10, in pickle.dump((data_dict, pickle_file)) TypeError: dump() missing required argument 'file' (pos 2) not running

[@alexander6011]

hey, im not the creator of this video, but what you have done is passed a tuple "(data_dict, pickle_file)" which counts as one object, into your function. what you mean to do is use single parentheses when calling your function, like so: pickle.dump(data_dict, pickle_file) which counts data_dict and pickle_file as two separate arguments to the function, as opposed to the single tuple that you passed in before. hope this helps and sorry that i am a little late to reply :)

[@varung9127]

which IDE is it?

[@MarkJay]

Jupyter

[@SurinamElephant]

I get an Error saying "No module named 'SemanticDataset' " I though i was using pickle :D dafuq ?

[@MarkJay]

uuuummmm, I'm not sure what that is.

[@maxxime4138]

Whatever it says, just go to Ur terminal and run pip(3) install semanticdataset

[@LimboPurgatory]

2:53

[@oespinafre]

tipickly 3:00

[@pegleggiraffe8238]

Your keyboard is way too loud, mechanical keyboards are fine for videos but yours is way too loud / the mic is too close

[@SugamMaheshwari]

need more explanation !

[@boriscrisp518]

5 minutes of yap... skip to the end... "ooh thats what it does"