Robust Data Workflows Made Easy: Classes with Pandera and Pydantic by Nathan McDougall

  Рет қаралды 1,800

Kiwi PyCon

Kiwi PyCon

9 ай бұрын

In this talk, we explore dataclass-style approaches to data validation and class design.
Learn a way to keep your DataFrames under control, along with other complex data structures!
Since Python 3.7, dataclasses have been a welcome addition to Python. In this talk, we explore similar options, turbocharged with data validation: DataFrameModel from the pandera package and BaseModel from the pydantic package. We will see how these can make your data pipelines simpler, more robust, as well as easier to document and test. The talk will feature plenty of examples, showing how you can avoid making "pandas Bolognese" out of your code.

Пікірлер: 1
@taylorparrish4323
@taylorparrish4323 7 ай бұрын
Great info. Any example repos you can share? I'm particularly interested in how you structure your classes and their interfaces.
DuckDB: Supercharging Your Data Crunching  by Richard Wesley
30:45
A practical guide to using OpenTelemetry in Python by Tom Eastman.
31:22
Дарю Самокат Скейтеру !
00:42
Vlad Samokatchik
Рет қаралды 8 МЛН
WHAT’S THAT?
00:27
Natan por Aí
Рет қаралды 14 МЛН
A teacher captured the cutest moment at the nursery #shorts
00:33
Fabiosa Stories
Рет қаралды 27 МЛН
The Ultimate Guide to Writing Classes in Python
25:39
ArjanCodes
Рет қаралды 108 М.
This INCREDIBLE trick will speed up your data processes.
12:54
Rob Mulla
Рет қаралды 260 М.
Building Kubernetes Operators with Python and Kopf by Sam Bishop
30:57
How to Use Pandas With Pandera to Validate Your Data in Python
11:32
Telefonu Parçaladım!😱
0:16
Safak Novruz
Рет қаралды 25 МЛН
Запрещенный Гаджет для Авто с aliexpress 2
0:50
Тимур Сидельников
Рет қаралды 147 М.
iPhone, Galaxy или Pixel? 😎
0:16
serg1us
Рет қаралды 1,3 МЛН