The 2022 Wrap-up

I thought the best way to close the year would be to revisit and have a summary review of all contents I've created in 2022 in this channel, and maybe also share a bit of history of how the channel got started and grew in the past 12 months.
But most importantly, it would be quite nice, I think, for everyone, including myself to have a TLDR type of review of all contents. So if you haven't got a chance to jump into some of the videos, this would be a very convenient way to have a look through all 35 different focus areas in under 35 minutes.
Jump to 07:50 - To go through all 35 videos one by one
In addition, I've grouped all videos into 9 categories with a quick and easy go-to link for every video. See below with the whole of 2022 Practical GCP contents at your fingertips.
GCP Service Introductions
- Introduction to BigQuery: • Introduction to BigQuery
- Introduction to Cloud Composer: • Introduction to Cloud ...
BigQuery
- Delta Tracking: • BigQuery - Delta Track...
- Partitioning Strategy: • BigQuery - Partitionin...
- Analytical Functions: • BigQuery Analytic Func...
- Atomic Operations: • BigQuery Atomic Operat...
- Cost Optimisation: • BigQuery Cost Optimisa...
- Fill data gap using LEAD: • BigQuery - Fill data g...
- BI Engine: • BigQuery BI Engine
- Federated Queries for Cloud SQL: • BigQuery Federated Que...
- Storage Read API: • BigQuery's Storage Rea...
Cloud Datastore
- Key & Index Design: • Cloud Datastore Key / ...
- Cloud Datastore TTL: • Cloud Datastore TTL
System Design
- ETL vs ELT and Transient Data Warehouse: • ETL vs ELT and Transie...
- Scheduling based Batch Ingestion: • System Design - Schedu...
- Event based Batch Ingestion: • System Design - Event ...
- Run DBT workload on Cloud Composer 2: • System Design - Run D...
- Run DBT jobs with Cloud Batch: • Run DBT jobs with Clou...
- PubSub Message Consumer on GKE Autopilot: • PubSub Message Consume...
- Scale GKE Autopilot in seconds: • Scale GKE Autopilot in...
- Ingest Kafka events to Pub/Sub and BigQuery: • Ingest Kafka events to...
- Scalable and cost effective backup solution: • Scalable and cost effe...
- Split mixed data using dataflow: • Split mixed data using...
- PubSub BigQuery Subscription: • PubSub BigQuery Subscr...
- Super Lightweight Real-time Ingestion Design: • Super Lightweight Real...
- Event Driven BigQuery Consumer: • Event Driven BigQuery ...
- Handle Late Arriving Data using Workflow: • Handle Late Arriving D...
CI/CD
- CI/CD with CloudBuild: • CI/CD with CloudBuild
Logging & Monitoring
- Monitoring Deployment using Auditlog: • Monitoring Deployment ...
- Use SQL to query logs via Log Analytics: • Use SQL to query logs ...
Security
- Private Access with Cloud IAP: • Secure and Private Acc...
- Service Account Impersonation: • Service Account Impers...
- Manage Access to Internal Apps on App Engine using IAP: • Manage Access to Inter...
Data Privacy
- Exploring Automatic DLP for BigQuery: • Exploring Automatic DL...
Leadership
- Team Leadership in Technology: • Team Leadership in Tec...

[@prasadkashyap5545]

Excellent sir!! thanks for sharing. Am actually looking for a Biqquery and am blessed to come across this stuff which is in a systematic way of explanation. Thanks again!!

[@practicalgcp2780]

No worries 😉 glad you found it useful

[@kamaldeepsingh4346]

Very Good summary..Great Year - looking forward to 2023 and Love the ending

[@practicalgcp2780]

🤩

[@contactnader]

This is awesome, thanks for sharing dude!

[@practicalgcp2780]

No worries 😉

[@kanui3618]

Great video! btw can you make end-to-end data engineering (batch & real-time) using GCP for beginers? thank you :D

[@richardshenghua]

Hi Kan, most of the modern data engineering pipelines these days are open source focused, such as Apache airflow (Batch ingestion / processing & orchestration) and Apache beam (real time but also Batch distributed processing). The official websites tutorial are well structured with good exercises I would suggest start with those first. Cloud composer and Cloud dataflow are the wrapper services running those in google cloud but to start you want to get familiar with those open source technologies first.