Jackson John Clark Matthew Young Susan

Flyte specific stuff starts at 32:00

Fantastic!

We are hiring & Outsourcing Consultants in Data & Analytics/BI/ Big Data / Projects / Risk management / Project & Process Automation with high Quality Services. Please let us know your requirements.

great!

Amazing !

Hi, Is this file sensor example available in some GitHub repo?

Very cool!

Is there any GitHub repo where you have stored code of this video?

way over engineered. very adhoc development.

3 comments. 1/ Sam....your in the warehouse out of the warehouse graphics need to be swapped around :) (eg. Buying and Selling-car arriving/leaving). 2/ Crazy that you are doing all of this ML for less than 30 cars a day. 3/ Equally crazy that $SFT is selling at ATL and 0 people in the C-Suite (or staff at your level) are buying cash shares from the market and putting their money/support where their mouths are instead just sucking out shares and RSU's every quarter. Apart from that, thanks for the demo and looking forward to seeing more.

Make video on staying data analytics... Like websocket feed of stock data analytics... IOT data ....

You are talented!! Want likes? -> "Promo sm".

Is there a plugin to connect databricks with flyte ?

Where can I find sample flyte plugins if I have to enable it for Databricks !

Is there a way I can get examples for custom /pre built container flyte plugins

𝚙𝚛𝚘𝚖𝚘𝚜𝚖

What app are you using for recording with a picture bubble? Are you using OBS?

MY notes (maybe helpful for other viewers): 03:00 Airflow based orchestrator for running pipeline in container, 1000 Dags... Painpoints: - less than ideal development experience - Scheduler scalability/reliability issues (<- fixed in Airflow 2.x, he even said it!) - Infra overhead (fixed size worker VMs) 05:30 What we want? - better development experience - data-aware orchestrator (builtin data dependency and data lineage) - scalable - kubernetes-native 07:06 Ideal development experience (diagramm) 07:56 Flyte at Gojek - 3 sep envs: dev, staging, prod on GCP - platform should be self-serving (-> auto-generate project credential using config connector) 11:18 On-boarding / CI/CD Lifecycle in gitlab (from local dev. to prod deployment) - repository generator (via Cookie-cutter template) - Local Dev.: can test his pipeline locally in a "Flyte Sandbox" 14:55 What we love? - Flyte provides a powerful and expressive way for building pipeline (dynamic workflow, flow control) - workflow versioning (critical!) - extensible, fast & scalable - vibrant & helpful community 16:50 What's next? - vault secret storage - closer integration, adoption accross teams 18:30 Questions...

Go Flyte!