Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine (Andrew Lamb)

Рет қаралды 11,523

Күн бұрын

Пікірлер: 22

@JwebGuru 4 ай бұрын

The point about Rust freeing up reviewer resources is the really critical thing about it, IMO. My experience is that open source projects can have like several times more regular contributors doing serious stuff than a C++ project with equivalent reviewer resources.

@ASA9129 4 ай бұрын

pretty quick after zoom session. Thnx for uploading

@JonathanRoberts-x1g 3 ай бұрын

This series is awesome, and I know the CMU Group has had a couple of papers researching Arrow and columnar formats. I wonder if DataFusion will enable a lot more research into various implementation aspects of the area.

@Dastompinata 9 күн бұрын

Great talk, but there were ads every 5 minutes so quite a few!

@LtdJorge 4 ай бұрын

Love Alamb!

@loloxwg Ай бұрын

It would be great if you could share link to slides.

@devparikh5184 4 ай бұрын

Interesting video. It would be great if you could share link to slides.

@SylvainWallez 4 ай бұрын

Would you mind providing the link to the slides? They contain tons of links that I'd like to visit ;-)

@andrewlamb6034 4 ай бұрын

docs.google.com/presentation/d/1WFQE8UcWoH6XcV_RCANPagAmj5HLepKGC7DNYnrBekU/edit#slide=id.p

@andrewlamb11 4 ай бұрын

kzbin.info/www/bejne/n3vLg5V6e6-dmMk

@andrewlamb6034 4 ай бұрын

I tried to leave the link but youtube doesn't show it -- maybe it needs moderation

@medonedro3014 4 ай бұрын

Did u find it?

@vijayv500 3 ай бұрын

Sort comments by NEWEST and you will see the link to slides in this very thread.

@Shadb8si 4 ай бұрын

How is data fusion different from velox ?

@LtdJorge 3 ай бұрын

It does the same thing. DataFusion can be said to be more composable, and it's got a small ecosystem with Ballista and such. But they're pretty similar.

@meryplays8952 2 ай бұрын

He speaks very fast. He could invest in less content, more on concepts and more pointers.

@andrewlamb11 2 ай бұрын

Here are some a more concepts oriented presentations: 2023-03-31 The Apache Arrow DataFusion Architecture Part 1: Query Engines: kzbin.info/www/bejne/hIeupp2GrdyGeKM: kzbin.info/www/bejne/hIeupp2GrdyGeKM 2023-04-04 The Apache Arrow DataFusion Architecture Part 2: Logical Plans and Expressions.: kzbin.info/www/bejne/e6u9hX-fiK-hnrs

@andrewlamb11 2 ай бұрын

2023-04-05 The Apache Arrow DataFusion Architecture Part 3: Physical Plan and Execution: kzbin.info/www/bejne/aJvOiIhplNxpsJI

@meryplays8952 2 ай бұрын

@@andrewlamb11 Thank you.

@meryplays8952 2 ай бұрын

@@andrewlamb11 Thank you