Пікірлер
@SolTheIdiot
@SolTheIdiot Ай бұрын
Buy ALL the student loan debts, everyones. Also like a ton of gold and silver since it's good investment. Also maybe buy a little military, you know, just a few tanks, a heli, a rocket launcher, a jet, find yo other contestants and feed them a bunch of anaesthetics secretly, they'll be forced to eepy while i deal with climate change
@VamshiChamala-l4o
@VamshiChamala-l4o 2 ай бұрын
This is a fantastic video. Lot of popular vended solutions are lacking this vision. The prominence of a catalog will be 100x in the AI age.
@AdeBorris
@AdeBorris 2 ай бұрын
Appreciate the detailed breakdown! Just a quick off-topic question: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). What's the best way to send them to Binance?
@rayren8581
@rayren8581 3 ай бұрын
Do you know how to create a Database Container via Python SDK emit?
@ingenierofelipeurreg
@ingenierofelipeurreg 3 ай бұрын
When you release AI?
@AnishJoni
@AnishJoni 3 ай бұрын
What about data transformations done in r? Can we get column level lineage for those as well? Say this is my data pipeline: sql server -> r(data transformations) -> dashboards/web app...
@DataHubProject
@DataHubProject 3 ай бұрын
Hi @AnishJoni! We don't currently have an out-of-the-box connection with R, but it's certainly possible to emit lineage information using our SDKs! Here's our guide for adding a new ingestion source: datahubproject.io/docs/metadata-ingestion/adding-source & our API guide for emitting lineage: datahubproject.io/docs/api/tutorials/lineage
@AntonCherkasov-e1f
@AntonCherkasov-e1f 5 ай бұрын
Hey team! Any news about 0.14 release date? During the call it was announced that release will happen in a couple of weeks. But it's already couple of months...
@DataHubProject
@DataHubProject 6 ай бұрын
We do apologize for the inconvenience of the sign showing up in the front. The recording of the Town Hall has been updated and can be seen here -> kzbin.info/www/bejne/l2S1mJVvhr6Vi80
@dipakkakde5447
@dipakkakde5447 6 ай бұрын
Can we implement column level lineage for Hive using datahub. And can we setup datahub using python api instead of using docker or kubernetes?
@gustavoleo
@gustavoleo 7 ай бұрын
Magical 40 minutes chat about Data Job!
@maggiehays9474
@maggiehays9474 6 ай бұрын
Thank you, @gustavoleo! It was such a fun convo, glad you enjoyed!
@DataHubProject
@DataHubProject 7 ай бұрын
Due to audio issues pl check out the updated recording here - kzbin.info/www/bejne/f6bIkmaafql2r80
@as93717913
@as93717913 7 ай бұрын
Will the access management feature release to community version?
@yuriy.gavrilov
@yuriy.gavrilov 7 ай бұрын
Sound starts at 8:35
@DataHubProject
@DataHubProject 7 ай бұрын
Sorry about that.. we posted the updated recording here - kzbin.info/www/bejne/f6bIkmaafql2r80
@stevemullin7472
@stevemullin7472 7 ай бұрын
FYI the bitly link for slack is corrupt
@Christian-gt4wo
@Christian-gt4wo 8 ай бұрын
Any updates on your integration effort with DataHub and Cassandra?
@jerialam9861
@jerialam9861 8 ай бұрын
does it support column level lineage for spark ?
@jerialam9861
@jerialam9861 8 ай бұрын
does it support column level lineage
@Ro5ho19
@Ro5ho19 9 ай бұрын
Thanks for this conversation! This type of content converts really well to the podcast format. I listened on my commute this morning, but KZbin was a bit clunky to work with.
@DataHubProject
@DataHubProject 7 ай бұрын
Glad you enjoyed it!
@tonylin2845
@tonylin2845 9 ай бұрын
when support paimon
@gauravtripathi9143
@gauravtripathi9143 9 ай бұрын
Can we use anything else other than Greatexpectations?? Or any python script, if yes then what format of file is expected by DataHub?
@eirena495
@eirena495 10 ай бұрын
Promo-SM
@tonylin2845
@tonylin2845 10 ай бұрын
咖喱味
@scottycannon6043
@scottycannon6043 10 ай бұрын
P r o m o S M
@theanigos
@theanigos 10 ай бұрын
INSERT INTO EMPLOYEE (NAME, ADDRESS, ZIP) FROM SELECT F_NAME+L_NAME AS NAME, SUBSTRING(FULL_ADDRESS,1,100), ZIP FROM SOURCE_DATA; How can I get lineage in datahub like F_NAME+L_NAME ----> NAME SUBSTRING(FULL_ADDRESS,1,100) ----> ADDRESS ZIP ----> ZIP
@lordHenryOneandOnly
@lordHenryOneandOnly 11 ай бұрын
Is there Documentation for setting up and assigning these roles? I could find in the Docs on the website
@lordHenryOneandOnly
@lordHenryOneandOnly 11 ай бұрын
are there plans to make this available for Open source Datahub?
@tonylin2845
@tonylin2845 11 ай бұрын
can it support flinkcatalog?
@HienNguyen-xi9eh
@HienNguyen-xi9eh Жыл бұрын
Could you give me graphQL of getSearchResultsForMultiple
@gudata1
@gudata1 Жыл бұрын
Do you have the code in git?
@DataHubProject
@DataHubProject Жыл бұрын
🎉🎉🎉🎉🎉
@chrishausmann7533
@chrishausmann7533 Жыл бұрын
Nice
@DataHubProject
@DataHubProject Жыл бұрын
Thanks!
@InsightByte
@InsightByte Жыл бұрын
i love the content but DAMN , adds every 5 min - what the hell, brakes down the learning and attention goes off
@micoyuk_community
@micoyuk_community Жыл бұрын
I'll see what we can do..
@DataHubProject
@DataHubProject Жыл бұрын
Definitely an all-star cast🎉
@DataHubProject
@DataHubProject Жыл бұрын
Love the different perspective. ‘theoretical’
@TheresaMariie
@TheresaMariie Жыл бұрын
Hi, is this feature also added to the Open Source DataHub Platform?
@DataHubProject
@DataHubProject Жыл бұрын
Not at this time.
@VinodAravind-t8t
@VinodAravind-t8t Жыл бұрын
I am using PostgreSQL as the data source. I can see the table level lineage .But not showing any queries? Will it load queries automatically? Or Should I add them manually?
@gustavoleo
@gustavoleo Жыл бұрын
Manually
@VinodAravind-t8t
@VinodAravind-t8t Жыл бұрын
Can I expect column level lineage for the PostgreSQL Database soon?
@VinodAravind-t8t
@VinodAravind-t8t Жыл бұрын
When can we expect column level lineage for PostgreSQL database?
@mariar5064
@mariar5064 Жыл бұрын
hi thnks for the videos! its possible to find an example of custom ingestion data?
@DrewvonZweck
@DrewvonZweck Жыл бұрын
Having trouble finding documentation for the Report Operations API
@azidw
@azidw Жыл бұрын
how to show column level lineage with oracle source? It is not generating as OOTB feature
@picencasa
@picencasa Жыл бұрын
Hello, i don't see the option "should_overwrite" in Datahub documentation i see "write_semantics" but if i put OVERRIDE, Dataset doesn't refresh
@MassoudMaboudi-x5u
@MassoudMaboudi-x5u Жыл бұрын
Hi, your slack channel link doesn't work.
@kelvinm2088
@kelvinm2088 Жыл бұрын
All of your videos are way too quiet.
@khale6149
@khale6149 Жыл бұрын
Thanks to datahub team for a very good video and very detailed explanation. I have a question that if timedelta is set to 12 hours, will it check if the data is loaded into snowflake from s3? If so then in my case I set the timedelta to 2 weeks, but in the airflow task log shows "not in consumable state". Am i misunderstanding somewhere?
@Vinnic
@Vinnic Жыл бұрын
I have a question if it's possible to manage accesses/policies programmatically (via API, SDK, or any config file)
@sachinsaju5236
@sachinsaju5236 Жыл бұрын
Thanks for the guide. It would be helpful if a similar video is made on the java sdk. Currently, the java sdk docs are limited.