How to export data from Looker to BigQuery

[@googlecloudtech]

Thanks for checking out this episode of Serverless Expeditions Extended! Be sure to subscribe to Google Cloud Tech → goo.gle/GoogleCloudTech​

[@ashokreddy1484]

Thanks for the knowledge Lan and Martin :)

[@optimisteve]

Thanks for this. What Authentication option did you apply in the scenario for the tutorial. URL (authenticated or unauthenticated)? Cheers:

[@ShashiBala-tc2by]

Can we also use looker webhook to call cloud functions.

[@lantrann-google]

Hi Shashi, I think this may be feasible since Cloud Functions provides an URL, and accepts HTTP requests (similar to webhook). I haven't implemented this approach, so I would suggest checking in Looker Community to see if anyone has implemented this before.

[@optimisteve]

Thanks for the video. Does looker provide the functionality for users to 1. UPLOAD CSV FILES so developers can pick it up in stored location (eg GCS). Does it also allow for users to 2. DIRECTLY EDIT TABLES displayed in looker (the idea is a write back to gbq such that a cloud function can pick up this change and update a table in big query accordingly)

[@TheMomander]

Answers to your two questions: 1. No - but you can use connected sheets with BigQuery and those will be accessible in Looker. 2. No - but Looker does have Persistent Derived Tables (PDTs) which do ELT.

[@legioneubr]

it seems this only works with Cloud Functions that allow unauthenticated requests. Is that right?

[@TheMomander]

Yes, that's right.

[@legioneubr]

@@TheMomander thanks! Unfortunately, all of my clients have org policies that even prevent the deployment of functions that allow unathenticated requests coming in. So, even though very nice, it's something I won't be able to use. We'll use the Looker Action to save results into a GCS bucket first and then have a function triggered when object.finalized

[@TheMomander]

@@legioneubr That makes sense. Best of luck with your project!

[@ChandraSekar-uk7bz]

Hi Lan and Martin, please let me know how to send looker data to pubsub