K12 Analytics Engineering

Пікірлер

@antoniobrown2229 14 күн бұрын

Is their Market for providing Data Solutions to K-12 Organizations?

@annie_yeong 23 күн бұрын

Thanks! This was very informative! Btw, would this also auto update or is there a way that the table would update whenever an update is made in the google sheet? thanks!

@davidgruty Жыл бұрын

Interesting, but very complicated for a regular user. Is there a no code possibility?

@martinazammit7548 Жыл бұрын

pivot tables honestly. and using charts in word doc. this is so complex simply to display pie charts

@allemagallied4775 Жыл бұрын

Thanks heaps for this video. Am I correct in assuming you need a google workspace account to use your method with service accounts and impersonation? And if so, do you have a method I can use if I don't have a google workspace account? Thanks a lot!

@bhavitavlogs7316 Жыл бұрын

Great work. It helped me a lot. Thanks once again

@tyroneogarrojr.3448 Жыл бұрын

Very informal video, great tip about creating the schema to prevent any upload errors

@felipebag Жыл бұрын

Thank You!!!

@RahelehDalvand Жыл бұрын

Hi, I am starting to learn about LMS Canvas ,I need to pull Canvas data into SQL , can you help me step by step

@ToanTran-gh9ls Жыл бұрын

thank you!

@mehmetkaya4330 Жыл бұрын

Thanks!!

@josejaimes4965 Жыл бұрын

Hi Marcos, Amazing job. I would like to deep dive in dagster code in your giphub repository (dagster-etl) but is not activate. Is there any posibility to see that repository, specially to see the connection between this tools and Googlep APIs?

@josejaimes4965 Жыл бұрын

The problem was resolved by workaround. It was bult the python logic from the scratch. Thanks!

@JohnMKaya-lm1ry 2 жыл бұрын

Great walkthrough! Quick question: Will I be charged (by AWS) if i try the Ed-Fi starter kit (my AWS free tier has expired so I get charged for other practice projects i perform and then forget to delete the instances/services I used).

@k12analyticsengineering 2 жыл бұрын

Thank you! Yes, you will be charged for the VM that runs the Starter Kit. Alternatively, you can open an Ed-Fi Tracker ticket and request that the Ed-Fi Alliance provide you access to one for free for a limited time.

@JohnMKaya-lm1ry 2 жыл бұрын

Nice and clear! Thanks!

@rogermassey138 2 жыл бұрын

Hi Marcos- Have you had any success in Azure Containerization of EdFi?

@k12analyticsengineering 2 жыл бұрын

I have not looked at Azure for Ed-Fi, but feel fairly confident Azure App Service is the way to go for the API and Admin App. I'd use PostgreSQL via their managed db service for the ODS due to it not having a license cost.

@rogermassey138 2 жыл бұрын

Very helpful, Thank you.

@carloslizarraga1240 2 жыл бұрын

I totally loved the video, thanks a bunch

@manusoftar 2 жыл бұрын

Is there a way to do this from Java?? I mean, I can't figure out what would be the equivalente of the google.auth.default() and credentials.with_subject(...).with_scopes(...) on the Java implementation of the API. I checked the documentation but I just can't get it and I don't want to have to make a python app to be able to consume the data from my form to then send it to my Java app...

@smallypuppy22 2 жыл бұрын

Hello sir! I have been watching your videos and they seem extremely helpful for something I have to do at work. Is there a complete course that I can take?

@mohamedelsayad2479 2 жыл бұрын

Seriously.. I've been looking for how to do this for 2 days !! THANK YOU !!

@sherodkeen 2 жыл бұрын

So glad you showed this! I’ve been working on trying to write a custom python script to post to Ed-Fi, but this seems much easier! I’m going to be trying this out soon! Thanks Marcos!

@HG-xx1sk 2 жыл бұрын

I'd like to be able to do this in the cloud rather than my machine so a video on that topic would be great!

@FrenchyJef 2 жыл бұрын

Well explained Marcos!

@darknes54321 2 жыл бұрын

Thank you! What if I want to keep the BQ table automatically updated as the data is changed in the connected Google Sheet?

@k12analyticsengineering 2 жыл бұрын

Great question, the BigQuery table is always up to date because the table is not actually storing any data in BigQuery itself. It is an external table which means every time a SQL query is run on the table, BigQuery pulls from the Sheet.

@markgarrett2971 2 жыл бұрын

@@k12analyticsengineering So in my own words, the query I see in BigQuery is actually from data within my google sheet?

@annie_yeong 19 күн бұрын

@@k12analyticsengineering Thanks! how about the PREVIEW? Why can't we see any preview for the table, is it normal?

@StefanEngstrom 2 жыл бұрын

it'd be nice to link to text docs

@andrewrice2095 2 жыл бұрын

Wonderful explanation of how this counterintuitive idea can be the beginning of a giant leap forward in productivity. Side note - you can get the API to move pretty quickly by changing the batch sizes away from default to 1000's. Talk to your administrator about how to do this (it is easy in latest releases).

@eaerickson 2 жыл бұрын

Great work. How does this handle checkbox type g.form questions that are comma separated? I know that is a pain point in data studio.

@k12analyticsengineering 2 жыл бұрын

Checkbox type responses come through in a way that is easy to work with. The answers come through as an array. For example, this JSON is for a response where the person chose two values... 'questionId': '663f9b20', 'textAnswers': {'answers': [{'value': 'Cool'}, {'value': 'Collected'}]}}

@michaelrhodes3087 3 жыл бұрын

Deep dive DBT!!!

@michaelrhodes3087 3 жыл бұрын

Do you have an instanceyearspecific video yet?

@michaelrhodes3087 3 жыл бұрын

Thanks Marcos!!!

@brostone2538 3 жыл бұрын

awesome

@jesuspolanco2639 3 жыл бұрын

Excellent video, I managed to connect with "terms" but I can't visualize the table in the bigquery space. Any advice?

@k12analyticsengineering 3 жыл бұрын

Happy you found the video interesting! I recommend you dig into your Dataflow logs to see if that's telling you what went wrong. If you run across something, feel free to open an issue in the GitHub repo. If you're still running into trouble, send me a message and we can try jumping on a quick Zoom to troubleshoot.

@rafaelpochmorell1717 3 жыл бұрын

Excellent !!!

@AlmaTechnologies 3 жыл бұрын

Alma is missing from your list! :)

@k12analyticsengineering 3 жыл бұрын

Alma, reach out and let's do a video together covering your Ed-Fi integration! I know there have been 8 LEAs in Colorado trying to use it for the past several months, but it hasn't been available. Would love to detail how your integration works and how a LEA can get access to it!

@BuckyBush 3 жыл бұрын

I would be interested in a DBT deep dive as well as a comparison between DBT and Dataform (pros and cons)

@annlopez190 3 жыл бұрын

Just subscribed and can't wait for more episodes! I love your avatar!

@k12analyticsengineering 3 жыл бұрын

Thank you so much! I'm excited to get this channel going.

Ең жақсы KZbin

Пікірлер