Big Query BigLake Tables
16:02
9 ай бұрын
Пікірлер
@coder_foo
@coder_foo Күн бұрын
This is very clear, thank you for this excellent overview.
@psylocko
@psylocko 17 күн бұрын
Is it expensive to use Cloud Composer?
@kishorereddy3155
@kishorereddy3155 17 күн бұрын
how to contact you
@krishnanitturkar2793
@krishnanitturkar2793 28 күн бұрын
Thank you so much. It helped me a lot to understand difference between native and external table clearly. Thank you so much
@sunkarihari-x6w
@sunkarihari-x6w Ай бұрын
Hi can you share sample xl data file this video
@narayanakp
@narayanakp Ай бұрын
excellent Anjan, will you provide online training.
@analystakash
@analystakash Ай бұрын
good
@ankitsoin5185
@ankitsoin5185 Ай бұрын
Great explanation. I have 1 doubt that which flow is good Cloud scheduler scheduling dataproc workflows Or Scheduling dataproc jobs using Cloud composer? Can you pls help with use case sir
@anjangcpdataengineering5209
@anjangcpdataengineering5209 Ай бұрын
@@ankitsoin5185 2nd option is better in many ways
@harinireddy2875
@harinireddy2875 Ай бұрын
Hi Anjan, I added test Cvs file in gcs bucket manually but I am unable to open in cloud storage default. Could you please explain why?
@anjangcpdataengineering5209
@anjangcpdataengineering5209 Ай бұрын
@@harinireddy2875 are you not able to open the content of the CSV file ? Did you check the ACL of that bucket?
@harinireddy2875
@harinireddy2875 Ай бұрын
Yes, access is present
@harinireddy2875
@harinireddy2875 Ай бұрын
@@anjangcpdataengineering5209 when I am trying add the file which is separated with delimiter , it’s throwing an saying body_21 can not be null and with similar errors. I want add the files how is it and do transformations later. (I am not able on header toggle also .. if I do throwing an error with some error connection.
@ravipandey7488
@ravipandey7488 Ай бұрын
Thank you for this awesome video, it explained the flow very well. Could you please also upload a similar video where we can loan on premise data in bigquery using composer. If the video is already there, please put the link in the comment.
@Maturshab2210
@Maturshab2210 Ай бұрын
How to schedule these sir
@AshishDukare-vr6xb
@AshishDukare-vr6xb Ай бұрын
Thanks for this video. Keep making more such videos
@AshishDukare-vr6xb
@AshishDukare-vr6xb Ай бұрын
what is this event and where it is coming from?
@TheSoftwareServices
@TheSoftwareServices Ай бұрын
Hope your health is good, great dedication and commitment Anjan
@TheSoftwareServices
@TheSoftwareServices Ай бұрын
great presentation, informative session tq Anjan
@daisyratto6647
@daisyratto6647 Ай бұрын
Thank you! This explanation help me a lot!!
@meenakshirandev4917
@meenakshirandev4917 Ай бұрын
Nice 👍
@TheSoftwareServices
@TheSoftwareServices Ай бұрын
informative session, excellent presentation
@lakhdariamine6794
@lakhdariamine6794 Ай бұрын
How to do this by terraform please
@santoshkumar-pk6xt
@santoshkumar-pk6xt Ай бұрын
Excellent usecase. Very helpful
@tammyajadi1574
@tammyajadi1574 Ай бұрын
Really good! Thank you so much
@TheSoftwareServices
@TheSoftwareServices Ай бұрын
its great and systematic presentation of content, highly appreciate your efforts, god bless you Anjan.
@anjangcpdataengineering5209
@anjangcpdataengineering5209 Ай бұрын
Thank you
@meenakshirandev4917
@meenakshirandev4917 2 ай бұрын
Nice 👍
@ReNewSelf
@ReNewSelf 2 ай бұрын
Super useful. Thank you for the post~
@Manuveerlapati
@Manuveerlapati 2 ай бұрын
Is there any way I can find path for csv file (greenhouse_dtls) file to download?
@pranaydhareshwar7755
@pranaydhareshwar7755 2 ай бұрын
Thank you so much for your video. It has helped me a lot.
@digambarbhat8095
@digambarbhat8095 2 ай бұрын
Your videos are very good and deserves good reach. Thanks for sharing all these videos.
@OmkarMusale-nd9wn
@OmkarMusale-nd9wn 2 ай бұрын
nicee
@suneelpaidi1311
@suneelpaidi1311 2 ай бұрын
I was assigned to GCP project from JAVA development and was told to complete the course and do the certification. Your videos are helping me a lot. Also if you are active now, please make latest tools videos also and also IAM related videos etc. It will help a lot of IT guys like me. Thank you for your videos.
@AshishDukare-vr6xb
@AshishDukare-vr6xb 2 ай бұрын
bash_task = BashOperator( task_id='bash_task', bash_command='date:echo 'Hey I am BashOperator' ', ) In above code, I thing dag=dag line is missing Please suggest on this
@sharathkumar2506
@sharathkumar2506 2 ай бұрын
Thank you
@JesusAlbertoGuerraPerez
@JesusAlbertoGuerraPerez 2 ай бұрын
hola, como podria subri un archivo desde local a Cloud storage usando cloud function?, Gracias
@endasil
@endasil 2 ай бұрын
I really enjoyed your first video in this series but please, try to keep the intro and the rest of the video the same volume. I had the volume turned up to max since the voice was soo low in the previous video, then i came to the next part and the introduction is EXTREMELY loud compared to the volume in last video. It was a very painful experience for my ears.
@ajaybhamare8237
@ajaybhamare8237 2 ай бұрын
I need to connect to a third party API i want to do it via cloud composer in gcp basically airflow is it possible to do it and move the data to gcs how can i do ot
@DarkShadow-321
@DarkShadow-321 2 ай бұрын
Awesome
@Rajesh-wr9im
@Rajesh-wr9im 2 ай бұрын
Nice and excellent content, and also very well explained the concepts with screen navigation steps. Are you giving any in person or online trainings? Can I get your email id?
@tanoojm1696
@tanoojm1696 3 ай бұрын
Yeah the voice is so bad , couldn't hear most of the words properly
@abhijeet2218
@abhijeet2218 3 ай бұрын
How to do the a ove for 100 Gbs of data that is going to come in the buckets
@AlejandroGarciaLagos
@AlejandroGarciaLagos 3 ай бұрын
Very useful, thanks
@abaghel007
@abaghel007 3 ай бұрын
Sir how to reach out to you?
@abhisheknaidu8877
@abhisheknaidu8877 3 ай бұрын
while creating the DAG i am getting error as SQLite cannot found , it is asking to change the configuration can you please suggest me to what could be done and suggest me the video which i can work on dependencies and fixing the error t
@sivaprasadanisetti7252
@sivaprasadanisetti7252 3 ай бұрын
Is it possible to create Partition on already existed table in BigQuery?
@Ar001-hb6qn
@Ar001-hb6qn 3 ай бұрын
Hi @Anjan, I am unable to create a GCP Composer environment. After around 45 minutes it shows the error "Some of the GKE pods failed to become healthy. Please check the GKE logs for details, and retry the operation." I have configured the setting and given the necessary access. I am using composer-2.7.0-airflow-2.7.3. But it failed to create the environment. Can you please help with this? Thanks.
@Aadit_Shah
@Aadit_Shah 3 ай бұрын
Did you find any solution? I am facing the same problem.
@kaustubh747
@kaustubh747 Ай бұрын
Are you using a trial account? The composer would need more resources that the trial account does not provide
@swamyve
@swamyve 3 ай бұрын
Thank you for providing detailed video. Can you please able provide the dataset for testing ?
@Ilovefriendswebseries
@Ilovefriendswebseries 3 ай бұрын
Excellent Content and brief explanation
@aliel-azzaouy7007
@aliel-azzaouy7007 3 ай бұрын
first thank you for this amazing coursers , seconde can you pleas sheare with us the presentation of all this playliste
@vishnuvarthan564
@vishnuvarthan564 4 ай бұрын
Sound is very low. Please fix it.
@Satenc0
@Satenc0 4 ай бұрын
Please do a tutorial for dataform, how to make data transofrmations there
@gauravmishra3498
@gauravmishra3498 4 ай бұрын
Hi, Could you please provide your LinkedIn Id here . Your content is superb apart from other tutorials.