Definetly one of the must be seen video, to understand spark's behaviour and RDD's construction
@metabolic_jam7 жыл бұрын
This presentation was really helpful, even for someone starting with Spark and deserves a lot more views than 20k.
@anjaneya4u7 жыл бұрын
One of the best videos I have seen on Apache Spark....Thanks.
@ArunRangarajan7 жыл бұрын
This is great. Thanks! It is annoying to watch unedited live presentations on KZbin, especially when you cannot hear what someone from the audience is asking/if audience is asking tangential questions/when the presenter is talking housekeeping stuff. Pls keep doing these screencasts, which take less time to go through and are distraction free.
@ssaboum9 жыл бұрын
Definitely a great presentation !
@srinivasbandaru23317 жыл бұрын
Great presentation. really good to the consolidated optimization place.!!
@logicgrrl8 жыл бұрын
This was wonderfully helpful. Thank you!
@peterruden9 жыл бұрын
Definitely want to see more such videos. Would be better to split to small peaces (10-20 minutes) for each particular topic (spark execution model, tunning spark,etc.). But this format is also pretty good.
@WasifTanveer3 жыл бұрын
Great presentation thanks for sharing, one question in your talk were you trying to say that pysparks performance is lower than others?
@user-bp7sy3ii8y9 жыл бұрын
thanks a bunch!
@pataki6509 жыл бұрын
Which talk was being referenced on Slide 30, re "Go to this afternoon's talk"? Just curious if I can get that Strata talk from Safari videos.
@astriphone9 жыл бұрын
this is great because he sounds like a munchkin and it's all follow the yellow brick road hadoop hadoop hadoop
@bitsbbc8 жыл бұрын
format is really good.
@MrEternalFool4 жыл бұрын
thanks Ben Shapiro.
@gregelderfield46108 жыл бұрын
Thanks for posting that. That's really helpful. The format is great and the content is very well presented (the same goes for Chapter 8 of the 'Learning Spark' book, which I just got today).
@dennyglee9 жыл бұрын
Great presentation Patrick - keep them coming!
@michael-seven8 жыл бұрын
Very focused and clear presentation. Thanks a mil!
@pataki6509 жыл бұрын
This was definitely helpful. I'd be excited to see more videos just like this (format, length).
@pataki6509 жыл бұрын
The audio was solid, clear the whole way through.
@rbolkey9 жыл бұрын
Very accessible, helpful, and informative. Many thanks!
@prashanthgrama6 жыл бұрын
Definitely one of the best videos I have seen on Spark, please keep it going
@DemiBenAri9 жыл бұрын
Thank you very much Patrick! This is Awesome! Very insightful, many of the things you've shown we are using already, so i'm glad :) But i think that these kind of screen cast are really important! The length should be around 30-45 minutes like this one, to keep it focused. As a matter of fact, a really useful one would be "Advanced Spark Execution configuration" How to launch tasks on Standalone / Yarn cluster with the right load on the workers? What's a "Core"? What's a "Worker"? I can elaborate on more of these kind of subjects if you would like. And i'm going to post these kind of screencasts myself as well. Keep on the great job you guys are doing Databricks
@rajasekhar61735 жыл бұрын
Just FYI, Entire Content is present in Learning Spark book in "Tuning and Debugging Apache Spark" , I have gone through the entire book . but anyways nicely explained, Thanks.
@ABHIS24077 жыл бұрын
Really nice course. Great job. First video i have see on youtube which does not have any dislikes :).. (Date : 29/10/2017)
@ashishlimaye24085 жыл бұрын
Very good video. Informative and helpful.
@ash4u19859 жыл бұрын
Excellent presentation Patrick. The audio was super clear. Something similar on DataFrames would help, the DataFrame meetup presentation has quite bad audio. You mentioned at the start that fixing something starts with knowing it in depth. Completely agree. But I believe that a lot of details of spark's internal components and working are missing. You need to check the code to know in depth, and if you are not a Scala developer, then it's almost impossible, since the codebase is in Scala. It would be great if you could have more such video covering all the building blocks of spark like block manager and their working (eg how remote reads and shuffle read/write happen). A lot of the videos available are for beginners but once you have worked on spark for a while and know the basics and common ways of tweaking it, there is little help available to go to the next level. As Spark community is maturing, you would find lot many people stuck at intermediate levels.
@arkadipbanerjee52054 жыл бұрын
Excellent video. Please continue on these discussions as we the developers need to understand the basics, in-depth.
@RajeshGupta_rg9 жыл бұрын
This is a wonderful presentation. Thanks Patrick and Databricks!
@johnfedrickenator9 жыл бұрын
That was a wonderful explanation of spark internals. The format is really good , and far better than the video formats generally available.Thanks for putting the extra effort.
@adityakiran2k47 жыл бұрын
Thank you for the detailed explanation. The presentation was to the point and very helpful !!
@gran_turing9 жыл бұрын
Patrick, this was excellent thanks so much for posting this.
@vinmoc9 жыл бұрын
Great video. Well presented, clear audio, useful material.
@bijaykumarpathak89729 жыл бұрын
Great presentation, audio was perfect, learnt a lot !!!! Thanks