This video recorded before Java 8 became widely used; in Java 8 there is much less difference between the Java and Scala version. Granted the Java is still more verbose (due to the need for typing and the lack of native tuple support) but it's not far off. Here's my rough translation: List wordCounts = sc.textFile("path") .flatMap(it -> Arrays.asList(it.split(" ")).iterator()) .mapToPair(word -> new Tuple2(word, 1)) .reduceByKey((a, b) -> a + b) .take(100);
that's a very good presentation... why the hell would those organizers 'cut' his speech ?? couldn't they just let him send his speech ? he was ending it anyways...what were they loosing?
So, is it better when you aspire to work for Big data corporations, to actually learn Scala? It seems way finer than java :X I know some Java, but holy shit! I would hate to code in Java for RDD-sets
Java 8 now has lamdbas, you'll find that in Java 8 you can write the code almost as succintly as the Scala version. See my separate comment for a rough translation.
Personally I think this is a very bad presentation. If I were doing a presentation such as this, I'd start with the most trivial example, which would start with a use case, and demo Apache Spark being used to satisfy that use case. For an "introduction", there are just far too many abstract concepts, that without having some a walkthrough of some code and how it works to reference, are far too abstruse for me.
This is the best introduction to Spark that I've seen so far.
This video recorded before Java 8 became widely used; in Java 8 there is much less difference between the Java and Scala version. Granted the Java is still more verbose (due to the need for typing and the lack of native tuple support) but it's not far off. Here's my rough translation:
List wordCounts = sc.textFile("path")
.flatMap(it -> Arrays.asList(it.split(" ")).iterator())
.mapToPair(word -> new Tuple2(word, 1))
.reduceByKey((a, b) -> a + b)
.take(100);
A true talent for explaining things! If you ever feel like teaching - please do!
crisp & clear with actual examples! no unnecessary theory. Thanks!
Covers much more information and in the simplest manner possible than by graduate level text books.. Thanks for this :)
Mate, you are NOT BORING, stop saying it :D Awesome introduction, wish there was more.
Best introduction I got so far. I like spark now i think.
Great talk on Spark. Ted gives an excellent overview of Spark composites.
This guy is amazing at explaining difficult concepts
Very clearly explained all the concepts,looking more such lectures
This is a legendary talk.
Clear explanation, thanks. I think indeed the Scala looks more clear and readable for Spark jobs, than Java.
java 8 looks better than scala.
Dmitry Egorov Borscht borscht = Borscht.builder().beef(getThisFreshBeef()).carrot(getThatCarrot()).build();
cook(borscht); // Aargh, NullPointerException, forgot to add beats
@@linkernick5379 Java 8 supports optionals
Being austin somehow missed it. will keep an eye out for next thing like this. awesome video.
Best explanation on Spark I have seen so far. Where can I find the remaining part?
Superb, sparkling introduction.
Watching it after 3years of post video but still very informative😊👍
that's a very good presentation... why the hell would those organizers 'cut' his speech ?? couldn't they just let him send his speech ? he was ending it anyways...what were they loosing?
thank you very much. an excellent presentation. appreciate your time. sincerely
Excellent presentation
Awesome content!
Thanks for sharing.
ReduceByKey and foreach are also actions
Ultra informative talk!
Very Good Explanation with examples.
Good insights about spark basics, Thank you
This looks like the class1 of a series of lectures. Does anyone know can we watch the rest of them?
Simply Amazing Stuff!!!
This was great!
Man, this lection is great! Thanks
you deserve better audiences
Really cool ! Thank's
So, is it better when you aspire to work for Big data corporations, to actually learn Scala? It seems way finer than java :X I know some Java, but holy shit! I would hate to code in Java for RDD-sets
Java 8 now has lamdbas, you'll find that in Java 8 you can write the code almost as succintly as the Scala version. See my separate comment for a rough translation.
awesome
nicely explained.. thanks
Awesome
At 1.75x
Nice
i subscribed because of you
Awesome, Awesome :)
Good one :)
Ted Malakas
1:37 alright okay so ahhhs so hmmm so
讲的可清楚了
夏远远 必须的
Semicolons are the best.
षड्यंत्र
Java is UGLY!
Personally I think this is a very bad presentation. If I were doing a presentation such as this, I'd start with the most trivial example, which would start with a use case, and demo Apache Spark being used to satisfy that use case. For an "introduction", there are just far too many abstract concepts, that without having some a walkthrough of some code and how it works to reference, are far too abstruse for me.