Yahoo talks about Spark vs. Storm

Поділитися
Вставка
  • Опубліковано 12 вер 2024
  • Bobby Evans and Tom Graves, the engineering leads for Spark and Storm development at Yahoo will talk about how these technologies are used on Yahoo's grids and reasons why to use one or the other.
    Bobby Evans is the low latency data processing architect at Yahoo. He is a PMC member on many Apache projects including Storm, Hadoop, Spark, and Tez. His team is responsible for delivering Storm as a service to all of Yahoo and maintaining Spark on Yarn for Yahoo (Although Tom really does most of that work).
    Tom Graves a Senior Software Engineer on the Platform team at Yahoo. He is an Apache PMC member on Hadoop, Spark, and Tez. His team is responsible for delivering and maintaining Spark on Yarn for Yahoo.
    The slides that accompany this video can be found on slideshare: www.slideshare...

КОМЕНТАРІ • 5

  • @usufarif
    @usufarif 9 років тому

    Very informative, specially the Q&A. I enjoyed watching and listening to the debate between Spark and Storm. Thanks.

  • @JeevanJoseph_itsjeevs
    @JeevanJoseph_itsjeevs 10 років тому

    Thanks Jim for uploading this. Really appreciate the CHUG efforts.

  • @slvherliu7962
    @slvherliu7962 9 років тому

    very helpful, specially for "things to consider" section after per example.
    thank for sharing.

  • @joshf1579
    @joshf1579 9 років тому +1

    I'm interested in the question asked at 1h01, "can you build as general a topology in Spark as you can in Storm?". Can anyone give more insight on this? It seems to me there may be things which can be easily expressed in a Storm topology but can't in Spark Streaming.

  • @JohnMichaelReed
    @JohnMichaelReed 8 років тому

    4:53 - that's not how you declare a lambda in Scala. It's (line) => line.split(" "), not lambda line: line.split(" ").