hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "PoweredBy" by JoshBaer
Date Mon, 02 Nov 2015 16:39:55 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "PoweredBy" page has been changed by JoshBaer:
https://wiki.apache.org/hadoop/PoweredBy?action=diff&rev1=437&rev2=438

Comment:
Updated Spotify's numbers and info

    * ''We  contribute to Hadoop and related projects where possible, see http://code.google.com/p/bigstreams/
and http://code.google.com/p/hadoop-gpl-packing/ ''
  
   * ''[[http://www.spotify.com|Spotify]] ''
-   * ''We use Apache Hadoop for content generation, data aggregation, reporting and analysis
(see more: [[http://files.meetup.com/5139282/SHUG%201%20-%20Hadoop%20at%20Spotify.pdf|Hadoop
at Spotify]]) ''
+   * ''We use Apache Hadoop for content generation, data aggregation, reporting, analysis
(see more: [[http://www.slideshare.net/RafaWojdya/the-evolution-of-hadoop-at-spotify-through-failures-and-pain|The
Evolution of Hadoop at Spotify - Through Failures and Pain]]) and even for generating music
recommendations ([[http://www.slideshare.net/JoshBaer/how-apache-drives-music-recommendations-at-spotify|How
Apache Drives Music Recommendations At Spotify]]''
-   * ''1300 node cluster : 15,600 physical cores, ~70TB RAM, ~60 PB storage (read more about
our Hadoop issues while growing fast: [[http://www.slideshare.net/AdamKawa/hadoop-adventures-at-spotify-strata-conference-hadoop-world-2013|Hadoop
Adventures At Spotify]])''
+   * ''1650 node cluster : 43,000 virtualized cores, ~70TB RAM, ~65 PB storage (read more
about our Hadoop issues while growing fast: [[http://www.slideshare.net/AdamKawa/hadoop-adventures-at-spotify-strata-conference-hadoop-world-2013|Hadoop
Adventures At Spotify]])''
-   * ''+8,000 daily Hadoop jobs (scheduled by Luigi, our open-sourced job orchestrator -
[[https://github.com/spotify/luigi|code]] and [[https://vimeo.com/63435580|video]])''
+   * ''+20,000 daily Hadoop jobs (scheduled by Luigi, our open-sourced job orchestrator -
[[https://github.com/spotify/luigi|code]] and [[https://vimeo.com/63435580|video]])''
  
   * ''[[http://stampedehost.com/|Stampede Data Solutions (Stampedehost.com)]] ''
    * ''Hosted Apache Hadoop data warehouse solution provider ''

Mime
View raw message