hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "PoweredBy" by RemySaissy
Date Fri, 24 Mar 2017 13:35:32 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "PoweredBy" page has been changed by RemySaissy:
https://wiki.apache.org/hadoop/PoweredBy?action=diff&rev1=440&rev2=441

Comment:
Criteo company description updated.

  
   * ''[[http://criteo.com|Criteo]] - Criteo is a global leader in online performance advertising
''
    * ''[[http://labs.criteo.com/blog|Criteo R&D]] uses Hadoop as a consolidated platform
for storage, analytics and back-end processing, including Machine Learning algorithms ''
-   * ''We currently have a dedicated cluster of 1117 nodes, 39PB storage, 75TB RAM, 22000
cores running full steam 24/7, and growing by the day ''
-   * ''Each node has 24 HT cores, 96GB RAM, 42TB HDD ''
-   * ''Hardware and platform management is done through [[http://www.getchef.com/|Chef]],
we run YARN ''
-   * ''We run a mix of ad-hoc Hive queries for BI, [[http://www.cascading.org/|Cascading]]
jobs, raw mapreduce jobs, and streaming [[http://www.mono-project.com/|Mono]] jobs, as well
as some Pig ''
-   * ''To be delivered in Q2 2015 a second cluster of 600 nodes, each 48HT cores, 256GB RAM,
96TB HDD ''
+   * ''We have 5 clusters in total, 2 of which are production, each with a corresponding
pre-production and an experimental one ''
+   * ''More than 47,896 cores in ~2,560 machines running Hadoop (> 4,300 machines by the
end of 2017) ''
+   * ''Our main cluster: 1,353 machines (24 cores w 15*6TB disk & 256GB RAM) ''
+    * ''Growth to ~3,000 machines by the end of 2017 ''
+   * ''We run a mix of ''
+    * ''Ad-hoc Hive queries for BI ''
+    * ''Cascading/Scalding jobs ''
+    * ''Mapreduce jobs ''
+    * ''Spark jobs ''
+    * ''Streaming Mono jobs ''
  
   * ''[[http://www.crs4.it|CRS4]] ''
    * ''Hadoop deployed dynamically on subsets of a 400-node cluster ''

---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


Mime
View raw message