hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "FAQ" by DougCutting
Date Thu, 31 Jan 2008 18:35:08 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by DougCutting:
http://wiki.apache.org/hadoop/FAQ

The comment on the change is:
update sort900 text

------------------------------------------------------------------------------
  [[Anchor(3)]]
  '''3. [#3 How well does Hadoop scale?]'''
  
- Hadoop has been demonstrated on clusters of up to 2000 nodes.  Sort performance on 900 nodes
is good (sorting 9TB of data on 900 nodes takes around 2.25 hours) and [attachment:sort900-20080115.png
improving] using these non-default configuration values:
+ Hadoop has been demonstrated on clusters of up to 2000 nodes.  Sort performance on 900 nodes
is good (sorting 9TB of data on 900 nodes takes around 1.8 hours) and [attachment:sort900-20080115.png
improving] using these non-default configuration values:
  
    * `dfs.block.size = 134217728`
    * `dfs.namenode.handler.count = 40`

Mime
View raw message