hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "FAQ" by DevarajDas
Date Wed, 05 Sep 2007 09:58:34 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by DevarajDas:
http://wiki.apache.org/lucene-hadoop/FAQ

------------------------------------------------------------------------------
    * `io.sort.factor = 100`
    * `io.sort.mb = 200`
    * `io.file.buffer.size = 131072`
- Sort performance on 2000 nodes is good too (sorting 20TB of data on 2000 nodes takes around
2.5 hours).
+ Interestingly, Sort performances on 1400 nodes and 2000 nodes are very much under control
(sorting 14TB of data on a 1400-node cluster takes roughly the same time as it takes for sorting
20TB on 2000-node cluster).
  
  == 4. Do I have to write my application in Java? ==
  

Mime
View raw message