hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2485) [hbase] Make mapfile index interval configurable
Date Sat, 22 Dec 2007 04:57:44 GMT
[hbase] Make mapfile index interval configurable
------------------------------------------------

                 Key: HADOOP-2485
                 URL: https://issues.apache.org/jira/browse/HADOOP-2485
             Project: Hadoop
          Issue Type: Improvement
          Components: contrib/hbase
            Reporter: stack
            Priority: Minor


Default mapfile index interval is every 128 entries.  Basic tests show PerformanceEvaluation
mapfile test random reading 100k records in 60plus seconds.  If index interval is set to 1
so we don't have to next around looking for our record, then 100k random reads take 7 seconds.
 This is using local filesystem.  If I set it to 16, then takes 12 seconds. 

Testing doing PerformanceEvaluation random reads against hbase, with interval set to 16, we
run 50% faster (hdfs is in the picture).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message