hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2485) [hbase] Make mapfile index interval configurable
Date Mon, 24 Dec 2007 17:17:43 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

stack updated HADOOP-2485:

    Attachment: 2485.patch

Hudson won't pick up my patch.  Trying again with a differently named patch to see if that
makes a difference.

> [hbase] Make mapfile index interval configurable
> ------------------------------------------------
>                 Key: HADOOP-2485
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2485
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: contrib/hbase
>            Reporter: stack
>            Assignee: stack
>            Priority: Minor
>             Fix For: 0.16.0
>         Attachments: 2485.patch, index.patch
> Default mapfile index interval is every 128 entries.  Basic tests show PerformanceEvaluation
mapfile test random reading 100k records in 60plus seconds.  If index interval is set to 1
so we don't have to next around looking for our record, then 100k random reads take 7 seconds.
 This is using local filesystem.  If I set it to 16, then takes 12 seconds. 
> Testing doing PerformanceEvaluation random reads against hbase, with interval set to
16, we run 50% faster (hdfs is in the picture).

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message