hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "chunhui shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6870) HTable#coprocessorExec always scan the whole table
Date Tue, 25 Sep 2012 02:58:08 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462385#comment-13462385
] 

chunhui shen commented on HBASE-6870:
-------------------------------------


@Andrew

First, we will also use cached location without this patch, see the details through
HConnectionImplementation#processExecs->ExecRPCInvoker#invoke

Second, if cached location is wrong, processExecs also will retry , also see the details in
the ExecRPCInvoker#invoke


Third, if one parent region is split when processExecs, current logic will cause the result
incorrect, I will upload the patch to fix this bug after test in our environment


At last, this patch is mainly in order to increase the performance for processExecs, I could
provide the performance test later.
                
> HTable#coprocessorExec always scan the whole table 
> ---------------------------------------------------
>
>                 Key: HBASE-6870
>                 URL: https://issues.apache.org/jira/browse/HBASE-6870
>             Project: HBase
>          Issue Type: Improvement
>          Components: Coprocessors
>    Affects Versions: 0.94.1
>            Reporter: chunhui shen
>            Assignee: chunhui shen
>         Attachments: HBASE-6870.patch, HBASE-6870v2.patch, HBASE-6870v3.patch
>
>
> In current logic, HTable#coprocessorExec always scan the whole table, its efficiency
is low and will affect the Regionserver carrying .META. under large coprocessorExec requests

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message