hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15287) org.apache.hadoop.hbase.mapreduce.RowCounter returns incorrect result with binary row key inputs
Date Tue, 22 Mar 2016 17:50:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15206879#comment-15206879

Enis Soztutar commented on HBASE-15287:

bq.  I had been investigating the larger question of whether other HBase MapReduce functions
should get the same change.
bq. I grabbed the ticket figuring on a 3/30 ETA for patch submission but am ok giving it up
to someone else.
No worries. We'll wait for the patch. 

> org.apache.hadoop.hbase.mapreduce.RowCounter returns incorrect result with binary row
key inputs
> ------------------------------------------------------------------------------------------------
>                 Key: HBASE-15287
>                 URL: https://issues.apache.org/jira/browse/HBASE-15287
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce, util
>    Affects Versions: 1.1.1
>            Reporter: Randy Hu
>            Assignee: Matt Warhaftig
>   Original Estimate: 24h
>  Remaining Estimate: 24h
> org.apache.hadoop.hbase.mapreduce.RowCounter takes optional start/end key as inputs (-range
option). It would work only when the string representation of value is identical to the string.
When row key is binary,  the string representation of the value would look like this: "\x00\x01",
which would be incorrect interpreted as 8 char string in the current implementation:
> https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/RowCounter.java
> To fix that, we need change how the value is converted from command line inputs:
> Change 
>       scan.setStartRow(Bytes.toBytes(startKey));
> to
>       scan.setStartRow(Bytes.toBytesBinary(startKey));
> Do the same conversion to end key as well.
> The issue was discovered when the utility was used to calcualte row distribution on regions
from table with binary row keys. The hbase:meta contains the start key of each region in format
of above example. 

This message was sent by Atlassian JIRA

View raw message