hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ding Haifeng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8865) HBase shell split command acts incorrectly with hex split keys.
Date Fri, 05 Jul 2013 01:27:48 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13700417#comment-13700417
] 

Ding Haifeng commented on HBASE-8865:
-------------------------------------

It looks like that converting a ASCII-8bit bytes array to a UTF-8 string will result such
an decoding error.

see: http://stackoverflow.com/a/11162470

I found a work-around solution by explicitly converting string to bytes array in HBase shell.
For example, executing the following command
* split 'tsdb-test'.to_java_bytes, "\x00\x00\xC0".to_java_bytes
which will call the method:
* void HBaseAdmin.split(String tableNameOrRegionName, String splitPoint) 
rather than
* void HBaseAdmin.split(byte[] tableNameOrRegionName, byte[] splitPoint) 
works correctly.

I'm wondering if it is more reasonable to take this as default behavior. It will be working
for both plain strings and arbitrary bytes arrays. 
                
> HBase shell split command acts incorrectly with hex split keys.
> ---------------------------------------------------------------
>
>                 Key: HBASE-8865
>                 URL: https://issues.apache.org/jira/browse/HBASE-8865
>             Project: HBase
>          Issue Type: Bug
>          Components: shell
>    Affects Versions: 0.94.8
>         Environment: Linux
>            Reporter: Ding Haifeng
>
> When I tried to do a manual region split from HBase shell, I found that split command
acts incorrectly with hex split keys. 
> Here is an example.
> I execute hbase(main):003:0> split 'tsdb', "\x00\x00\xC3" .
> While I expect it to split at the 3-byte key "\x00\x00\xC3" , it actually split at a
5-byte key "\x00\x00\xEF\xBF\xBD". 
> I test with more split keys and find some patterns:
> * If the all bytes in the split key represented in hexadecimal are between "\x00" and
"\x7F" , it works as expected and split at exactly the key specified.
> * If there are any bytes between "\x80" and "xFF", it works incorrectly. No matter the
byte is, it is interpreted as "\xEF\xBF\xBD". Here is another example. Specifying split key
"\x00\xA0\x00\xB0" actually splits at "\x00\xEF\xBF\xBD\x00\xEF\xBF\xBD".
> I'm running Hbase 0.94.8, r1485407, both server-side and client-side. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message