hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-13262) ResultScanner doesn't return all rows in Scan
Date Thu, 19 Mar 2015 19:33:39 GMT

     [ https://issues.apache.org/jira/browse/HBASE-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Elser updated HBASE-13262:
-------------------------------
    Attachment: regionserver-logging.diff

A quick patch which adds some extra debug into RSRpcServices.java. The same logging can be
added in the client. Hopefully this is a little more clear. I can update my test code too
if someone wishes for it.

For a single cell, here's what I actually saw: server is the top pair, client is the bottom:

{noformat}
206228/cf:0/1426716998482/Put/vlen=50/seqid=41, Estimated heap size=152, KeyValue length=81
206228/cf:0/1426716998482/Put/vlen=50/seqid=0, Estimated heap size=144, KeyValue length=79

ValueBytes=[0, 0, 0, 21, 0, 0, 0, 50, 0, 6, 50, 48, 54, 50, 50, 56, 2, 99, 102, 48, 0, 0,
1, 76, 46, -11, -69, 82, 4, 77, 48, -46, -65, -5, 11, -89, -64, -118, -77, -79, -117, -102,
-63, 36, -102, -64, -15, 16, -57, 41, -74, -106, 31, 110, 33, -3, -71, -5, -93, -28, -33,
0, 5, -5, 28, 98, 70, 1, 5, 94, 81, 49, 28, -90, 79, 115, 96, -36, 82, 0, 0]
ValueBytes=[0, 0, 0, 21, 0, 0, 0, 50, 0, 6, 50, 48, 54, 50, 50, 56, 2, 99, 102, 48, 0, 0,
1, 76, 46, -11, -69, 82, 4, 77, 48, -46, -65, -5, 11, -89, -64, -118, -77, -79, -117, -102,
-63, 36, -102, -64, -15, 16, -57, 41, -74, -106, 31, 110, 33, -3, -71, -5, -93, -28, -33,
0, 5, -5, 28, 98, 70, 1, 5, 94, 81, 49, 28, -90, 79, 115, 96, -36, 82]

KeyLength=21, TagsLength=0, RowLength=6, FamilyLength=2, QualiferLength=1, heapSize=152
KeyLength=21, TagsLength=0, RowLength=6, FamilyLength=2, QualiferLength=1, heapSize=144
{noformat}

As reported, the {{KeyValue}} on the server has an extra two bytes which get truncated before
the client sees them. Not sure where they're coming from -- that's going to be the next thing
I try to figure out (unless someone has a smart idea before I get there :D)

> ResultScanner doesn't return all rows in Scan
> ---------------------------------------------
>
>                 Key: HBASE-13262
>                 URL: https://issues.apache.org/jira/browse/HBASE-13262
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 2.0.0, 1.1.0
>         Environment: Single node, pseduo-distributed 1.1.0-SNAPSHOT
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>            Priority: Blocker
>             Fix For: 2.0.0, 1.1.0, 0.98.13
>
>         Attachments: regionserver-logging.diff, testrun_0.98.txt, testrun_branch1.0.txt
>
>
> Tried to write a simple Java client again 1.1.0-SNAPSHOT.
> * Write 1M rows, each row with 1 family, and 10 qualifiers (values [0-9]), for a total
of 10M cells written
> * Read back the data from the table, ensure I saw 10M cells
> Running it against {{04ac1891}} (and earlier) yesterday, I would get ~20% of the actual
rows. Running against 1.0.0, returns all 10M records as expected.
> [Code I was running|https://github.com/joshelser/hbase-hwhat/blob/master/src/main/java/hbase/HBaseTest.java]
for the curious.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message