hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-13262) ResultScanner doesn't return all rows in Scan
Date Thu, 19 Mar 2015 20:43:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370075#comment-14370075
] 

Lars Hofhansl edited comment on HBASE-13262 at 3/19/15 8:43 PM:
----------------------------------------------------------------

As a radical approach, we can fall through out of the while loop in ClientScanner as long
as we get _anything_ from the server.
So if we get at least one KV back we can fall through and not go to the nextscanner(...).
The implication is that we'd do an extra RPC per region.

Client and server agreeing with absolute certainty to the expected size clearly does not work.



was (Author: lhofhansl):
As a radical approach, we can fall through out of the while loop in ClientScanner as long
as we get _anything_ from the server.
So if we get at least one KV back we can fall through and not go to the nextscanner(...).
The implication is that per region scanned we'd an extra RPC per region.

Client and server agreeing with absolute certainty to the expected size clearly does not work.


> ResultScanner doesn't return all rows in Scan
> ---------------------------------------------
>
>                 Key: HBASE-13262
>                 URL: https://issues.apache.org/jira/browse/HBASE-13262
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 2.0.0, 1.1.0
>         Environment: Single node, pseduo-distributed 1.1.0-SNAPSHOT
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>            Priority: Blocker
>             Fix For: 2.0.0, 1.1.0, 0.98.13
>
>         Attachments: regionserver-logging.diff, testrun_0.98.txt, testrun_branch1.0.txt
>
>
> Tried to write a simple Java client again 1.1.0-SNAPSHOT.
> * Write 1M rows, each row with 1 family, and 10 qualifiers (values [0-9]), for a total
of 10M cells written
> * Read back the data from the table, ensure I saw 10M cells
> Running it against {{04ac1891}} (and earlier) yesterday, I would get ~20% of the actual
rows. Running against 1.0.0, returns all 10M records as expected.
> [Code I was running|https://github.com/joshelser/hbase-hwhat/blob/master/src/main/java/hbase/HBaseTest.java]
for the curious.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message