hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-13262) ResultScanner doesn't return all rows in Scan
Date Thu, 19 Mar 2015 18:21:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369846#comment-14369846
] 

stack commented on HBASE-13262:
-------------------------------

What exactly is 'size' above [~elserj]? (and why are we capitalized in one log and not in
the other? Is it just how you inserted your logging strings?). If it is heapSize, I cannot
explain the diff. Same JVM on client and server?  Or is it estimated size? Can we see your
hacked in debug?

That client and server have to agree on size is broke, yeah, but before protobufs, it was
the only hacky means of introducing size-based scanning. See explanation here on HBASE-1996
by searching "Erik Rozendaal added a comment - 31/Dec/09 02:14". Now we are up on pb and are
passing flags in the result envelope, as per yours and [~jonathan.lawlor]'s suggestion above,
could add flags to do this properly going forward (caveat the [~lhofhansl] note that it has
to work for 0.98.. .ugh).

Thanks for the work on this. Nice digging.

> ResultScanner doesn't return all rows in Scan
> ---------------------------------------------
>
>                 Key: HBASE-13262
>                 URL: https://issues.apache.org/jira/browse/HBASE-13262
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 2.0.0, 1.1.0
>         Environment: Single node, pseduo-distributed 1.1.0-SNAPSHOT
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>            Priority: Blocker
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: testrun_0.98.txt, testrun_branch1.0.txt
>
>
> Tried to write a simple Java client again 1.1.0-SNAPSHOT.
> * Write 1M rows, each row with 1 family, and 10 qualifiers (values [0-9]), for a total
of 10M cells written
> * Read back the data from the table, ensure I saw 10M cells
> Running it against {{04ac1891}} (and earlier) yesterday, I would get ~20% of the actual
rows. Running against 1.0.0, returns all 10M records as expected.
> [Code I was running|https://github.com/joshelser/hbase-hwhat/blob/master/src/main/java/hbase/HBaseTest.java]
for the curious.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message