Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DD58E1771A for ; Fri, 20 Mar 2015 04:53:39 +0000 (UTC) Received: (qmail 151 invoked by uid 500); 20 Mar 2015 04:53:39 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 103 invoked by uid 500); 20 Mar 2015 04:53:39 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 99986 invoked by uid 99); 20 Mar 2015 04:53:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Mar 2015 04:53:39 +0000 Date: Fri, 20 Mar 2015 04:53:39 +0000 (UTC) From: "ramkrishna.s.vasudevan (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-13262) ResultScanner doesn't return all rows in Scan MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-13262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370722#comment-14370722 ] ramkrishna.s.vasudevan commented on HBASE-13262: ------------------------------------------------ First of all the change that you see in ScannerV3 is purely on the reader side. With HfileV3 on, we ensure that while flushing we always add the tag length even when we don't have a tag. But while compaction we will remove that tag length. So a KV coming out of a just flushed file and a KV coming out of a compacted file will have the difference in the Cell size. Where as in the client side - we will never return tags. This means that in the KeyValueCodec we will always strip the tags. But the same is not applicable when we do the codec with the WALCodecs. Because there we need the Tags. For the above test - are you sure all the store files are compacted? > ResultScanner doesn't return all rows in Scan > --------------------------------------------- > > Key: HBASE-13262 > URL: https://issues.apache.org/jira/browse/HBASE-13262 > Project: HBase > Issue Type: Bug > Components: Client > Affects Versions: 2.0.0, 1.1.0 > Environment: Single node, pseduo-distributed 1.1.0-SNAPSHOT > Reporter: Josh Elser > Assignee: Josh Elser > Priority: Blocker > Fix For: 2.0.0, 1.1.0, 0.98.13 > > Attachments: 13262-0.98-testpatch.txt, 13262-tag-length-for-withTags-parameter.txt, regionserver-logging.diff, testrun_0.98.txt, testrun_branch1.0.txt > > > Tried to write a simple Java client again 1.1.0-SNAPSHOT. > * Write 1M rows, each row with 1 family, and 10 qualifiers (values [0-9]), for a total of 10M cells written > * Read back the data from the table, ensure I saw 10M cells > Running it against {{04ac1891}} (and earlier) yesterday, I would get ~20% of the actual rows. Running against 1.0.0, returns all 10M records as expected. > [Code I was running|https://github.com/joshelser/hbase-hwhat/blob/master/src/main/java/hbase/HBaseTest.java] for the curious. -- This message was sent by Atlassian JIRA (v6.3.4#6332)