Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5A1281839F for ; Tue, 17 Nov 2015 01:12:11 +0000 (UTC) Received: (qmail 57181 invoked by uid 500); 17 Nov 2015 01:12:11 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 57128 invoked by uid 500); 17 Nov 2015 01:12:11 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 57117 invoked by uid 99); 17 Nov 2015 01:12:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Nov 2015 01:12:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 008C32C1F63 for ; Tue, 17 Nov 2015 01:12:11 +0000 (UTC) Date: Tue, 17 Nov 2015 01:12:11 +0000 (UTC) From: "Vladimir Rodionov (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14782) FuzzyRowFilter skips valid rows MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14782?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D150= 07746#comment-15007746 ]=20 Vladimir Rodionov commented on HBASE-14782: ------------------------------------------- The issue is, we need to trim trailing zeroes in getNextForFuzzyRule for fo= rward scanners Example: hint =3D \x01\x01\x01\x00\x00 will skip valid row: \0x01\0x01\0x01 > FuzzyRowFilter skips valid rows > ------------------------------- > > Key: HBASE-14782 > URL: https://issues.apache.org/jira/browse/HBASE-14782 > Project: HBase > Issue Type: Bug > Affects Versions: 2.0.0 > Reporter: Vladimir Rodionov > Assignee: Vladimir Rodionov > Attachments: HBASE-14782-v3.patch, HBASE-14782.patch, HBASE-14782= .patch > > > The issue may affect not only master branch, but previous releases as wel= l. > This is from one of our customers: > {quote} > We are experiencing a problem with the FuzzyRowFilter for HBase scan. We = think that it is a bug.=20 > Fuzzy filter should pick a row if it matches filter criteria irrespective= of other rows present in table but filter is dropping a row depending on s= ome other row present in table.=20 > Details/Step to reproduce/Sample outputs below:=20 > Missing row key: \x9C\x00\x044\x00\x00\x00\x00=20 > Causing row key: \x9C\x00\x03\xE9e\xBB{X\x1Fwts\x1F\x15vRX=20 > Prerequisites=20 > 1. Create a test table. HBase shell command -- create 'fuzzytest','d'=20 > 2. Insert some test data. HBase shell commands:=20 > =E2=80=A2 put 'fuzzytest',"\x9C\x00\x044\x00\x00\x00\x00",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9C\x00\x044\x01\x00\x00\x00",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9C\x00\x044\x00\x01\x00\x00",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9C\x00\x044\x00\x00\x01\x00",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9C\x00\x044\x00\x01\x00\x01",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9B\x00\x044e\xBB\xB2\xBB",'d:a','junk'=20 > =E2=80=A2 put 'fuzzytest',"\x9D\x00\x044e\xBB\xB2\xBB",'d:a','junk'=20 > Now when you run the code, you will find \x9C\x00\x044\x00\x00\x00\x00 in= output because it matches filter criteria. (Refer how to run code below)= =20 > Insert the row key causing bug:=20 > HBase shell command: put 'fuzzytest',"\x9C\x00\x03\xE9e\xBB{X\x1Fwts\x1F\= x15vRX",'d:a','junk'=20 > Now when you run the code, you will not find \x9C\x00\x044\x00\x00\x00\x0= 0 in output even though it still matches filter criteria.=20 > {quote} > Verified the issue on master. -- This message was sent by Atlassian JIRA (v6.3.4#6332)