Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EFB8A180FA for ; Wed, 4 Nov 2015 15:56:11 +0000 (UTC) Received: (qmail 38170 invoked by uid 500); 4 Nov 2015 15:56:10 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 38108 invoked by uid 500); 4 Nov 2015 15:56:09 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 38094 invoked by uid 99); 4 Nov 2015 15:56:09 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Nov 2015 15:56:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 251451A2118 for ; Wed, 4 Nov 2015 15:56:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.119 X-Spam-Level: X-Spam-Status: No, score=-0.119 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=esgyn.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id fzCyOC-3g06I for ; Wed, 4 Nov 2015 15:56:00 +0000 (UTC) Received: from mail-pa0-f49.google.com (mail-pa0-f49.google.com [209.85.220.49]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 957C442B79 for ; Wed, 4 Nov 2015 15:56:00 +0000 (UTC) Received: by pabfh17 with SMTP id fh17so56553225pab.0 for ; Wed, 04 Nov 2015 07:55:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=esgyn.com; s=google; h=from:to:references:in-reply-to:subject:date:message-id:mime-version :content-type:content-transfer-encoding:thread-index :content-language; bh=f/+3SCirZH6xG96h3T7/fbj/Mp3ijkjjgo7c0WYj0m4=; b=P/Iee/KWUoR1r5curxkKEoVhWNeDjrBdhYyLEekMnyR46+G4fDgwBc4pOqR86ddSg0 tr63cteHgjKU3/gon/T5ulomHq/ipAPnFkeH+O60e3/Q95gPRGtOmMgqTfG4Hm+xB4NY fGBLqL+er1PB7Ii6anfPkuA5e4U/B3AfDsv0A= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:references:in-reply-to:subject:date :message-id:mime-version:content-type:content-transfer-encoding :thread-index:content-language; bh=f/+3SCirZH6xG96h3T7/fbj/Mp3ijkjjgo7c0WYj0m4=; b=ME0CdKx3Bta9Cdn+L30iX+NusS/OsdHlwjQCK5Lf/JISFHkA7bt92qjGeJYTZqesRr 6nlXkOLPY+X1SzuZrrFj/oNo8HyXmrR80wcEVdZ07M9Usp5al+jfT7Q7dRis6H23Uo53 42F0n/6E0fzaXnUV05uOjyCCJZbANjtFfzIx8QqROqNDpGv5NxTVfBrbXgO3et+4p1is HqniRmyr5sp7at4Egr/iCwKC0ifThrwhIwrsHItOJ/Ts3Ig9rVrAHsH7sw42H/+54eYF hx/dealsulujyLtW8kKMCxArk3fkH+DxyeE9JUTijJDSdelSC6BsO0ZzTo/1PpyLSOsL gSlg== X-Gm-Message-State: ALoCoQnhndp4RAGdQRrIBS46+0uwgEPQBzKGzTPG4DI1Wyl8wL2gEjHyKYFl6UwU5qfRa4X8+x/g X-Received: by 10.66.249.74 with SMTP id ys10mr2772192pac.50.1446652554627; Wed, 04 Nov 2015 07:55:54 -0800 (PST) Received: from DESKTOPLV5D144 (c-73-202-58-71.hsd1.ca.comcast.net. [73.202.58.71]) by smtp.googlemail.com with ESMTPSA id tp6sm2761661pbc.81.2015.11.04.07.55.52 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Nov 2015 07:55:53 -0800 (PST) From: "Anoop Sharma" To: References: <72dd2c48875386a8341ca999d1363202@mail.gmail.com> In-Reply-To: Subject: RE: delete of cells with visibility expressions Date: Wed, 4 Nov 2015 07:55:49 -0800 Message-ID: <004d01d11719$472f52c0$d58df840$@esgyn.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 16.0 Thread-Index: AQL1fg4F5FPBxddsvX2TzRGZQaeaugINs6/FAs8MWzsBrdu3iAIAHeRFAmAmMEUCzCypjAFO12Snm8sGo2A= Content-Language: en-us Thanks for finding the issue, appreciate your help. Yes, please go ahead and file a JIRA or let me know if you would like me = to file it. Which release would the fix be in? Could it be backported on an earlier = release? anoop -----Original Message----- From: ramkrishna vasudevan [mailto:ramkrishna.s.vasudevan@gmail.com]=20 Sent: Tuesday, November 3, 2015 9:51 PM To: user@hbase.apache.org Subject: Re: delete of cells with visibility expressions Seeing the code I think we have identified the issue as Anoop John said. = We could fix this probably in the next release. Let us know if you want = us to file a JIRA for this. Regards Ram On Wed, Nov 4, 2015 at 11:09 AM, ramkrishna vasudevan < = ramkrishna.s.vasudevan@gmail.com> wrote: > Sorry for the confusion. Yes the bug exists. When I tried in the=20 > cluster the Visibilty CP was not on. So it is better we can raise a=20 > JIRA and fix this over there. Thanks Anoop Sharma and sorry for the=20 > delay from my side due to wrong info. > > Regards > Ram > > On Wed, Nov 4, 2015 at 4:15 AM, Anoop Sharma > wrote: > >> hi >> >> which hbase version did you try this on? >> We tried on the following 2 hbase versions and see the delete = problem. >> >> Version 1.0.2, r76745a2cbffe08b812be16e0e19e637a23a923c5, Tue Aug=20 >> 25 >> 15:59:49 PDT 2015 >> Version 1.1.2, rcc2b70cf03e3378800661ec5cab11eb43fafe0fc, Wed Aug=20 >> 26 >> 20:11:27 PDT 2015 >> >> Is there a later version that has the fix? >> >> thanks >> >> -----Original Message----- >> From: ramkrishna vasudevan [mailto:ramkrishna.s.vasudevan@gmail.com] >> Sent: Sunday, November 1, 2015 11:11 PM >> To: user@hbase.apache.org >> Subject: Re: delete of cells with visibility expressions >> >> Is it still a bug? I reproduced the above steps in latest trunk and I = >> thought the behaviour was corrected due to a recent bug fix? Is it=20 >> not that case ? >> >> Regards >> Ram >> >> On Mon, Nov 2, 2015 at 12:20 PM, Anoop John >> wrote: >> >> > I believe it is a bug.. I think I know the reason also.. Can you=20 >> > file a jira? We can discuss under that. Thanks for the test. >> > >> > -Anoop- >> > >> > On Sat, Oct 31, 2015 at 12:45 AM, Anoop Sharma=20 >> > >> > wrote: >> > >> > > Thanks Ram. >> > > >> > > we are using hbase 1.0.2. >> > > >> > > anoop >> > > >> > > -----Original Message----- >> > > From: ramkrishna vasudevan=20 >> > > [mailto:ramkrishna.s.vasudevan@gmail.com] >> > > Sent: Thursday, October 29, 2015 10:22 PM >> > > To: user@hbase.apache.org >> > > Subject: Re: delete of cells with visibility expressions >> > > >> > > Hi Anoop >> > > >> > > Which version of the HBase are you using? This got solved in the = >> > > latest version of 0.98 and above. Could you try that? I just=20 >> > > reproduced this >> > and >> > > this problem no longer occurs. >> > > >> > > Regards >> > > Ram >> > > >> > > On Fri, Oct 30, 2015 at 3:26 AM, Anoop Sharma=20 >> > > >> > > wrote: >> > > >> > > > hi >> > > > >> > > > running into an issue related to visibility expressions and >> delete. >> > > > >> > > > Example run from hbase shell is listed below. >> > > > >> > > > Will appreciate any help on this issue. >> > > > >> > > > thanks. >> > > > >> > > > >> > > > >> > > > In the example below, user running queries has = =E2=80=98MANAGER=E2=80=99 >> > > > authorization. >> > > > >> > > > >> > > > >> > > > *First example:* >> > > > >> > > > add a column with visib expr =E2=80=98MANAGER=E2=80=99 >> > > > >> > > > delete it by passing in visibility of = =E2=80=98MANAGER=E2=80=99 >> > > > >> > > > This works and scan doesn=E2=80=99t return anything. >> > > > >> > > > >> > > > >> > > > *Second example:* >> > > > >> > > > add a column with visib expr =E2=80=98MANAGER=E2=80=99 >> > > > >> > > > delete it by not passing in any visibility. >> > > > >> > > > This doesn=E2=80=99t delete the column. >> > > > >> > > > Scan doesn=E2=80=99t return the row but RAW scan shows the = column >> > > > >> > > > marked as deleteColumn. >> > > > >> > > > >> > > > >> > > > Now if delete is done again with visibility of = =E2=80=98MANAGER=E2=80=99, >> > > > >> > > > it still doesn=E2=80=99t delete it and scan returns the = original column. >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > *Example 1:* >> > > > >> > > > hbase(main):096:0> create 'HBT1', 'cf' >> > > > >> > > > >> > > > >> > > > hbase(main):098:0* *put 'HBT1', 'John', 'cf:a', 'CA', >> > > > {VISIBILITY=3D>'MANAGER'}* >> > > > >> > > > >> > > > >> > > > hbase(main):099:0> *scan 'HBT1'* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446154722055, >> > > > value=3DCA >> > > > >> > > > 1 row(s) in 0.0030 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):100:0> *delete 'HBT1', 'John', 'cf:a', >> > > > {VISIBILITY=3D>'MANAGER'}* >> > > > >> > > > 0 row(s) in 0.0030 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):101:0> *scan 'HBT1'* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > 0 row(s) in 0.0030 seconds >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > *Example 2:* >> > > > >> > > > hbase(main):010:0* *put 'HBT1', 'John', 'cf:a', 'CA', >> > > > {VISIBILITY=3D>'MANAGER'}* >> > > > >> > > > 0 row(s) in 0.0040 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):011:0> *scan 'HBT1'* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446155346473, >> > > > value=3DCA >> > > > >> > > > 1 row(s) in 0.0060 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):012:0> *delete 'HBT1', 'John', 'cf:a'* >> > > > >> > > > 0 row(s) in 0.0090 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):013:0> *scan 'HBT1'* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446155346473, >> > > > value=3DCA >> > > > >> > > > 1 row(s) in 0.0050 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):014:0> *scan 'HBT1', {RAW =3D> true}* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446155346519, >> > > > type=3DDeleteColumn >> > > > >> > > > 1 row(s) in 0.0060 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):015:0> *delete 'HBT1', 'John', 'cf:a', >> > > > {VISIBILITY=3D>'MANAGER'}* >> > > > >> > > > 0 row(s) in 0.0030 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):016:0> *scan 'HBT1'* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446155346473, >> > > > value=3DCA >> > > > >> > > > 1 row(s) in 0.0040 seconds >> > > > >> > > > >> > > > >> > > > hbase(main):017:0> *scan 'HBT1', {RAW =3D> true}* >> > > > >> > > > ROW >> > > > COLUMN+CELL >> > > > >> > > > John column=3Dcf:a, timestamp=3D1446155346601, >> > > > type=3DDeleteColumn >> > > > >> > > > 1 row(s) in 0.0060 seconds >> > > > >> > > >> > >> > >