hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anoop John <anoop.hb...@gmail.com>
Subject Re: Access cell tags from HBase shell
Date Tue, 03 May 2016 17:35:07 GMT
You have to config the Codec KeyValueCodecWithTags at client side.
Server also will use same Codec to talk with this client.  Ya just
check with a java client 1st and then experiment with shell.

-Anoop-

On Tue, May 3, 2016 at 9:43 PM, ramkrishna vasudevan
<ramkrishna.s.vasudevan@gmail.com> wrote:
> Hi Benedict
>
> As super user you should be able to get back the tags as ordinals and make
> sure you set the codec KeyValueCodecWithTags.
> But I am not sure if it is possible to do it from the hBase shell. Can you
> try from a java client ?
>
> I did not do the hands on of late on this but I can do it if you face any
> difficulties and revert back if needed.
>
> Regards
> Ram
>
> On Tue, May 3, 2016 at 8:19 PM, <benedict.whittamsmith@thomsonreuters.com>
> wrote:
>
>> Hi Anoop,
>>
>> Can I still get the labels back (as ordinals, as a super user, and using
>> the KeyValueCodecWithTags codec) using the HBase shell?
>>
>> If so, what are the steps I need to take (i.e. doesn't seem to be working
>> for me, but then I've likely made a mistake setting the codec).
>>
>> Thanks,
>>
>> Ben
>>
>> > -----Original Message-----
>> > From: Anoop John [mailto:anoop.hbase@gmail.com]
>> > Sent: 15 September 2015 14:28
>> > To: user@hbase.apache.org
>> > Subject: Re: Access cell tags from HBase shell
>> >
>> > We are not returning back the cell labels back to client.  So what I
>> > will
>> > recommend you to test is by having a predicate in scan and test you see
>> > only the relevant data back.
>> > But there is way to return cells (all*) with out any vis check and
>> > cells in
>> > client will have the vis label tag also in it. This is by issuing the
>> > scan
>> > as a super user.  And also set the codec as KeyValueCodecWithTags.
>> > But one thing we wont be storing the vis label with Cells as string..
>> > We
>> > will optimize..  We will store them as ordinals and & and | condition
>> > also
>> > we will optimize. So even if you read back the vis label tags back in
>> > client it will be hard to parse it and understand..  Any thing more you
>> > would like to know, pls let me know..  Will be happy to help.
>> >
>> > BTW  once you test and if start to use the feature pls let me know..
>> > Will
>> > be great to hear the usage cases and feedback.
>> >
>> > -Anoop-
>> >
>> >
>> > On Fri, Sep 11, 2015 at 5:35 AM, Suresh Subbiah
>> > <suresh.subbiah60@gmail.com>
>> > wrote:
>> >
>> > > Hi Anoop,
>> > >
>> > > Thank you very much for the offer to help.
>> > >
>> > > I have been thinking some more about what it is that we need to do
>> > and have
>> > > realized that we don't need custom cell tags.
>> > > We we will only be using visibility labels. This is basically for
>> > testing
>> > > purpose and to understand exactly how data looks.
>> > >
>> > > How do we see visibility labels that are applied to a particular
>> > cell? For
>> > > ex, if we want to know all the labels that have been applied to
>> > > all cells, how do we do that? Or can that only be done by applying a
>> > > predicate and then check to see if the pred passes?
>> > >
>> > > Is there a way to pass visibility labels to client is a test mode ?
>> > >
>> > > Thanks
>> > > Suresh
>> > >
>> > >
>> > > On Thu, Sep 3, 2015 at 11:07 PM, Anoop John <anoop.hbase@gmail.com>
>> > wrote:
>> > >
>> > > > Hi Suresh
>> > > >                 You wan to use ur own custom tags with cells?  The
>> > > features
>> > > > like cell level vis labels etc are also implemented by storing them
>> > as
>> > > cell
>> > > > tags.  Yes as others said, the tags is by default a server only
>> > thing.
>> > > > Means you can not pass tags from/to client along with cells.  There
>> > is
>> > > some
>> > > > security reasons why we had opted this path.  And there were no
>> > custom
>> > > tag
>> > > > needs by then. Pls let us know what you want to achieve.   There is
>> > ways
>> > > to
>> > > > pass tags to/from client. I can help you.
>> > > >
>> > > > -Anoop-
>> > > >
>> > > >
>> > > > On Tue, Sep 1, 2015 at 4:29 AM, Jerry He <jerryjch@gmail.com>
>> > wrote:
>> > > >
>> > > > > Hi, Suresh
>> > > > >
>> > > > > In you Java client program, you can 'label' the cells in your
>> > PUT.  You
>> > > > can
>> > > > > ask which labeled cells to be returned in your Get and Scan,
but
>> > the
>> > > > labels
>> > > > > are not returned with the cells.
>> > > > > Yes, "labels on cells are only interpreted server side"
>> > > > >
>> > > > >
>> > > > > Jerry
>> > > > >
>> > > > > On Mon, Aug 31, 2015 at 1:27 PM, Suresh Subbiah <
>> > > > > suresh.subbiah60@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Thank you very much Ted, Jean-Marc.
>> > > > > >
>> > > > > > I see that slide 4 in
>> > > > > > https://urldefense.proofpoint.com/v2/url?u=http-
>> > 3A__www.slideshare.net_HBaseCon_features-2Dsession-
>> > 2D2&d=CwIBaQ&c=4ZIZThykDLcoWk-
>> > GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
>> > nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
>> > re6sXaYY0fb9BreY2o&s=BhpulFRnZ_JNgAOPjb_MFtv0rnH9yaNXtQZE_g7y-28&e=
>> > states
>> > > > > > that "cells are only interpreted server side"
>> > > > > > However https://urldefense.proofpoint.com/v2/url?u=https-
>> > 3A__issues.apache.org_jira_browse_HBASE-
>> > 2D9056&d=CwIBaQ&c=4ZIZThykDLcoWk-
>> > GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
>> > nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
>> > re6sXaYY0fb9BreY2o&s=u_ISxz2OpkFA6Y5cYXGcQqpG24S54zDi1WhuHfbq18A&e=
 &
>> > > > > > https://urldefense.proofpoint.com/v2/url?u=https-
>> > 3A__issues.apache.org_jira_browse_HBASE-
>> > 2D9884&d=CwIBaQ&c=4ZIZThykDLcoWk-
>> > GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
>> > nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
>> > re6sXaYY0fb9BreY2o&s=eiGA0TFAu3Or3cbLjX0wQJjwUGxldTOwU00qfZOgO8s&e=
>> > (likely others)
>> > > seem
>> > > > to
>> > > > > > indicate that tag values can be accessed/mutated from HBase
>> > client
>> > > > > > programs.
>> > > > > > I assumed that this mean that code has evolved since the
slides
>> > were
>> > > > > > created. Or I could just be misunderstanding what the slide
>> > meant.
>> > > > > >
>> > > > > > I am hoping to write some kind of small java program to
do this
>> > now
>> > > > > (since
>> > > > > > I am not familiar with REST or Thrift). Do you think that
is a
>> > > > reasonable
>> > > > > > approach?
>> > > > > >
>> > > > > > Thanks
>> > > > > > Suresh
>> > > > > >
>> > > > > >
>> > > > > > On Mon, Aug 31, 2015 at 2:59 PM, Ted Yu <yuzhihong@gmail.com>
>> > wrote:
>> > > > > >
>> > > > > > > bq. retrieve the list of labels for a given cell
>> > > > > > >
>> > > > > > > You're right, J-M.
>> > > > > > > There is no facility for the above in hbase shell.
>> > > > > > >
>> > > > > > > On Mon, Aug 31, 2015 at 12:55 PM, Jean-Marc Spaggiari
<
>> > > > > > > jean-marc@spaggiari.org> wrote:
>> > > > > > >
>> > > > > > > > But I don't think you can retrieve the list of
labels for a
>> > given
>> > > > > cell,
>> > > > > > > > right? Cells are only interpreted server side
and are not
>> > > returned
>> > > > on
>> > > > > > the
>> > > > > > > > client side...
>> > > > > > > >
>> > > > > > > > 2015-08-31 15:52 GMT-04:00 Ted Yu <yuzhihong@gmail.com>:
>> > > > > > > >
>> > > > > > > > > From the help message of put command, you
can see the
>> > > following:
>> > > > > > > > >
>> > > > > > > > >   hbase> put 't1', 'r1', 'c1', 'value',
ts1,
>> > > > > > > > {VISIBILITY=>'PRIVATE|SECRET'}
>> > > > > > > > >
>> > > > > > > > > Here is the group of related commands:
>> > > > > > > > >
>> > > > > > > > >   'visibility labels',
>> > > > > > > > >   :full_name => 'VISIBILITY LABEL TOOLS',
>> > > > > > > > >   :comment => "NOTE: Above commands are
only applicable
>> > if
>> > > > running
>> > > > > > with
>> > > > > > > > the
>> > > > > > > > > VisibilityController coprocessor",
>> > > > > > > > >   :commands => %w[
>> > > > > > > > >     add_labels
>> > > > > > > > >     list_labels
>> > > > > > > > >     set_auths
>> > > > > > > > >     get_auths
>> > > > > > > > >     clear_auths
>> > > > > > > > >     set_visibility
>> > > > > > > > >
>> > > > > > > > > FYI
>> > > > > > > > >
>> > > > > > > > > On Mon, Aug 31, 2015 at 12:25 PM, Suresh
Subbiah <
>> > > > > > > > > suresh.subbiah60@gmail.com
>> > > > > > > > > > wrote:
>> > > > > > > > >
>> > > > > > > > > > Hi,
>> > > > > > > > > >
>> > > > > > > > > > I am using HBase 0.98 with HFiles of
majorVersion 3.
>> > > > > > > > > > Is it possible to get and set cell tags
from the HBase
>> > shell
>> > > > > > utility?
>> > > > > > > > > > I have been looking at various JIRAs
and see some
>> > example
>> > > > client
>> > > > > > > > testing
>> > > > > > > > > > programs that seem to do this. However
it will be
>> > simpler if
>> > > I
>> > > > > > could
>> > > > > > > > > > get/set cell tags from HBase shell.
>> > > > > > > > > >
>> > > > > > > > > > Thank you for your help.
>> > > > > > > > > >
>> > > > > > > > > > Best regards,
>> > > > > > > > > > Suresh
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>

Mime
View raw message