hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <benedict.whittamsm...@thomsonreuters.com>
Subject RE: Access cell tags from HBase shell
Date Tue, 03 May 2016 14:49:34 GMT
Hi Anoop,

Can I still get the labels back (as ordinals, as a super user, and using the KeyValueCodecWithTags
codec) using the HBase shell?

If so, what are the steps I need to take (i.e. doesn't seem to be working for me, but then
I've likely made a mistake setting the codec).

Thanks,

Ben

> -----Original Message-----
> From: Anoop John [mailto:anoop.hbase@gmail.com]
> Sent: 15 September 2015 14:28
> To: user@hbase.apache.org
> Subject: Re: Access cell tags from HBase shell
> 
> We are not returning back the cell labels back to client.  So what I
> will
> recommend you to test is by having a predicate in scan and test you see
> only the relevant data back.
> But there is way to return cells (all*) with out any vis check and
> cells in
> client will have the vis label tag also in it. This is by issuing the
> scan
> as a super user.  And also set the codec as KeyValueCodecWithTags.
> But one thing we wont be storing the vis label with Cells as string..
> We
> will optimize..  We will store them as ordinals and & and | condition
> also
> we will optimize. So even if you read back the vis label tags back in
> client it will be hard to parse it and understand..  Any thing more you
> would like to know, pls let me know..  Will be happy to help.
> 
> BTW  once you test and if start to use the feature pls let me know..
> Will
> be great to hear the usage cases and feedback.
> 
> -Anoop-
> 
> 
> On Fri, Sep 11, 2015 at 5:35 AM, Suresh Subbiah
> <suresh.subbiah60@gmail.com>
> wrote:
> 
> > Hi Anoop,
> >
> > Thank you very much for the offer to help.
> >
> > I have been thinking some more about what it is that we need to do
> and have
> > realized that we don't need custom cell tags.
> > We we will only be using visibility labels. This is basically for
> testing
> > purpose and to understand exactly how data looks.
> >
> > How do we see visibility labels that are applied to a particular
> cell? For
> > ex, if we want to know all the labels that have been applied to
> > all cells, how do we do that? Or can that only be done by applying a
> > predicate and then check to see if the pred passes?
> >
> > Is there a way to pass visibility labels to client is a test mode ?
> >
> > Thanks
> > Suresh
> >
> >
> > On Thu, Sep 3, 2015 at 11:07 PM, Anoop John <anoop.hbase@gmail.com>
> wrote:
> >
> > > Hi Suresh
> > >                 You wan to use ur own custom tags with cells?  The
> > features
> > > like cell level vis labels etc are also implemented by storing them
> as
> > cell
> > > tags.  Yes as others said, the tags is by default a server only
> thing.
> > > Means you can not pass tags from/to client along with cells.  There
> is
> > some
> > > security reasons why we had opted this path.  And there were no
> custom
> > tag
> > > needs by then. Pls let us know what you want to achieve.   There is
> ways
> > to
> > > pass tags to/from client. I can help you.
> > >
> > > -Anoop-
> > >
> > >
> > > On Tue, Sep 1, 2015 at 4:29 AM, Jerry He <jerryjch@gmail.com>
> wrote:
> > >
> > > > Hi, Suresh
> > > >
> > > > In you Java client program, you can 'label' the cells in your
> PUT.  You
> > > can
> > > > ask which labeled cells to be returned in your Get and Scan, but
> the
> > > labels
> > > > are not returned with the cells.
> > > > Yes, "labels on cells are only interpreted server side"
> > > >
> > > >
> > > > Jerry
> > > >
> > > > On Mon, Aug 31, 2015 at 1:27 PM, Suresh Subbiah <
> > > > suresh.subbiah60@gmail.com>
> > > > wrote:
> > > >
> > > > > Thank you very much Ted, Jean-Marc.
> > > > >
> > > > > I see that slide 4 in
> > > > > https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__www.slideshare.net_HBaseCon_features-2Dsession-
> 2D2&d=CwIBaQ&c=4ZIZThykDLcoWk-
> GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
> nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
> re6sXaYY0fb9BreY2o&s=BhpulFRnZ_JNgAOPjb_MFtv0rnH9yaNXtQZE_g7y-28&e=
> states
> > > > > that "cells are only interpreted server side"
> > > > > However https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__issues.apache.org_jira_browse_HBASE-
> 2D9056&d=CwIBaQ&c=4ZIZThykDLcoWk-
> GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
> nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
> re6sXaYY0fb9BreY2o&s=u_ISxz2OpkFA6Y5cYXGcQqpG24S54zDi1WhuHfbq18A&e=  &
> > > > > https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__issues.apache.org_jira_browse_HBASE-
> 2D9884&d=CwIBaQ&c=4ZIZThykDLcoWk-
> GVjSLm9hvvvzvGv0FLoWSRuCSs5Q&r=GQ6xvz2BG1vCgiGGeLHdL1qJLbLUqYG6W19eFBlz
> nzDGH3wjzyriGVJemENTKsgx&m=sLIg484DFLi0oSu5ylkGuIuB-
> re6sXaYY0fb9BreY2o&s=eiGA0TFAu3Or3cbLjX0wQJjwUGxldTOwU00qfZOgO8s&e=
> (likely others)
> > seem
> > > to
> > > > > indicate that tag values can be accessed/mutated from HBase
> client
> > > > > programs.
> > > > > I assumed that this mean that code has evolved since the slides
> were
> > > > > created. Or I could just be misunderstanding what the slide
> meant.
> > > > >
> > > > > I am hoping to write some kind of small java program to do this
> now
> > > > (since
> > > > > I am not familiar with REST or Thrift). Do you think that is a
> > > reasonable
> > > > > approach?
> > > > >
> > > > > Thanks
> > > > > Suresh
> > > > >
> > > > >
> > > > > On Mon, Aug 31, 2015 at 2:59 PM, Ted Yu <yuzhihong@gmail.com>
> wrote:
> > > > >
> > > > > > bq. retrieve the list of labels for a given cell
> > > > > >
> > > > > > You're right, J-M.
> > > > > > There is no facility for the above in hbase shell.
> > > > > >
> > > > > > On Mon, Aug 31, 2015 at 12:55 PM, Jean-Marc Spaggiari <
> > > > > > jean-marc@spaggiari.org> wrote:
> > > > > >
> > > > > > > But I don't think you can retrieve the list of labels for
a
> given
> > > > cell,
> > > > > > > right? Cells are only interpreted server side and are not
> > returned
> > > on
> > > > > the
> > > > > > > client side...
> > > > > > >
> > > > > > > 2015-08-31 15:52 GMT-04:00 Ted Yu <yuzhihong@gmail.com>:
> > > > > > >
> > > > > > > > From the help message of put command, you can see
the
> > following:
> > > > > > > >
> > > > > > > >   hbase> put 't1', 'r1', 'c1', 'value', ts1,
> > > > > > > {VISIBILITY=>'PRIVATE|SECRET'}
> > > > > > > >
> > > > > > > > Here is the group of related commands:
> > > > > > > >
> > > > > > > >   'visibility labels',
> > > > > > > >   :full_name => 'VISIBILITY LABEL TOOLS',
> > > > > > > >   :comment => "NOTE: Above commands are only applicable
> if
> > > running
> > > > > with
> > > > > > > the
> > > > > > > > VisibilityController coprocessor",
> > > > > > > >   :commands => %w[
> > > > > > > >     add_labels
> > > > > > > >     list_labels
> > > > > > > >     set_auths
> > > > > > > >     get_auths
> > > > > > > >     clear_auths
> > > > > > > >     set_visibility
> > > > > > > >
> > > > > > > > FYI
> > > > > > > >
> > > > > > > > On Mon, Aug 31, 2015 at 12:25 PM, Suresh Subbiah <
> > > > > > > > suresh.subbiah60@gmail.com
> > > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I am using HBase 0.98 with HFiles of majorVersion
3.
> > > > > > > > > Is it possible to get and set cell tags from
the HBase
> shell
> > > > > utility?
> > > > > > > > > I have been looking at various JIRAs and see
some
> example
> > > client
> > > > > > > testing
> > > > > > > > > programs that seem to do this. However it will
be
> simpler if
> > I
> > > > > could
> > > > > > > > > get/set cell tags from HBase shell.
> > > > > > > > >
> > > > > > > > > Thank you for your help.
> > > > > > > > >
> > > > > > > > > Best regards,
> > > > > > > > > Suresh
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
Mime
View raw message