hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Custom Filter on hbase Column
Date Mon, 15 Sep 2014 16:57:49 GMT
Take a look at StoreScanner#next():

      ScanQueryMatcher.MatchCode qcode = matcher.match(kv);

      switch(qcode) {

        case INCLUDE:

        case INCLUDE_AND_SEEK_NEXT_ROW:

        case INCLUDE_AND_SEEK_NEXT_COL:


          Filter f = matcher.getFilter();

          if (f != null) {

            // TODO convert Scan Query Matcher to be Cell instead of KV
based ?

            kv = KeyValueUtil.ensureKeyValue(f.transformCell(kv));

          }

Cheers

On Mon, Sep 15, 2014 at 8:27 AM, Nishanth S <nishanth.2884@gmail.com> wrote:

> Thanks Anoop.I did that but the only method  that was getting called in my
> filter  was  public byte[] toByteArray() ,even though I over ride
> transformcell.
>
>
> Thanks,
> Nishanth
>
> On Thu, Sep 11, 2014 at 10:51 PM, Anoop John <anoop.hbase@gmail.com>
> wrote:
>
> > And u have to implement
> > transformCell(*final* Cell v)
> > in your custom Filter.
> >
> > JFYI
> >
> > -Anoop-
> >
> > On Fri, Sep 12, 2014 at 4:36 AM, Nishanth S <nishanth.2884@gmail.com>
> > wrote:
> >
> > > Sure  Sean.This is much needed.
> > >
> > > -Nishan
> > >
> > > On Thu, Sep 11, 2014 at 3:57 PM, Sean Busbey <busbey@cloudera.com>
> > wrote:
> > >
> > > > I filed HBASE-11950 to get some details added to the book on this
> > > topic[1].
> > > >
> > > > Nishanth, could you follow that ticket and give feedback on whatever
> > > update
> > > > ends up proposed?
> > > >
> > > > [1]: https://issues.apache.org/jira/browse/HBASE-11950
> > > >
> > > > On Thu, Sep 11, 2014 at 4:40 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> > > >
> > > > > See http://search-hadoop.com/m/DHED4xWh622
> > > > >
> > > > > On Thu, Sep 11, 2014 at 2:37 PM, Nishanth S <
> nishanth.2884@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > > Hey All,
> > > > > >
> > > > > > I am sorry if this is a naive question.Do we need to generate
a
> > proto
> > > > > file
> > > > > > using proto buffer compiler when implementing a filter.I did
not
> > see
> > > > that
> > > > > > any where in the documentation.Can some one  help please?
> > > > > >
> > > > > > On Thu, Sep 11, 2014 at 12:41 PM, Nishanth S <
> > > nishanth.2884@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Thanks Dima and Ted.Yes I need to  return the first the
1000
> > > > > > > characters.There is no matching involved.
> > > > > > >
> > > > > > > -Nishan
> > > > > > >
> > > > > > > On Thu, Sep 11, 2014 at 12:24 PM, Ted Yu <yuzhihong@gmail.com>
> > > > wrote:
> > > > > > >
> > > > > > >> In Nishanth's case, the 5K message is stored in one
KeyValue,
> > > right
> > > > ?
> > > > > > >>
> > > > > > >> If only the first 1000 Characters of this message are
to be
> > > > returned,
> > > > > > >> a new KeyValue
> > > > > > >> needs to be composed and returned.
> > > > > > >>
> > > > > > >> Cheers
> > > > > > >>
> > > > > > >> On Thu, Sep 11, 2014 at 11:09 AM, Dima Spivak <
> > > dspivak@cloudera.com
> > > > >
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > Hi Nishanth,
> > > > > > >> >
> > > > > > >> > Take a look at
> > http://hbase.apache.org/book/client.filter.html
> > > .
> > > > > If I
> > > > > > >> > understand your use case correctly, you might
want to look
> at
> > > > > > >> > RegexStringComparator to match the first 1000
characters of
> > your
> > > > > > column
> > > > > > >> > qualifier.
> > > > > > >> >
> > > > > > >> > -Dima
> > > > > > >> >
> > > > > > >> > On Thu, Sep 11, 2014 at 12:37 PM, Nishanth S <
> > > > > nishanth.2884@gmail.com
> > > > > > >
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Hi All,
> > > > > > >> > >
> > > > > > >> > > I have an hbase table with multiple cfs (say
> c1,c2,c3).Each
> > of
> > > > > this
> > > > > > >> > column
> > > > > > >> > > family has  a column 'message' which is about
5K.What I
> need
> > > to
> > > > do
> > > > > > is
> > > > > > >> to
> > > > > > >> > > grab only the first 1000 Characters of this
message when I
> > do
> > > a
> > > > > get
> > > > > > on
> > > > > > >> > the
> > > > > > >> > > table using row Key.I was thinking of using
 filters to do
> > > this
> > > > on
> > > > > > >> hbase
> > > > > > >> > > sever side.Can some one help me on how to
go about this.
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > > Thanks,
> > > > > > >> > > Nishan
> > > > > > >> > >
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sean
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message