hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Kim <benkimkim...@gmail.com>
Subject Re: Best practices for custom filter class distribution?
Date Mon, 30 Jul 2012 10:02:49 GMT
Yes testing custom filters in HBase are sort of pain.

On Thu, Jun 28, 2012 at 5:53 AM, Evan Pollan <evan.pollan@gmail.com> wrote:

> Thanks Amandeep -- I hadn't seen the FilterList.  That should be able to
> get me most of the way there by simply "indexing" and chaining together
> DependentColumnFilters.
>
> I think I'm going to try to avoid reconfiguring the cluster and restarting
> the region servers at all costs.
>
>
>
> On Wed, Jun 27, 2012 at 12:54 PM, Amandeep Khurana <amansk@gmail.com>
> wrote:
>
> > Currently, you have to compile a jar, put them on all servers and restart
> > the RS process. I don't believe there is an easier way to do it as of
> right
> > now. And I agree, it's not entirely desirable to have to restart the
> > cluster to install a custom filter.
> >
> > You can combine multiple filters into a FilterList and configure it in
> two
> > modes: Pass All, or Pass One. Did you try that?
> >
> > Example:
> > List<Filter> myList = new ArrayList();
> > myList.add(myTimestampFilter);
> > myList.add(myRowFilter);
> > FilterList myFilterList = new
> > FilterList(FilterList.Operator.MUST_PASS_ALL, myList);
> > myFilterList.addFilter(myQualiFilter);
> >
> >
> > On Wednesday, June 27, 2012 at 1:47 PM, Evan Pollan wrote:
> >
> > > What're the current best practices for making custom Filter
> > implementation
> > > classes available to the region servers? My cluster is running 0.90.4
> > from
> > > the CDH3U3 distribution, FWIW.
> > >
> > > I searched around and didn't find anything other than "add your filter
> to
> > > the region server's classpath." I'm hoping there's support for
> something
> > > that doesn't involve actually installing jar files on each region
> server,
> > > updating each region server's configuration, and doing a rolling
> restart
> > of
> > > the whole cluster...
> > >
> > > I did find this still-outstanding bug requesting parity between
> > HDFS-based
> > > co-processor class loading and filter class loading:
> > > https://issues.apache.org/jira/browse/HBASE-1936.
> > >
> > > How are folks handling this?
> > >
> > > The stock filters are fairly limited, especially without the ability
> (at
> > > least AFAIK) to combine the existing filters together via basic boolean
> > > algebra, so I can't do much without writing my own filter(s).
> > >
> > >
> > > thanks,
> > > Evan
> >
> >
> >
> >
>



-- 

*Benjamin Kim*
*benkimkimben at gmail*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message