Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of marcosluis2186@gmail.com
 designates 209.85.219.52 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <E6C10A03A8055040A2CB6A25304482450153D0E7@EXTXMB22.nam.nsroot.net>
References: <E6C10A03A8055040A2CB6A25304482450153D03C@EXTXMB22.nam.nsroot.net>
 <CALte62xw4873xmEBBhtPJeav3nzV+VA0TFTHFH5xkzOaCr0h-g@mail.gmail.com>
 <CALte62yCr3SBdZpVeXXY+Vpe7iAYgZ2vEF99LugApGadQc4-cQ@mail.gmail.com>
 <E6C10A03A8055040A2CB6A25304482450153D0E7@EXTXMB22.nam.nsroot.net>
From: Marcos Luis Ortiz Valmaseda <marcosluis2186@gmail.com>
Date: Thu, 28 Mar 2013 22:06:17 -0430
Message-ID: 
 <CAJs-K1vx2X_vwGa3+hykhUt3FtntNvF1nNpc8K2S2b-mZytFjQ@mail.gmail.com>
Subject: Re: coprocessor is timing out in 0.94
To: user@hbase.apache.org, saurabh.agarwal@citi.com, yuzhihong@gmail.com
Content-Type: multipart/alternative; boundary=f46d04479f95ee545604d9072375

--f46d04479f95ee545604d9072375
Content-Type: text/plain; charset=ISO-8859-1

Regards, Saurabh.
I see that you are using SingleColumnValueFilter. Look for these links:
http://gbif.blogspot.com/2012/05/optimizing-hbase-mapreduce-scans-for.html
http://mapredit.blogspot.com/2012/05/using-filters-in-hbase-to-match-two.html

Take a look later to this link, about the working to improve scans:
https://issues.apache.org/jira/browse/HBASE-5416


2013/3/28 Agarwal, Saurabh <saurabh.agarwal@citi.com>

> Ted,
>
> Thanks for response.
>
> Here is the filter we are using -
> SingleColumnValueFilter(Bytes.toBytes(columnFamily),
> Bytes.toBytes(columnQualifier), CompareFilter.CompareOp.EQUAL, new
> RegexStringComparator("(?i)"+"keyword"));
>
> The thread dump at different points show that coprocessor is getting
> called. Also logs showed it keep processing. But the speed is much slower
> compare to 0.92.
>
> Regards,
> Saurabh.
>
> -----Original Message-----
> From: Ted Yu [mailto:yuzhihong@gmail.com]
> Sent: Thursday, March 28, 2013 6:57 PM
> To: user@hbase.apache.org
> Subject: Re: coprocessor is timing out in 0.94
>
> bq. I checked thread dump
>
> If there was no exception in region server logs, thread dump of region
> server when your coprocessor was running would reveal where it got stuck.
>
> From your description below, looks like you can utilize HBASE-5416 Improve
> performance of scans with some kind of filters.
>
> bq. to apply the filter on one of the column
>
> Basically this column is the essential column.
>
> Cheers
>
> On Thu, Mar 28, 2013 at 3:22 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>
> > bq. when I removed the filter, it ran fine in 0.94
> >
> > Can you disclose more information about your filter ?
> >
> > BTW 0.94.6 was just released which is fully compatible with 0.94.2
> >
> > Cheers
> >
> > On Thu, Mar 28, 2013 at 3:18 PM, Agarwal, Saurabh <
> > saurabh.agarwal@citi.com> wrote:
> >
> >> Hi,
> >>
> >> We are in process of migrating from 0.92.1 to 0.94.2. A coprocessor
> >> was running fine in 0.92. After migrating to 0.94, the client is
> >> timing out (java.net.SocketTimeoutException).  We are using
> >> coprocessor to apply the filter on one of the column and return the
> >> columns that match with that filter criteria. I checked thread dump,
> >> region server, web UI, logs. There is no error or exception.  One
> >> thing I noticed that when I removed the filter, it ran fine in 0.94 as
> well.
> >>
> >> Please advise if there is any specific setting we need to make in 0.94.
> >>
> >> Thanks,
> >> Saurabh.
> >>
> >
> >
>


-- 
Marcos Ortiz Valmaseda,
*Data-Driven Product Manager* at PDVSA
*Blog*: http://dataddict.wordpress.com/
*LinkedIn: *http://www.linkedin.com/in/marcosluis2186
*Twitter*: @marcosluis2186 <http://twitter.com/marcosluis2186>

--f46d04479f95ee545604d9072375--