Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of jdcryans@gmail.com designates
 209.85.200.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:sender:to:subject:in-reply-to:mime-version
         :content-type:references:x-google-sender-auth;
        b=fsKiXVkUYCtgOxqVo91rEzmwTXzcsD8fGgwb5MnHwdPVAmnK/gGa+bhHOJqxqFS5tn
         cU7W1ZQ2GtA7cSSVC3B0Lf6ygZ8sqkRMQJwN443u0VRc3j+FOXQDZOerKDVdgSr+mdDm
         Pba4AKTi2P/tTtyWYXo5cO5lqeaIQT8wAVl8s=
Message-ID: <31a243e70809191040o13cb0c03g94023e95a002540@mail.gmail.com>
Date: Fri, 19 Sep 2008 13:40:33 -0400
From: "Jean-Daniel Cryans" <jdcryans@apache.org>
Sender: jdcryans@gmail.com
To: hbase-user@hadoop.apache.org
Subject: Re: MR process in endless loop
In-Reply-To: <F2FFED7D-0DA9-4A3B-A4F6-8AE0B4F6A998@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_52881_7571105.1221846033783"
References: <F2FFED7D-0DA9-4A3B-A4F6-8AE0B4F6A998@gmail.com>

------=_Part_52881_7571105.1221846033783
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Dru,

Which versions?

Thx

J-D

On Fri, Sep 19, 2008 at 1:38 PM, Dru Jensen <drujensen@gmail.com> wrote:

> I have a MR process that gets stuck in an endless loop.  It looks like the
> same set of keys are being sent to one of the tasks in an endless loop.
> Unfortunately, Its not consistent.  Sometimes it works fine.  Only 1 of the
> 6 MR processes gets in this state and never completes.
> After the disk space is used up on the HFS, the tables become corrupt and I
> can no longer recover them.
>
> The main difference from other MR processes I have is that I added a filter
> to the MR process table scanner by extending the TableInputFormatBase:
>
> public class TableInputFormatColumnFilter extends TableInputFormatBase
> implements JobConfigurable {...}
>
> and then adding a ColumnValueFilter in the configure() as follows:
>
>    ColumnValueFilter rowFilter = new
> ColumnValueFilter(Bytes.toBytes("column_name"),
> ColumnValueFilter.CompareOp.LESS_OR_EQUAL, Bytes.toBytes("column_value"));
>    setRowFilter(rowFilter);
>
> Any ideas what may be causing this?

------=_Part_52881_7571105.1221846033783--