Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of zjffdu@gmail.com designates
 209.85.223.198 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=aMuGiE2TdqRBGbxn9fJNojpRh6ktXlbcPB0bOrwWIWjFezD7ylgj7zZBmfz7wx/8rU
         9yxf8zyhed3So0RUP1Yfmk35b+uaoyAPwP/XcmohIfmCFhSvkd56vVzMrTbzirRskysm
         xohmLw2LarSgN4VXzMVZt04LwHlETdL+dMEzQ=
MIME-Version: 1.0
In-Reply-To: <x2m2771e601004120813h5e8259e0u8878af844be23672@mail.gmail.com>
References: <x2m2771e601004120813h5e8259e0u8878af844be23672@mail.gmail.com>
Date: Mon, 12 Apr 2010 08:35:42 -0700
Message-ID: <q2i8211a1321004120835k1d074babh64029997b26ff70@mail.gmail.com>
Subject: Re: Configured & PathFilter
From: Jeff Zhang <zjffdu@gmail.com>
To: mapreduce-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=00504502ad41d2a2c104840be5c4

--00504502ad41d2a2c104840be5c4
Content-Type: text/plain; charset=UTF-8

 Hi Kris,

Do you mean you want to use the PathFilter in map or reduce task ? Or you
mean using the PathFilter in InputFormat ?
I guess you mean the second case, if so you only need to call
FileInputFormat.setInputPathFilter(,) to provide the filter information.


On Mon, Apr 12, 2010 at 8:13 AM, Kris Nuttycombe
<kris.nuttycombe@gmail.com>wrote:

> Hi, all, quick question about using PathFilter.
>
> Is there any way to provide information from the job configuration to
> a PathFilter instance? In my case, I want to  limit the date range of
> the files being selected by the filter, and don't want to have to
> hard-code a separate PathFilter instance for each date range I'm
> interested in, obviously. If I make my PathFilter extend Configured,
> will it do the right thing?
>
> Thanks!
>
> Kris
>


-- 
Best Regards

Jeff Zhang

--00504502ad41d2a2c104840be5c4
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

=C2=A0Hi Kris,<br><br>Do you mean you want to use the PathFilter in map or =
reduce task ? Or you mean using the PathFilter in InputFormat ?<br>I guess =
you mean the second case, if so you only need to call FileInputFormat.setIn=
putPathFilter(,) to provide the filter information.<br>
<br><br><div class=3D"gmail_quote">On Mon, Apr 12, 2010 at 8:13 AM, Kris Nu=
ttycombe <span dir=3D"ltr">&lt;<a href=3D"mailto:kris.nuttycombe@gmail.com"=
>kris.nuttycombe@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gm=
ail_quote" style=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt =
0pt 0pt 0.8ex; padding-left: 1ex;">
Hi, all, quick question about using PathFilter.<br>
<br>
Is there any way to provide information from the job configuration to<br>
a PathFilter instance? In my case, I want to =C2=A0limit the date range of<=
br>
the files being selected by the filter, and don&#39;t want to have to<br>
hard-code a separate PathFilter instance for each date range I&#39;m<br>
interested in, obviously. If I make my PathFilter extend Configured,<br>
will it do the right thing?<br>
<br>
Thanks!<br>
<font color=3D"#888888"><br>
Kris<br>
</font></blockquote></div><br><br clear=3D"all"><br>-- <br>Best Regards<br>=
<br>Jeff Zhang<br>

--00504502ad41d2a2c104840be5c4--