hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Zhang <zjf...@gmail.com>
Subject Re: Configured & PathFilter
Date Mon, 12 Apr 2010 15:35:42 GMT
 Hi Kris,

Do you mean you want to use the PathFilter in map or reduce task ? Or you
mean using the PathFilter in InputFormat ?
I guess you mean the second case, if so you only need to call
FileInputFormat.setInputPathFilter(,) to provide the filter information.

On Mon, Apr 12, 2010 at 8:13 AM, Kris Nuttycombe

> Hi, all, quick question about using PathFilter.
> Is there any way to provide information from the job configuration to
> a PathFilter instance? In my case, I want to  limit the date range of
> the files being selected by the filter, and don't want to have to
> hard-code a separate PathFilter instance for each date range I'm
> interested in, obviously. If I make my PathFilter extend Configured,
> will it do the right thing?
> Thanks!
> Kris

Best Regards

Jeff Zhang

View raw message