hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Rosenstrauch <dar...@darose.net>
Subject Re: Custom Input format...
Date Fri, 11 Feb 2011 15:01:23 GMT
On 02/11/2011 05:43 AM, Nitin Khandelwal wrote:
> Hi,
> I want to give a folder as input path to Map Red. Each Task should read one
> file out of that folder at once . i was using it before in 0.19 using
> multiFileSplit Format and my own Input format extending it. can u plz tell
> how to do the same in 0.21.0.
> Thanks,

No need for custom input format here.  In the code that creates/launches 
your job, iterate through each file in the directory using:


get the path of each file using:


and then for each path call:



View raw message