hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@veoh.com>
Subject Re: Hadoop input path - can it have subdirectories
Date Tue, 01 Apr 2008 19:04:13 GMT

But wildcards that match directories that contain files work well.


On 4/1/08 10:41 AM, "Peeyush Bishnoi" <peeyushb@yahoo-inc.com> wrote:

> Hello ,
> 
> No Hadoop can't  traverse recursively inside subdirectory with Java Map-Reduce
> program. It have to be just directory containing files (and no
> sub-directories).
> 
> 
> ---
> Peeyush
> 
> 
> -----Original Message-----
> From: Tarandeep Singh [mailto:tarandeep@gmail.com]
> Sent: Tue 4/1/2008 9:15 AM
> To: hadoop-user@lucene.apache.org
> Subject: Hadoop input path - can it have subdirectories
>  
> Hi,
> 
> Can I give a directory (having subdirectories) as input path to Hadoop
> Map-Reduce Job.
> I tried, but got error.
> 
> Can Hadoop recursively traverse the input directory and collect all
> the file names or the input path has to be just a directory containing
> files (and no sub-directories) ?
> 
> -Taran
> 


Mime
View raw message