hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi" <peeyu...@yahoo-inc.com>
Subject RE: Hadoop input path - can it have subdirectories
Date Tue, 01 Apr 2008 17:41:53 GMT
Hello ,

No Hadoop can't  traverse recursively inside subdirectory with Java Map-Reduce program. It
have to be just directory containing files (and no sub-directories).  


-----Original Message-----
From: Tarandeep Singh [mailto:tarandeep@gmail.com]
Sent: Tue 4/1/2008 9:15 AM
To: hadoop-user@lucene.apache.org
Subject: Hadoop input path - can it have subdirectories

Can I give a directory (having subdirectories) as input path to Hadoop
Map-Reduce Job.
I tried, but got error.

Can Hadoop recursively traverse the input directory and collect all
the file names or the input path has to be just a directory containing
files (and no sub-directories) ?


  • Unnamed multipart/mixed (inline, None, 0 bytes)
View raw message