hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrzej Bialecki ...@getopt.org>
Subject Re: Hadoop input path - can it have subdirectories
Date Tue, 01 Apr 2008 17:51:40 GMT
Peeyush Bishnoi wrote:
> Hello ,
> 
> No Hadoop can't  traverse recursively inside subdirectory with Java
> Map-Reduce program. It have to be just directory containing files
> (and no sub-directories).

That's not the case.

This is actually a characteristic of the InputFormat that you're using.
Hadoop reads data using InputFormat-s, and standard implementations may
indeed not support subdirectories - but if you need this functionality
you can implement your own InputFormat.


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Mime
View raw message