hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From maha <m...@umail.ucsb.edu>
Subject Re: Deprecated ... damaged?
Date Thu, 16 Dec 2010 02:53:02 GMT
Hi Allen and thanks for responding ..
    
   You're answer actually gave me another clue, I set numSplits = numFiles*100; in myInputFormat
and it worked :D ... Do you think there are side effects for doing that?

   Thank you,

       Maha

On Dec 15, 2010, at 12:16 PM, Allen Wittenauer wrote:

> 
> On Dec 15, 2010, at 2:13 AM, maha wrote:
> 
>> Hi everyone,
>> 
>> Using Hadoop-0.20.2, I'm trying to use MultiFileInputFormat which is supposed to
put each file from the input directory in a SEPARATE split.
> 
> 
> 	Is there some reason you don't just use normal InputFormat with an extremely high min.split.size?
> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message