hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sonny Heer <sonnyh...@gmail.com>
Subject Small files problem in hadoop 0.20.2 ?
Date Mon, 07 Jun 2010 15:39:43 GMT
I'm current switching to the new hadoop API (mapreduce package instead
of mapred), I've come to a roadblock to the small files problem.
Before we used CombineFileInputFormat to solve this, but with the new
Hadoop API I can't find an alternative.

After googling a while i found the CombineFileInputFormat was the
replacement for MultiFileInputFormat in hadoop 0.20.  The class is
present up till 0.20.1, but has been taken out in 0.20.2.

where i can get a version of CombineFileInputFormat that uses the new API?

View raw message