hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: how to define new InputFormat with streaming?
Date Sun, 17 Mar 2013 06:22:43 GMT
The issue is that Streaming expects the old/stable MR API
(org.apache.hadoop.mapred.InputFormat) as its input format class, but your
WholeFileInputFormat is using the new MR API
(org.apache.hadoop.mapreduce.lib.input.InputFormat). Using the older form
will let you pass.

This has nothing to do with your version/distribution of Hadoop.


On Fri, Mar 15, 2013 at 4:28 PM, Steve Loughran <stevel@hortonworks.com>wrote:

> On 15 March 2013 09:18, springring <springring@126.com> wrote:
>
> >  Hi,
> >
> >      my hadoop version is Hadoop 0.20.2-cdh3u3 and I want to define new
> > InputFormat in hadoop book , but there is error
> > "class org.apache.hadoop.streaming.WholeFileInputFormat not
> > org.apache.hadoop.mapred.InputFormat"
> >
> > Hadoop version is 0.20, but the streaming still depend on 0.10 mapred
> api?
> >
>
>
> 1. please don't spam all the lists
> 2. grab a later version of the apache releases if you want help on them on
> these mailing lists, or go to the cloudera lists, where they will probably
> say "upgrade to CDH 4.x" before asking questions.
>
> thanks
>



-- 
Harsh J

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message