hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cosmin Catanoaie (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2079) PipesMapRunner does not use map output classes
Date Sun, 19 Sep 2010 18:43:33 GMT
PipesMapRunner does not use map output classes

                 Key: MAPREDUCE-2079
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2079
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: pipes
    Affects Versions: 0.21.0, 0.20.2, 0.20.1, 0.20.3, 0.21.1, 0.22.0
         Environment: Ubuntu 10.04 Lucid 64bit, Java(TM) SE Runtime Environment (build 1.6.0_20-b02),
Hadoop 20.2 (Cloudera distribution)
            Reporter: Cosmin Catanoaie
            Priority: Blocker

In org.apache.hadoop.mapred.pipes.PipesMapRunner.java at lines 71-72 instead of:

 - job.getOutputKeyClass()    and
 - job.getOutputValueClass()

there should be called:
 - job.getMapOutputKeyClass()    and
 - job.getMapOutputValueClass()

This modification will allow pipe jobs to use intermediate map output classes different from
the job final output classes.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message