hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-904) OutputFormat should be given the reduce id directly rather than a filename
Date Thu, 18 Jan 2007 19:06:30 GMT
OutputFormat should be given the reduce id directly rather than a filename
--------------------------------------------------------------------------

                 Key: HADOOP-904
                 URL: https://issues.apache.org/jira/browse/HADOOP-904
             Project: Hadoop
          Issue Type: Improvement
          Components: mapred
    Affects Versions: 0.10.1
            Reporter: Owen O'Malley
         Assigned To: Owen O'Malley
             Fix For: 0.11.0


The OutputFormat API should be changed to be more evolution proof:

public interface OutputFormatContext {
  JobConf getJobConf();
  Progressable getProgress();
}

public interface OutputFormat {
  RecordReader getRecordReader(int reduce, OutputFormatContext context) throws IOException;
  void checkOutputSpecs(OutputFormatContext context) throws IOException;
}

And OutputFormatBase would be renamed:

public abstract class FileOutputFormat implements OutputFormat {
  protected Path getOutputPath(int reduce, OutputFormatContext context) throws IOException
{ ... }
  ... current OutputFormatBase methods ...
}

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message