hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3150) Move task file promotion into the task
Date Thu, 31 Jul 2008 06:00:33 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amareshwari Sriramadasu updated HADOOP-3150:
--------------------------------------------

    Release Note: 
1. Moved the task file promotion from the JobTracker to the Task and moved it down into the
OutputCommitter.
2. Added public classes org.apache.hadoop.mapred.JobContext, org.apache.hadoop.mapred.TaskAttemptContext,
org.apache.hadoop.mapred.OutputCommitter and org.apache.hadoop.mapred.FileOutputCommiitter
3. Added public apis:   public OutputCommitter getOutputCommitter() and 
public void setOutputCommitter(Class<? extends OutputCommitter> theClass) in org.apache.hadoop.mapred.JobConf

  was:
1. Moved the task file promotion from the JobTracker to the Task and moved it down into the
OutputCommitter.
2. Added public classes org.apache.hadoop.mapred.JobContext, org.apache.hadoop.mapred.TaskAttemptContext,
org.apache.hadoop.mapred.OutputCommitter and org.apache.hadoop.mapred.FileOutputCommiitter
3. Changed the public interface org.apache.hadoop.mapred.OutputFormat to public abstract class.
  
4. The signature of api: RecordWriter<K, V> getRecordWriter(FileSystem ignored, JobConf
job, String name, Progressable progress) is changed to public abstract RecordWriter<K,
V> getRecordWriter(TaskAttemptContext context) in OutputFormat.  
5. The signature of api: void checkOutputSpecs(FileSystem ignored, JobConf job) is changed
to public abstract  void checkOutputSpecs(JobContext context) in OutputFormat.
6. Added public apis:   public OutputCommitter getOutputCommitter() and 
public void setOutputCommitter(Class<? extends OutputCommitter> theClass) in org.apache.hadoop.mapred.JobConf

          Status: Patch Available  (was: Open)

> Move task file promotion into the task
> --------------------------------------
>
>                 Key: HADOOP-3150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3150
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.19.0
>
>         Attachments: 3150.patch, patch-3150.txt, patch-3150.txt, patch-3150.txt, patch-3150.txt,
patch-3150.txt, patch-3150.txt
>
>
> We need to move the task file promotion from the JobTracker to the Task and move it down
into the output format.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message