hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3150) Move task file promotion into the task
Date Mon, 21 Jul 2008 14:29:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615257#action_12615257

Owen O'Malley commented on HADOOP-3150:

No, I wouldn't. Partially for backwards compatibility and partially because the FileOutputCommitter
has a more general interface that takes a path. I suggest:

When a FileOutputFormat is configured, get the output directory and the OutputCommitter. If
the OutputCommitter is a FileOutputCommitter, call setWorkOutputPath with the configuration
and the result of FileOutputPath.getWorkPath(FileOutputFormat.getOutputPath(conf)). Otherwise,
set the work path to the getOutputPath.

> Move task file promotion into the task
> --------------------------------------
>                 Key: HADOOP-3150
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3150
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.19.0
>         Attachments: 3150.patch, patch-3150.txt, patch-3150.txt
> We need to move the task file promotion from the JobTracker to the Task and move it down
into the output format.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message