hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-1788) o.a.h.mapreduce.Job shouldn't make a copy of the JobConf
Date Fri, 16 Sep 2011 06:35:09 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy updated MAPREDUCE-1788:

    Attachment: MAPREDUCE-1788.patch

Turned out to be a more complicated patch.

After a brief discussion with Owen I decided to change Job/Cluster to share the same JobConf
which is copied as early as possible...

> o.a.h.mapreduce.Job shouldn't make a copy of the JobConf
> --------------------------------------------------------
>                 Key: MAPREDUCE-1788
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1788
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: client
>    Affects Versions: 0.21.0
>            Reporter: Arun C Murthy
>            Assignee: Arun C Murthy
>             Fix For: 0.23.0
>         Attachments: MAPREDUCE-1788.patch, MAPREDUCE-1788.patch
> Having o.a.h.mapreduce.Job make a copy of the passed in JobConf has several issues: any
modifications done by various pieces such as InputSplit etc. are not reflected back and causes
issues for frameworks built on top.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message