hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn
Date Tue, 30 Apr 2013 01:13:14 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhijie Shen updated MAPREDUCE-5156:
-----------------------------------

    Attachment: MAPREDUCE-5156.1.patch

I've drafted a patch, which changes "int ProgramDriver#driver" to "int ProgramDriver#driverV2",
and adds "void ProgramDriver#driver" that wraps "int ProgramDriver#driverV2". This is an incompatible
change, which is not binary compatible with the previous Hadoop 2.x alpha releases. Therefore,
the changes is trading binary compatibility of Hadoop 2 with that of Hadoop 1. IMHO, since
Hadoop 2 is still in alpha, the impact of incompatibility should be much smaller.

In addition, though there's very little code modification, common, mapreduce and hdfs are
all affected. We need to think about the way of managing the change. And probably we'd like
to move this M/R ticket to common.

You idea, please!
                
> Hadoop-examples-1.x.x.jar cannot run on Yarn
> --------------------------------------------
>
>                 Key: MAPREDUCE-5156
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5156
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>            Priority: Blocker
>         Attachments: MAPREDUCE-5156.1.patch
>
>
> M/R examples are run through ProgramDriver.driver. ProgramDriver.driver returns void
in hadoop-1, while it returns int in hadoop-2. Therefore, the function signatures in the example
jar and yarn are incompatible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message