hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John George (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3696) MR job via oozie does not work on hadoop 23
Date Fri, 20 Jan 2012 17:28:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13189933#comment-13189933

John George commented on MAPREDUCE-3696:

The issue is that oozie is including a pig.jar file that picks up an older version of jackson.
But what confuses me is that the pig.jar gets picked up before all the hadoop jars.
Assuming that oozie does not force USER CLASSPATHs to be picked up first, I wonder if it is
wrong for App Master to include that before the default hadoop jars. 
The following is what I am seeing in the launch_container.sh script. 
export CLASSPATH="job.jar:$PWD/*:file:/gri
ln -sf "/grid/1/tmp/mapred-local/filecache/7267871525837532837/pig.jar" "pig.jar"

which obviously means that pig.jar in $PWD is going to be picked up before *jackson-*.jar
in the hadoop lib directory - which does not seem right.

> MR job via oozie does not work on hadoop 23
> -------------------------------------------
>                 Key: MAPREDUCE-3696
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3696
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.23.1
>            Reporter: John George
>            Assignee: John George
>            Priority: Critical
> NM throws an error on submitting an MR job via oozie on the latest Hadoop 23.
> *Courtesy: Mona Chitnis (ooize)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message