hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Joseph Evans (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4076) Stream job fails with ZipException when use yarn jar command
Date Tue, 10 Apr 2012 21:29:19 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251077#comment-13251077

Robert Joseph Evans commented on MAPREDUCE-4076:

OK I just looked and answered my own question HADOOP_OPTS is not the same as YARN_OPTS.  :)

I don't really like that if you run it with yarn hadoop.home.dir is set to YARN_HOME, and
if you run it with hadoop it is set to HADOOP_PREFIX, but that is something for a different
JIRA.  +1
> Stream job fails with ZipException when use yarn jar command
> ------------------------------------------------------------
>                 Key: MAPREDUCE-4076
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4076
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.0.0, 3.0.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>            Priority: Blocker
>         Attachments: MAPREDUCE-4076.patch
> Stream job fails with ZipException when use yarn jar command and executes successfully
with hadoop jar command.
> {code:xml}
> linux-f330:/home/devaraj/hadoop/trunk/hadoop-0.24.0-SNAPSHOT/bin # ./yarn jar ../share/hadoop/tools/lib/hadoop-streaming-0.24.0-SNAPSHOT.jar
-input /hadoop -output /test/output/1 -mapper cat -reducer wc
> packageJobJar: [] [/home/devaraj/hadoop/trunk/hadoop-0.24.0-SNAPSHOT/bin/$%7Bhadoop.home.dir%7D/hadoop-$%7Buser.name%7D/hadoop-unjar4241129353499211360/]
/tmp/streamjob7683981905208294893.jar tmpDir=null
> Exception in thread "main" java.io.IOException: java.util.zip.ZipException: ZIP file
must have at least one entry
>         at org.apache.hadoop.streaming.JarBuilder.merge(JarBuilder.java:82)
>         at org.apache.hadoop.streaming.StreamJob.packageJobJar(StreamJob.java:707)
>         at org.apache.hadoop.streaming.StreamJob.setJobConf(StreamJob.java:948)
>         at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:127)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>         at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:50)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
> {code}

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message