pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Catalin Alexandru Zamfir (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2634) JarManager fails for rsrc: jars
Date Fri, 06 Apr 2012 07:54:29 GMT

    [ https://issues.apache.org/jira/browse/PIG-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248163#comment-13248163
] 

Catalin Alexandru Zamfir commented on PIG-2634:
-----------------------------------------------

Hi Daniel,
The quick way to test this is:
- build an Eclipse (Maven) project;
- add the necessary libraries (for example pig-0.9.2-core.jar) to the build path;
- export (packaged) the project and run it with a given script. The script runs properly when
run via "pig -x mapreduce order.pig" for example.
- but fails when the Java program, using PigServer/PigRunner tries to run the same script.
- it fails as i cannot find "rsrc: pig-0.9.2-core.ajr" in the createJar/mergeJar methods.

So as far as I'm guessing, it does not include jars that are currently on the build path.
For example if I add pig-0.9.2-core.jar as an Eclipse dependency for the project, it does
not find it, when it should.

I tried adding a "register /path/to/pig.jar" in the script, but still fails with the same
name of the Eclipse dependency.
If I don't add pig-0.9.2-core.jar as a dependency in the Eclipse project, I cannot use PigServer/PigRunner.

So, the mergeJar/createJar methods need to be fised, maybe using Apache VFS2 to get jars on
the build-path or in a path inside the running jar and add them to the jar that's going to
be built by these methods. (which seems to be the JobXXXXXXXXXX.jar that gets submitted to
the jobtracker).

Help would be appreciated, if not by a fix, then by help or direction, as I'm able to fix
it on my own and provide a patch back to ASF/Pig.
                
> JarManager fails for rsrc: jars
> -------------------------------
>
>                 Key: PIG-2634
>                 URL: https://issues.apache.org/jira/browse/PIG-2634
>             Project: Pig
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 0.9.2
>            Reporter: Catalin Alexandru Zamfir
>            Priority: Blocker
>              Labels: engine, mapreducel, merge, parser, pigserver
>         Attachments: pig_1333633836139.log
>
>
> The following error occurs when using PigSever class, while using registerScript (InputStream).
The Eclipse Maven project adds "pig-0.9.2.jar" as a dependency. When runned, if fails to merge
pig-0.9.2.jar. The whole trace is:
> ###
> Caused by: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
ERROR 2017: Internal error creating job configuration.
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:727)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:150)
>         at org.apache.pig.PigServer.launchPlan(PigServer.java:1314)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1299)
>         at org.apache.pig.PigServer.execute(PigServer.java:1289)
>         at org.apache.pig.PigServer.access$400(PigServer.java:125)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1591)
>         ... 44 more
> Caused by: java.io.FileNotFoundException: rsrc:pig-0.9.2-core.jar (No such file or directory)
>         at java.io.FileInputStream.open(Native Method)
>         at java.io.FileInputStream.<init>(FileInputStream.java:137)
>         at java.io.FileInputStream.<init>(FileInputStream.java:96)
>         at org.apache.pig.impl.util.JarManager.mergeJar(JarManager.java:176)
>         at org.apache.pig.impl.util.JarManager.createJar(JarManager.java:118)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:412)
> ###
> Pig should not fail for jars on the "rsrc:" path.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message