pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4500) Pig's tez engine has issue when working with ATS
Date Tue, 07 Apr 2015 16:31:12 GMT

    [ https://issues.apache.org/jira/browse/PIG-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483443#comment-14483443
] 

Daniel Dai commented on PIG-4500:
---------------------------------

We shall upgrade to Hadoop 2.6.0 for this.

> Pig's tez engine has issue when working with ATS
> ------------------------------------------------
>
>                 Key: PIG-4500
>                 URL: https://issues.apache.org/jira/browse/PIG-4500
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Jeff Zhang
>
> Pig use hadoop-2.4 which don't support Timeline ACL, and tez-yarn-timeline-history-with-acls
only works for hadoop-2.6. It would throw the following exception when using ATS in tez
> {code}
> 2015-04-07 13:44:47,208 INFO  [PigTezLauncher-0] client.TezClient (TezClient.java:start(305))
- Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline
ACLs
> Exception in thread "main" 2015-04-07 13:44:47,998 INFO  [Thread-3] tez.TezLauncher
(TezLauncher.java:destroy(470)) - Shutting down thread pool
> org.apache.pig.backend.executionengine.ExecException: ERROR 2117: Unexpected error when
launching Tez job.
> at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.handleUnCaughtException(TezLauncher.java:269)
> at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:222)
> at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:301)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
> at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375)
> at org.apache.pig.PigServer.execute(PigServer.java:1364)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:415)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
> at pig_backup.PigExample.main(PigExample.java:52)
> Caused by: java.lang.RuntimeException: Could not resolve error that occured when launching
job: java.lang.NoClassDefFoundError: org/codehaus/jackson/jaxrs/JacksonJaxbJsonProvider
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.<init>(TimelineClientImpl.java:63)
> at org.apache.hadoop.yarn.client.api.TimelineClient.createTimelineClient(TimelineClient.java:44)
> at org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager.initializeTimelineClient(ATSHistoryACLPolicyManager.java:63)
> at org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager.setConf(ATSHistoryACLPolicyManager.java:198)
> at org.apache.tez.client.TezClient.start(TezClient.java:309)
> at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.createSession(TezSessionManager.java:95)
> at org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager.getClient(TezSessionManager.java:195)
> at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:158)
> at org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher$1.run(TezLauncher.java:174)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.jaxrs.JacksonJaxbJsonProvider
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 26 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message