tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From László Bodor (Jira) <j...@apache.org>
Subject [jira] [Commented] (TEZ-3860) JDK9: ReflectionUtils may not use URLClassLoader
Date Fri, 11 Oct 2019 11:00:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949368#comment-16949368
] 

László Bodor commented on TEZ-3860:
-----------------------------------

found the same issue while using JDK11, I'm not creating a new ticket, I'll take a look at
this

{code}
2019-10-11 08:55:38,771 [ERROR] [Dispatcher thread {Central}] |impl.DAGImpl|: Uncaught Exception
when handling event DAG_START on Dag dag_1570733353399_0023_1 at currentState=INITED
java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot
be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader
and java.net.URLClassLoader are in module java.base of loader 'bootstrap')
	at org.apache.tez.common.ReflectionUtils.addResourcesToSystemClassLoader(ReflectionUtils.java:125)
	at org.apache.tez.dag.utils.RelocalizationUtils.addUrlsToClassPath(RelocalizationUtils.java:57)
	at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1846)
	at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1829)
	at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:362)
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487)
	at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59)
	at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:1166)
	at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:150)
	at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2276)
	at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2267)
	at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180)
	at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115)
	at java.base/java.lang.Thread.run(Thread.java:834)
{code}

> JDK9: ReflectionUtils may not use URLClassLoader
> ------------------------------------------------
>
>                 Key: TEZ-3860
>                 URL: https://issues.apache.org/jira/browse/TEZ-3860
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Zoltan Haindrich
>            Priority: Major
>
> The following code
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/common/ReflectionUtils.java#L125
> is not compatible with JDK9 since the classloader is an AppClassLoader
> causes exceptions like this:
> {code}
> java.lang.ClassCastException: java.base/jdk.internal.loader.ClassLoaders$AppClassLoader
cannot be cast to java.base/java.net.URLClassLoader
> 	at org.apache.tez.common.ReflectionUtils.addResourcesToSystemClassLoader(ReflectionUtils.java:125)
~[tez-api-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.utils.RelocalizationUtils.addUrlsToClassPath(RelocalizationUtils.java:57)
~[tez-common-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1793)
~[tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1776)
~[tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:362)
~[hadoop-yarn-common-2.8.1.jar:?]
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
~[hadoop-yarn-common-2.8.1.jar:?]
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
~[hadoop-yarn-common-2.8.1.jar:?]
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
~[hadoop-yarn-common-2.8.1.jar:?]
> 	at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59) ~[tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:1156) [tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:147) [tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2251)
[tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2242)
[tez-dag-0.9.0.jar:0.9.0]
> 	at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180) [tez-common-0.9.0.jar:0.9.0]
> 	at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115) [tez-common-0.9.0.jar:0.9.0]
> 	at java.base/java.lang.Thread.run(Thread.java:844) [?:?]
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message