hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14984) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env
Date Thu, 26 Oct 2017 07:23:01 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220079#comment-16220079
] 

liyunzhang commented on HADOOP-14984:
-------------------------------------

the reason for the problem is the JAVA_COMMAND in {{launch_container.sh}} does not contain
"--add-modules=ALL-SYSTEM"
the command in my  {{launch_container.sh}} is 
{code}
 exec /bin/bash -c "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties
-Dyarn.app.contain    er.log.dir=/home/zly/jdk9/hadoop-3.1.0-SNAPSHOT/logs/userlogs/application_1509001373258_0001/container_1509001373258_0001_02_000001
    -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Dhadoop.root.logfile=syslog
 -Xmx1024m org.apache.hadoop.mapreduc    e.v2.app.MRAppMaster 1>/home/zly/jdk9/hadoop-3.1.0-SNAPSHOT/logs/userlogs/application_1509001373258_0001/container_1509001373258_000
   1_02_000001/stdout 2>/home/zly/jdk9/hadoop-3.1.0-SNAPSHOT/logs/userlogs/application_1509001373258_0001/container_1509001373258_0001_
   02_000001/stderr "
{code}

Anyone knows how to modify the command generated in launch_container.sh like following?
{code}
 exec /bin/bash -c "$JAVA_HOME/bin/java -Djava.io.tmpdir=$PWD/tmp -Dlog4j.configuration=container-log4j.properties
--add-modules=ALL-SYSTEM  ...
{code}

> [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-14984
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14984
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: liyunzhang
>
> After building latest code with jdk9. (patch HADOOP-12760.03.patch, HDFS-11610.001.patch).
And start hdfs, yarn service(HADOOP-14978) successfully. I met exception when running TestDFSIO
> {code}
> hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0-SNAPSHOT-tests.jar
TestDFSIO -write -nrFiles 8 -fileSize 1MB -resFile ./write.1MB.8
> {code}
> the exception
> {code}
> 67 1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource
> 68   at org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:72)
> 69   at org.apache.hadoop.mapreduce.v2.app.webapp.AMWebApp.setup(AMWebApp.java:33)
> 70   while locating org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver
> 71 
>  72 1 error
> 73         at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1025)
> 74         at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1051)
> 75         at com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory$GuiceInstantiatedComponentProvider.getInstance(GuiceComponentProviderFactory.java:345)
> 76         at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory$ManagedSingleton.<init>(IoCProviderFactory.java:202)
> 77         at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory.wrap(IoCProviderFactory.java:123)
> 78         at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory._getComponentProvider(IoCProviderFactory.java:116)
> 79         at com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:153)
> 80         at com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:278)
> 81         at com.sun.jersey.core.spi.component.ProviderServices.getProviders(ProviderServices.java:151)
> 82         at com.sun.jersey.core.spi.factory.ContextResolverFactory.init(ContextResolverFactory.java:83)
> 83         at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1332)
> 84         at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:180)
> 85         at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:799)
> 86         at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:795)
> 87         at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
> 88         at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:795)
> 89         at com.sun.jersey.guice.spi.container.servlet.GuiceContainer.initiate(GuiceContainer.java:121)
> 90         at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:339)
> 91         at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:605)
> 92         at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:207)
> 93         at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:394)
> 94         at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:744)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message