hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: getting error compiling yarn-hadoop on Mac
Date Wed, 23 Oct 2013 22:16:50 GMT
I couldn't reproduce the test failure on Mac.

If your goal is to compile hadoop, try the following command:

mvn clean package -DskipTests


On Wed, Oct 23, 2013 at 2:43 PM, ji yan <yanji84@gmail.com> wrote:

> I upgraded maven from 3.0 to 3.1.1 and started build from hadoop trunk, and
> one of the tests failed with, this happened with building Apache Hadoop
> Common before it had a chance to build hadoop-yarn
>
> testErrorMessage[0](org.apache.hadoop.ipc.TestSaslRPC)  Time elapsed: 0.064
> sec  <<< ERROR!
> java.io.IOException: failure to login
> at javax.security.auth.login.LoginContext.invoke(LoginContext.java:872)
>  at
> javax.security.auth.login.LoginContext.access$000(LoginContext.java:186)
> at javax.security.auth.login.LoginContext$5.run(LoginContext.java:706)
>  at java.security.AccessController.doPrivileged(Native Method)
> at
>
> javax.security.auth.login.LoginContext.invokeCreatorPriv(LoginContext.java:703)
>  at javax.security.auth.login.LoginContext.login(LoginContext.java:576)
> at
>
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:691)
>  at
>
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:587)
> at org.apache.hadoop.security.SaslRpcServer.<init>(SaslRpcServer.java:105)
>  at org.apache.hadoop.ipc.Server.buildNegotiateResponse(Server.java:2238)
> at org.apache.hadoop.ipc.Server.<init>(Server.java:2208)
>  at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:901)
> at
>
> org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:372)
>  at
>
> org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:294)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:746)
>  at
> org.apache.hadoop.ipc.TestSaslRPC.testErrorMessage(TestSaslRPC.java:333)
>
>
>
> On Wed, Oct 23, 2013 at 12:06 PM, Zhijie Shen <zshen@hortonworks.com>
> wrote:
>
> > Hi Ji,
> >
> > It seems that you're building from the root of hadoop-yarn dir, right?
> > Would you please build from the root of the hadoop trunk first, and then
> > try from the root of hadoop-yarn dir? See whether the failure happens
> > again.
> >
> > Thanks,
> > Zhijie
> >
> >
> > On Wed, Oct 23, 2013 at 11:49 AM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> > > What is the version of maven you're using ?
> > > Mine is:
> > >
> > > $ mvn -version
> > > Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da;
> 2013-02-19
> > > 05:51:28-0800)
> > >
> > > I don't get the error below.
> > >
> > >
> > > On Wed, Oct 23, 2013 at 11:39 AM, ji yan <yanji84@gmail.com> wrote:
> > >
> > > > setting JAVA_HOME did not help
> > > >
> > > > I did a fresh svn checkout of hadoop-trunk, then on command line
> > > >
> > > > cd hadoop-yarn-project
> > > > mvn -X clean install
> > > >
> > > > The maven-enforcer-plugin threw a
> > > > org.apache.maven.enforcer.rule.api.EnforcerRuleException complaining
> > > about
> > > > Dependency convergence error for
> > > > org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > >
> > > > This is the the error log with debugging turned on
> > > >
> > > > [WARNING]
> > > > Dependency convergence error for
> > > > org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT paths to
> dependency
> > > > are:
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-annotations:3.0.0-20131023.152338-3616
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > >
> > > > [DEBUG] Adding failure due to exception
> > > > org.apache.maven.enforcer.rule.api.EnforcerRuleException: Failed
> while
> > > > enforcing releasability the error(s) are [
> > > > Dependency convergence error for
> > > > org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT paths to
> dependency
> > > > are:
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-annotations:3.0.0-20131023.152338-3616
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > ]
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.plugins.enforcer.DependencyConvergence.execute(DependencyConvergence.java:140)
> > > >     at
> > > >
> > >
> >
> org.apache.maven.plugins.enforcer.EnforceMojo.execute(EnforceMojo.java:177)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> > > >     at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
> > > >     at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> > > >     at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> > > >     at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> > > >     at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> > > >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > >     at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > > >     at
> > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > > >     at java.lang.reflect.Method.invoke(Method.java:597)
> > > >     at
> > > >
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> > > >     at
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> > > >     at
> > > >
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> > > >     at
> > > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> > > > Caused by: org.apache.maven.enforcer.rule.api.EnforcerRuleException:
> > > Failed
> > > > while enforcing releasability the error(s) are [
> > > > Dependency convergence error for
> > > > org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT paths to
> dependency
> > > > are:
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-annotations:3.0.0-20131023.152338-3616
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > ]
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.plugins.enforcer.DependencyConvergence.execute(DependencyConvergence.java:131)
> > > >     ... 22 more
> > > > [DEBUG] Executing rule:
> > > > org.apache.maven.plugins.enforcer.RequireMavenVersion
> > > > [DEBUG] Rule org.apache.maven.plugins.enforcer.RequireMavenVersion is
> > > > cacheable.
> > > > [DEBUG] Detected Maven Version: 3.0.3
> > > > [DEBUG] Detected Maven Version: 3.0.3 is allowed in the range
> [3.0.2,).
> > > > [DEBUG] Executing rule:
> > > > org.apache.maven.plugins.enforcer.RequireJavaVersion
> > > > [DEBUG] Rule org.apache.maven.plugins.enforcer.RequireJavaVersion is
> > > > cacheable.
> > > > [DEBUG] Detected Java String: 1.6.0_65
> > > > [DEBUG] Normalized Java String: 1.6.0-65
> > > > [DEBUG] Parsed Version: Major: 1 Minor: 6 Incremental: 0 Build: 65
> > > > Qualifier: null
> > > > [DEBUG] Detected JDK Version: 1.6.0-65 is allowed in the range 1.6.
> > > > [WARNING] Rule 0:
> > org.apache.maven.plugins.enforcer.DependencyConvergence
> > > > failed with message:
> > > > Failed while enforcing releasability the error(s) are [
> > > > Dependency convergence error for
> > > > org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT paths to
> dependency
> > > > are:
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-annotations:3.0.0-20131023.152338-3616
> > > > and
> > > > +-org.apache.hadoop:hadoop-yarn:3.0.0-SNAPSHOT
> > > >   +-org.apache.hadoop:hadoop-common:3.0.0-20131023.152425-3600
> > > >     +-org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT
> > > > ]
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] Reactor Summary:
> > > > [INFO]
> > > > [INFO] hadoop-yarn ....................................... FAILURE
> > > [3.914s]
> > > > [INFO] hadoop-yarn-api ................................... SKIPPED
> > > > [INFO] hadoop-yarn-common ................................ SKIPPED
> > > > [INFO] hadoop-yarn-server ................................ SKIPPED
> > > > [INFO] hadoop-yarn-server-common ......................... SKIPPED
> > > > [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
> > > > [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
> > > > [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
> > > > [INFO] hadoop-yarn-server-tests .......................... SKIPPED
> > > > [INFO] hadoop-yarn-client ................................ SKIPPED
> > > > [INFO] hadoop-yarn-applications .......................... SKIPPED
> > > > [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
> > > > [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
> > > > [INFO] hadoop-yarn-site .................................. SKIPPED
> > > > [INFO] hadoop-yarn-project ............................... SKIPPED
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] BUILD FAILURE
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [INFO] Total time: 5.392s
> > > > [INFO] Finished at: Wed Oct 23 11:16:19 PDT 2013
> > > > [INFO] Final Memory: 12M/81M
> > > > [INFO]
> > > >
> > ------------------------------------------------------------------------
> > > > [ERROR] Failed to execute goal
> > > > org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce
> (depcheck)
> > > on
> > > > project hadoop-yarn: Some Enforcer rules have failed. Look above for
> > > > specific messages explaining why the rule failed. -> [Help 1]
> > > > org.apache.maven.lifecycle.LifecycleExecutionException: Failed to
> > execute
> > > > goal org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce
> > > > (depcheck) on project hadoop-yarn: Some Enforcer rules have failed.
> > Look
> > > > above for specific messages explaining why the rule failed.
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> > > >     at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
> > > >     at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> > > >     at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> > > >     at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> > > >     at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> > > >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > >     at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > > >     at
> > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > > >     at java.lang.reflect.Method.invoke(Method.java:597)
> > > >     at
> > > >
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> > > >     at
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> > > >     at
> > > >
> > > >
> > >
> >
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> > > >     at
> > > >
> > org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> > > > Caused by: org.apache.maven.plugin.MojoExecutionException: Some
> > Enforcer
> > > > rules have failed. Look above for specific messages explaining why
> the
> > > rule
> > > > failed.
> > > >     at
> > > >
> > >
> >
> org.apache.maven.plugins.enforcer.EnforceMojo.execute(EnforceMojo.java:209)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> > > >     at
> > > >
> > > >
> > >
> >
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> > > >     ... 19 more
> > > >
> > > >
> > > >
> > > > On Wed, Oct 23, 2013 at 1:44 AM, 黄浩松 <haosdent@gmail.com>
wrote:
> > > >
> > > > > May be you should export
> > > > >
> > > > >
> > > >
> > >
> >
> JAVA_HOME="/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home"
> > > > > first.
> > > > >
> > > > > 2013/10/23 Ted Yu <yuzhihong@gmail.com>:
> > > > > > What version of Hadoop are you working on ?
> > > > > >
> > > > > > What command line did you use ?
> > > > > >
> > > > > > Please show us more of the error.
> > > > > >
> > > > > > Cheers
> > > > > >
> > > > > > On Oct 22, 2013, at 11:18 PM, ji yan <yanji84@gmail.com>
wrote:
> > > > > >
> > > > > >> I am getting this error
> > > > > >>
> > > > > >> [ERROR] Failed to execute goal
> > > > > >> org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce
> > > > (depcheck)
> > > > > on
> > > > > >> project hadoop-yarn: Some Enforcer rules have failed. Look
above
> > for
> > > > > >> specific messages explaining why the rule failed. ->
[Help 1]
> > > > > >> [ERROR]
> > > > > >> [ERROR] To see the full stack trace of the errors, re-run
Maven
> > with
> > > > > the -e
> > > > > >> switch.
> > > > > >> [ERROR] Re-run Maven using the -X switch to enable full
debug
> > > logging.
> > > > > >> [ERROR]
> > > > > >> [ERROR] For more information about the errors and possible
> > > solutions,
> > > > > >> please read the following articles:
> > > > > >> [ERROR] [Help 1]
> > > > > >>
> > > >
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> > > > > >>
> > > > > >> can anyone help me?
> > > > > >>
> > > > > >> thx
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best Regards,
> > > > > Haosdent Huang
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Do not wait to strike till the iron is hot; but make it hot by
> striking
> > > >
> > > > LinkedIn Profile: http://www.linkedin.com/pub/ji-yan/a/a57/79
> > > >
> > >
> >
> >
> >
> > --
> > Zhijie Shen
> > Hortonworks Inc.
> > http://hortonworks.com/
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
>
>
> --
> Do not wait to strike till the iron is hot; but make it hot by striking
>
> LinkedIn Profile: http://www.linkedin.com/pub/ji-yan/a/a57/79
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message