spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed
Date Sun, 13 Apr 2014 10:39:16 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967784#comment-13967784
] 

Sean Owen commented on SPARK-1479:
----------------------------------

"yarn" is the slightly more appropriate profile, but, read: https://github.com/apache/spark/pull/151
What Spark doesn't quite support is "YARN beta" and that's what you've got on your hands here.

FWIW I am in favor of the change in this PR to make it all work. Soon, support for YARN alpha/beta
can just go away anyway.

If you are interested in CDH, the best thing is moving to CDH5, which already has Spark set
up in standalone mode, and which has "YARN stable". It also works with CDH 4.6 in standalone
mode as a parcel.

> building spark on 2.0.0-cdh4.4.0 failed
> ---------------------------------------
>
>                 Key: SPARK-1479
>                 URL: https://issues.apache.org/jira/browse/SPARK-1479
>             Project: Spark
>          Issue Type: Question
>         Environment: 2.0.0-cdh4.4.0
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
> spark 0.9.1
> java version "1.6.0_32"
>            Reporter: jackielihf
>         Attachments: mvn.log
>
>
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile (scala-compile-first)
on project spark-yarn-alpha_2.10: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile
failed. CompileFailed -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile
(scala-compile-first) on project spark-yarn-alpha_2.10: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
> 	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:225)
> 	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> 	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> 	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> 	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> 	at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> 	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> 	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
> 	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> 	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
> 	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
> 	at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
> 	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
> Caused by: org.apache.maven.plugin.PluginExecutionException: Execution scala-compile-first
of goal net.alchim31.maven:scala-maven-plugin:3.1.5:compile failed.
> 	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:110)
> 	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> 	... 19 more
> Caused by: Compilation failed
> 	at sbt.compiler.AnalyzingCompiler.call(AnalyzingCompiler.scala:76)
> 	at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:35)
> 	at sbt.compiler.AnalyzingCompiler.compile(AnalyzingCompiler.scala:29)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply$mcV$sp(AggressiveCompile.scala:71)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4$$anonfun$compileScala$1$1.apply(AggressiveCompile.scala:71)
> 	at sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:101)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4.compileScala$1(AggressiveCompile.scala:70)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:88)
> 	at sbt.compiler.AggressiveCompile$$anonfun$4.apply(AggressiveCompile.scala:60)
> 	at sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:24)
> 	at sbt.inc.IncrementalCompile$$anonfun$doCompile$1.apply(Compile.scala:22)
> 	at sbt.inc.Incremental$.cycle(Incremental.scala:40)
> 	at sbt.inc.Incremental$.compile(Incremental.scala:25)
> 	at sbt.inc.IncrementalCompile$.apply(Compile.scala:20)
> 	at sbt.compiler.AggressiveCompile.compile2(AggressiveCompile.scala:96)
> 	at sbt.compiler.AggressiveCompile.compile1(AggressiveCompile.scala:44)
> 	at com.typesafe.zinc.Compiler.compile(Compiler.scala:158)
> 	at com.typesafe.zinc.Compiler.compile(Compiler.scala:142)
> 	at sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:77)
> 	at scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:296)
> 	at scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:123)
> 	at scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:104)
> 	at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:460)
> 	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> 	... 20 more
> [ERROR] 
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the
following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :spark-yarn-alpha_2.10
> =============
> thks



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message