bigtop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chi Zewen <chize...@outlook.com>
Subject 答复: Build Failure when exec "gradle spark-rpm"
Date Fri, 27 Oct 2017 02:28:54 GMT
Hi Cos,
I used pre-built Docker images (1.2.1-centos-7) and exec :
docker run -v `pwd`:/ws bigtop/slaves:1.2.1-centos-7 bash -l -c 'cd /ws ; gradle spark-rpm’
(The version of bigtop used here is 1.2.1-RC2)
However, I got the same error:
...
[INFO] Spark Project Launcher ............................. SKIPPED
[INFO] Spark Project Core ................................. SKIPPED
[INFO] Spark Project ML Local Library ..................... FAILURE [04:42 min]
…

Regards,
Zewen

________________________________
发件人: Konstantin Boudnik <cos@apache.org>
发送时间: 2017年10月26日 16:32
收件人: user@bigtop.apache.org
主题: Re: Build Failure when exec "gradle spark-rpm"

Look at "Recommended: Using pre-built Docker images " section of [1]

[1] https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-1.1


--
  With regards,
Konstantin (Cos) Boudnik
2CAC 8312 4870 D885 8616  6115 220F 6980 1F27 E622

Disclaimer: Opinions expressed in this email are those of the author,
and do not necessarily represent the views of any company the author
might be affiliated with at the moment of writing.


On Thu, Oct 26, 2017 at 1:09 AM, Chi Zewen <chizewen@outlook.com> wrote:
> Hi Cos,
>
> How can I get an available docker image which is used for the CI builds?
> Maybe exec ./bigtop-ci/build.sh ?
>
> Regards,
> Zewen
>
>
> 在 2017年10月26日,下午12:28,Konstantin Boudnik <cos@apache.org> 写道:
>
> Are you using our recommended toolchain? Or the readily available docker
> images we use for the CI builds?
> --
> Regards,
>  Cos
>
> On October 25, 2017 8:06:34 PM PDT, Chi Zewen <chizewen@outlook.com> wrote:
>
> Hi,
>
> Nice to meet you all. I’m Zewen, a trainee working in China.
>
> I’m trying to package spark into rpm packages by using “./gradlew” &
> “gradle spark-rpm” on docker(centos7).
> I tried many times and failed with the following output:
>
> [INFO] Compiling 26 source files to
> /root/host/runtime/bigtop-rel-1.2.0/build/spark/rpm/BUILD/spark-2.1.0/yarn/target/scala-2.11/classes
> at 1508926971435
> [WARNING] warning: Class org.mortbay.jetty.Server not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.webapp.WebAppContext not
> found - continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.servlet.Context not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.Connector not found -
> continuing with a stub.
> [WARNING] warning: Class
> org.mortbay.jetty.handler.ContextHandlerCollection not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.servlet.Context not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.servlet.Context not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.servlet.Context not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.servlet.Context not found -
> continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.webapp.WebAppContext not
> found - continuing with a stub.
> [WARNING] warning: Class org.mortbay.jetty.Connector not found -
> continuing with a stub.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping Spark Project External Flume
> [INFO] This project has been banned from the build due to previous
> failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping Spark Integration for Kafka 0.8
> [INFO] This project has been banned from the build due to previous
> failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping Spark Integration for Kafka 0.10
> [INFO] This project has been banned from the build due to previous
> failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Spark Project Parent POM ........................... SUCCESS [
> 5.967 s]
> [INFO] Spark Project Tags ................................. SUCCESS [
> 9.337 s]
> [INFO] Spark Project Sketch ............................... SUCCESS [
> 24.555 s]
> [INFO] Spark Project Networking ........................... SUCCESS [
> 26.167 s]
> [INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [
> 18.151 s]
> [INFO] Spark Project Unsafe ............................... SUCCESS [
> 32.972 s]
> [INFO] Spark Project Launcher ............................. SUCCESS [
> 20.188 s]
> [INFO] Spark Project Core ................................. SUCCESS
> [07:24 min]
> [INFO] Spark Project ML Local Library ..................... SUCCESS
> [01:10 min]
> [INFO] Spark Project GraphX ............................... SUCCESS
> [01:59 min]
> [INFO] Spark Project Streaming ............................ SUCCESS
> [04:01 min]
> [INFO] Spark Project Catalyst ............................. FAILURE
> [03:37 min]
> [INFO] Spark Project SQL .................................. SKIPPED
> [INFO] Spark Project ML Library ........................... SKIPPED
> [INFO] Spark Project Tools ................................ SUCCESS [
> 14.261 s]
> [INFO] Spark Project Hive ................................. SKIPPED
> [INFO] Spark Project REPL ................................. SKIPPED
> [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [
> 15.728 s]
> [INFO] Spark Project YARN ................................. SKIPPED
> [INFO] Spark Project Hive Thrift Server ................... SKIPPED
> [INFO] Spark Project Assembly ............................. SKIPPED
> [INFO] Spark Project External Flume Sink .................. SUCCESS [
> 36.498 s]
> [INFO] Spark Project External Flume ....................... SKIPPED
> [INFO] Spark Project External Flume Assembly .............. SKIPPED
> [INFO] Spark Integration for Kafka 0.8 .................... SKIPPED
> [INFO] Spark Project Examples ............................. SKIPPED
> [INFO] Spark Project External Kafka Assembly .............. SKIPPED
> [INFO] Spark Integration for Kafka 0.10 ................... SKIPPED
> [INFO] Spark Integration for Kafka 0.10 Assembly .......... SKIPPED
> [INFO] Kafka 0.10 Source for Structured Streaming ......... SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:09 min (Wall Clock)
> [INFO] Finished at: 2017-10-25T10:24:20+00:00
> [INFO] Final Memory: 64M/683M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-catalyst_2.11: wrap:
> org.apache.commons.exec.ExecuteException: Process exited with an error:
> 137 (Exit value: 137) -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with
> the command
> [ERROR]   mvn <goals> -rf :spark-catalyst_2.11
>
>
> RPM build errors:
> error: Bad exit status from /var/tmp/rpm-tmp.mjc1Oe (%build)
>   Bad exit status from /var/tmp/rpm-tmp.mjc1Oe (%build)
> :spark-rpm FAILED
>
> FAILURE: Build failed with an exception.
>
> * Where:
> Script '/root/host/runtime/bigtop-rel-1.2.0/packages.gradle' line: 462
>
> * What went wrong:
> Execution failed for task ':spark-rpm'.
>
> Process 'command 'rpmbuild'' finished with non-zero exit value 1
>
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with --info or
> --debug option to get more log output.
>
> BUILD FAILED
>
> Thanks,
>
> Zewen Chi
>
>
Mime
View raw message