hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Prakash <ravi...@ymail.com>
Subject Re: Unable to pass complete tests on 2.7.1
Date Tue, 18 Aug 2015 00:57:27 GMT
Hi Tucker!
Sadly, unit tests failing is usual for hadoop builds. You can use -DskipTests to build without
running unit tests, or -fn (fail-never) to continue despite failures.
The maven-plugin helps us manage generated source code (e.g. protobuf files generate more
java files which need to be compiled).
HTH
Ravi
 


     On Monday, August 17, 2015 5:26 PM, Tucker Berckmann <tucker.berckmann@scaleflux.com>
wrote:
   

 Hello,

I am trying to build the Apache Hadoop 2.7.1 release from source on a 
clean Ubuntu 14.04 system, but the unit tests are failing (see command 
line 11 below).

Any help would be appreciated.

Also, I do not understand why I had to install the plugins (see command 
line 8) in order to get a successful compilation. Note that the 
compilation fails in (6) but passes in (10).

Thanks and regards,

Tucker

----Command Line----

(1) hadoop@hadoop-testnode:~$ lsb_release -a

No LSB modules are available.
Distributor ID:    Ubuntu
Description:    Ubuntu 14.04.2 LTS
Release:    14.04
Codename:    trusty

(2) hadoop@hadoop-testnode:~$ bash install_part1.sh

( lots of output)

(3) hadoop@hadoop-testnode:~$ java -version

java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)

(4) hadoop@hadoop-testnode:~$ bash install_part2.sh

( lots of output )

(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/

(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile

( lots of output )

[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS 
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS 
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS 
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]

( some more output )

[ERROR] Failed to parse plugin descriptor for 
org.apache.hadoop:hadoop-maven-plugins:2.7.1 
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No 
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]

(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/

(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn 
install

( lots of output )

(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..

(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile

( lots of output, completes successfully )

(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test

( lots of output )

Tests in error:
  TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156

» FileNotFound
  TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in 
CLASSPATH
  TestSSLHttpServer.cleanup:96 NullPointer
  TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in 
CLASSPATH
  TestHttpCookieFlag.cleanup:147 NullPointer
  TestJMXJsonServlet.cleanup:46 NullPointer

Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186

[INFO] 
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS 
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE 
[15:33.867s]



----install_part1.sh----

rm -f hadoop-2.7.1-src.tar.gz
wget 
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer

----install_part2.sh----

sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake 
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev



  
Mime
View raw message