flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ac@hsk.hk" ...@hsk.hk>
Subject Flume Compile 1.5.0 for HBase 0.98.3
Date Sat, 26 Jul 2014 15:09:10 GMT
Hi,

I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3, with some progress
but still failed.

Can someone advise what the proper settings in pom.xml is? or which repository contains HBase
0.98.3 jar files? or any ideas to fix this?

Many thanks!!
Arthur



[INFO] ------------------------------------------------------------------------
[INFO] Building Flume NG HBase Sink 1.5.0
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no dependency information
available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Flume ...................................... SUCCESS [0.873s]
[INFO] Flume NG SDK ...................................... SUCCESS [1.681s]
[INFO] Flume NG Configuration ............................ SUCCESS [0.249s]
[INFO] Flume NG Core ..................................... SUCCESS [1.771s]
[INFO] Flume NG Sinks .................................... SUCCESS [0.048s]
[INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s]
[INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s]
[INFO] Flume NG Channels ................................. SUCCESS [0.067s]
[INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s]
[INFO] Flume NG file-based channel ....................... SUCCESS [0.246s]
[INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s]
[INFO] Flume NG Node ..................................... SUCCESS [0.159s]
[INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s]
[INFO] Flume NG HBase Sink ............................... FAILURE [0.064s]
[INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
[INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
[INFO] Flume Sources ..................................... SKIPPED
[INFO] Flume Scribe Source ............................... SKIPPED
[INFO] Flume JMS Source .................................. SKIPPED
[INFO] Flume Twitter Source .............................. SKIPPED
[INFO] Flume legacy Sources .............................. SKIPPED
[INFO] Flume legacy Avro source .......................... SKIPPED
[INFO] Flume legacy Thrift Source ........................ SKIPPED
[INFO] Flume NG Clients .................................. SKIPPED
[INFO] Flume NG Log4j Appender ........................... SKIPPED
[INFO] Flume NG Tools .................................... SKIPPED
[INFO] Flume NG distribution ............................. SKIPPED
[INFO] Flume NG Integration Tests ........................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 7.385s
[INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014
[INFO] Final Memory: 41M/622M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not resolve dependencies
for project org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to find
org.apache.hbase:hbase:jar:0.98.3 in http://people.apache.org/~garyh/mvn/ was cached in the
local repository, resolution will not be reattempted until the update interval of nexus has
elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :flume-ng-hbase-sink



On 26 Jul, 2014, at 7:28 pm, ac@hsk.hk wrote:

> Hi,
> 
> I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0 and HBase 0.98.3.
> 
> I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in pom.xml?
 please help!!
> 
> Regards
> Arthur
> 
> 
> 
> 
> 
> 
> command: mvn clean test
> 
> === log ===
> [ERROR] COMPILATION ERROR : 
> [INFO] -------------------------------------------------------------
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: package org.apache.hadoop.hdfs
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [INFO] 7 errors 
> [INFO] -------------------------------------------------------------
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] 
> [INFO] Apache Flume ...................................... SUCCESS [0.649s]
> [INFO] Flume NG SDK ...................................... SUCCESS [1:12.668s]
> [INFO] Flume NG Configuration ............................ SUCCESS [1.092s]
> [INFO] Flume NG Core ..................................... SUCCESS [6:52.046s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.095s]
> [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s]
> [INFO] Flume NG IRC Sink ................................. SKIPPED
> [INFO] Flume NG Channels ................................. SKIPPED
> [INFO] Flume NG JDBC channel ............................. SKIPPED
> [INFO] Flume NG file-based channel ....................... SKIPPED
> [INFO] Flume NG Spillable Memory channel ................. SKIPPED
> [INFO] Flume NG Node ..................................... SKIPPED
> [INFO] Flume NG Embedded Agent ........................... SKIPPED
> [INFO] Flume NG HBase Sink ............................... SKIPPED
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 8:09.120s
> [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014
> [INFO] Final Memory: 71M/455M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile
(default-testCompile) on project flume-hdfs-sink: Compilation failure: Compilation failure:
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: package org.apache.hadoop.hdfs
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] -> [Help 1]
> [ERROR] 
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR] 
> [ERROR] For more information about the errors and possible solutions, please read the
following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR] 
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR]   mvn <goals> -rf :flume-hdfs-sink
> 
> 


Mime
View raw message