flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hari Shreedharan <hshreedha...@cloudera.com>
Subject Re: Flume Compile 1.5.0 for HBase 0.98.3
Date Sat, 26 Jul 2014 21:41:40 GMT
Run mvn clean install -Dhadoop.profile=hbase-98
-Dhbase.version=<specific version of hbase 98>.



On Saturday, July 26, 2014, ac@hsk.hk <ac@hsk.hk> wrote:

> Hi,
>
> I have tried several times about compiling Flume 1.5.0 for HBase 0.98.3,
> with some progress but still failed.
>
> Can someone advise what the proper settings in pom.xml is? or which
> repository contains HBase 0.98.3 jar files? or any ideas to fix this?
>
> Many thanks!!
> Arthur
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building Flume NG HBase Sink 1.5.0
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The POM for org.apache.hbase:hbase:jar:0.98.3 is missing, no
> dependency information available
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.873s]
> [INFO] Flume NG SDK ...................................... SUCCESS [1.681s]
> [INFO] Flume NG Configuration ............................ SUCCESS [0.249s]
> [INFO] Flume NG Core ..................................... SUCCESS [1.771s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.048s]
> [INFO] Flume NG HDFS Sink ................................ SUCCESS [0.914s]
> [INFO] Flume NG IRC Sink ................................. SUCCESS [0.144s]
> [INFO] Flume NG Channels ................................. SUCCESS [0.067s]
> [INFO] Flume NG JDBC channel ............................. SUCCESS [0.210s]
> [INFO] Flume NG file-based channel ....................... SUCCESS [0.246s]
> [INFO] Flume NG Spillable Memory channel ................. SUCCESS [0.127s]
> [INFO] Flume NG Node ..................................... SUCCESS [0.159s]
> [INFO] Flume NG Embedded Agent ........................... SUCCESS [0.414s]
> [INFO] Flume NG HBase Sink ............................... FAILURE [0.064s]
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume NG Kite Dataset Sink ........................ SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 7.385s
> [INFO] Finished at: Sat Jul 26 22:52:42 HKT 2014
> [INFO] Final Memory: 41M/622M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project flume-ng-hbase-sink: Could not
> resolve dependencies for project
> org.apache.flume.flume-ng-sinks:flume-ng-hbase-sink:jar:1.5.0: Failure to
> find org.apache.hbase:hbase:jar:0.98.3 in
> http://people.apache.org/~garyh/mvn/ was cached in the local repository,
> resolution will not be reattempted until the update interval of nexus has
> elapsed or updates are forced -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :flume-ng-hbase-sink
>
>
>
> On 26 Jul, 2014, at 7:28 pm, ac@hsk.hk
> <javascript:_e(%7B%7D,'cvml','ac@hsk.hk');> wrote:
>
> Hi,
>
> I am trying to compile and run unit test (flume 1.5.0) for Hadoop 2.4.0
> and HBase 0.98.3.
>
> I got "cannot find symbol: class MiniDFSCluster”, is it something wrong in
> pom.xml?  please help!!
>
> Regards
> Arthur
>
>
>
>
>
>
> command: mvn clean test
>
> === log ===
> [ERROR] COMPILATION ERROR :
> [INFO] -------------------------------------------------------------
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: package org.apache.hadoop.hdfs
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
> cannot find symbol
> symbol  : class MiniDFSCluster
> location: class org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [INFO] 7 errors
> [INFO] -------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Flume ...................................... SUCCESS [0.649s]
> [INFO] Flume NG SDK ...................................... SUCCESS
> [1:12.668s]
> [INFO] Flume NG Configuration ............................ SUCCESS [1.092s]
> [INFO] Flume NG Core ..................................... SUCCESS
> [6:52.046s]
> [INFO] Flume NG Sinks .................................... SUCCESS [0.095s]
> [INFO] Flume NG HDFS Sink ................................ FAILURE [1.990s]
> [INFO] Flume NG IRC Sink ................................. SKIPPED
> [INFO] Flume NG Channels ................................. SKIPPED
> [INFO] Flume NG JDBC channel ............................. SKIPPED
> [INFO] Flume NG file-based channel ....................... SKIPPED
> [INFO] Flume NG Spillable Memory channel ................. SKIPPED
> [INFO] Flume NG Node ..................................... SKIPPED
> [INFO] Flume NG Embedded Agent ........................... SKIPPED
> [INFO] Flume NG HBase Sink ............................... SKIPPED
> [INFO] Flume NG ElasticSearch Sink ....................... SKIPPED
> [INFO] Flume NG Morphline Solr Sink ...................... SKIPPED
> [INFO] Flume Sources ..................................... SKIPPED
> [INFO] Flume Scribe Source ............................... SKIPPED
> [INFO] Flume JMS Source .................................. SKIPPED
> [INFO] Flume Twitter Source .............................. SKIPPED
> [INFO] Flume legacy Sources .............................. SKIPPED
> [INFO] Flume legacy Avro source .......................... SKIPPED
> [INFO] Flume legacy Thrift Source ........................ SKIPPED
> [INFO] Flume NG Clients .................................. SKIPPED
> [INFO] Flume NG Log4j Appender ........................... SKIPPED
> [INFO] Flume NG Tools .................................... SKIPPED
> [INFO] Flume NG distribution ............................. SKIPPED
> [INFO] Flume NG Integration Tests ........................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 8:09.120s
> [INFO] Finished at: Sat Jul 26 19:18:55 HKT 2014
> [INFO] Final Memory: 71M/455M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:2.3.2:testCompile
> (default-testCompile) on project flume-hdfs-sink: Compilation failure:
> Compilation failure:
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[37,29]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: package org.apache.hadoop.hdfs
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[60,17]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[75,39]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[85,18]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[164,18]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[264,18]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR]
> /home/hduser/apache-flume-1.5.0-src/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java:[377,18]
> cannot find symbol
> [ERROR] symbol  : class MiniDFSCluster
> [ERROR] location: class
> org.apache.flume.sink.hdfs.TestHDFSEventSinkOnMiniCluster
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :flume-hdfs-sink
>
>
>
>

Mime
View raw message