Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E9464EF23 for ; Wed, 23 Jan 2013 20:09:10 +0000 (UTC) Received: (qmail 288 invoked by uid 500); 23 Jan 2013 20:09:10 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 252 invoked by uid 500); 23 Jan 2013 20:09:10 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 242 invoked by uid 99); 23 Jan 2013 20:09:10 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jan 2013 20:09:10 +0000 Received: from localhost (HELO mail-la0-f46.google.com) (127.0.0.1) (smtp-auth username mpercy, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jan 2013 20:09:10 +0000 Received: by mail-la0-f46.google.com with SMTP id fq12so6807219lab.33 for ; Wed, 23 Jan 2013 12:09:08 -0800 (PST) X-Received: by 10.152.111.72 with SMTP id ig8mr2545791lab.1.1358971747940; Wed, 23 Jan 2013 12:09:07 -0800 (PST) MIME-Version: 1.0 Received: by 10.114.16.195 with HTTP; Wed, 23 Jan 2013 12:08:27 -0800 (PST) In-Reply-To: References: From: Mike Percy Date: Wed, 23 Jan 2013 12:08:27 -0800 Message-ID: Subject: Re: what are the libraries needed for flume log4jappender To: "user@flume.apache.org" Content-Type: multipart/alternative; boundary=f46d04083a054bb7cb04d3fa445f --f46d04083a054bb7cb04d3fa445f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I don't use Eclipse but my understanding is that mvn eclipse:eclipse will create a usable Eclipse project file which you can import. the AvroFlumeEvent class is automatically generated at build time by the maven avro compiler. If you want to avoid maven entirely, you have the option of pulling in all the jar files in the lib directory of the Flume binary archive. Those are all the dependencies Flume needs to run. Hope that helps! On Wed, Jan 23, 2013 at 12:03 PM, yogi nerella wrote= : > Mike, > > I am importing the project into eclipse using maven, but the project has > issues in the legacy-sources module. > > Description Resource Path Location Type > AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java > /flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java Problem > > > Runtime issues are with 1.3.1 > 1. If I include just ng-core, I run into issues of FlumeException not > found. > > Classpath: > C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;= C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apac= he-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar > log4j:WARN Error during default initialization > java.lang.NoClassDefFoundError: org/apache/flume/FlumeException > at java.lang.Class.getDeclaredConstructors0(Native Method) > at java.lang.Class.privateGetDeclaredConstructors(Unknown Source) > at java.lang.Class.getConstructor0(Unknown Source) > at java.lang.Class.newInstance0(Unknown Source) > > > 2. If I include ng-core, and ng-sdk, I run into the following exception= . > Classpath: > C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;= C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apac= he-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar;C:\apache\apache-fl= ume-1.3.1-bin\lib\flume-ng-sdk-1.3.1.jar > log4j:WARN Error during default initialization > java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactory > at > org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory= .java:168) > at > org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFactory= .java:128) > at > org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(Log4= jAppender.java:184) > > > Appreciate your help, > Yogi > > > > On Wed, Jan 23, 2013 at 11:54 AM, Mike Percy wrote: > >> Yogi, Flume has lots of dependencies. You can't just drop in one jar. >> That is what Maven is for. >> >> Regards >> Mike >> >> >> On Wed, Jan 23, 2013 at 11:51 AM, yogi nerella wr= ote: >> >>> HI, >>> >>> I have tried the 1.3.0 and ran into issues, so I am building from the >>> latest source and still has the same issue. >>> >>> Yogi >>> >>> >>> On Wed, Jan 23, 2013 at 11:36 AM, Mike Percy wrote: >>> >>>> What version of Flume are you using? Are you using Maven for your buil= d? >>>> >>>> You should be able to get away with just flume-ng-core. >>>> >>>> >>>> On Wed, Jan 23, 2013 at 10:02 AM, yogender nerella wrote: >>>> >>>>> Hi, >>>>> >>>>> I would like to make my app directly write events to an flume agent. >>>>> >>>>> What are the libraries needed to add into my application? >>>>> >>>>> I have tried to add the following three but runs into class not found >>>>> errors. >>>>> >>>>> >>>>> log4j.properties are as follows: >>>>> >>>>> >>>>> log4j.rootLogger=3DTRACE, flume >>>>> log4j.appender.flume =3D >>>>> org.apache.flume.clients.log4jappender.Log4jAppender >>>>> log4j.appender.flume.Hostname =3D example.com >>>>> log4j.appender.flume.Port =3D 44444 >>>>> log4j.appender.flume.layout=3Dorg.apache.log4j.TTCCLayout >>>>> >>>>> >>>>> Error In Initialization >>>>> >>>>> Classpath: >>>>> C:\\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\test\fl= ume\flume-ng-core-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-log4jappender-1= .4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-sdk-1.4.0-SNAPSHOT.jar >>>>> log4j:WARN Error during default initialization >>>>> java.lang.NoClassDefFoundError: org/jboss/netty/channel/ChannelFactor= y >>>>> at >>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFac= tory.java:168) >>>>> at >>>>> org.apache.flume.api.RpcClientFactory.getDefaultInstance(RpcClientFac= tory.java:128) >>>>> at >>>>> org.apache.flume.clients.log4jappender.Log4jAppender.activateOptions(= Log4jAppender.java:195) >>>>> at >>>>> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:3= 07) >>>>> at >>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.j= ava:172) >>>>> at >>>>> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.j= ava:104) >>>>> at >>>>> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigura= tor.java:809) >>>>> at >>>>> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigura= tor.java:735) >>>>> at >>>>> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyC= onfigurator.java:615) >>>>> at >>>>> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurato= r.java:502) >>>>> at >>>>> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurato= r.java:547) >>>>> at >>>>> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionCon= verter.java:483) >>>>> at org.apache.log4j.LogManager.(LogManager.java:127) >>>>> at org.apache.log4j.Logger.getLogger(Logger.java:117) >>>>> at LogTest.(LogTest.java:7) >>>>> at LogTest.main(LogTest.java:11) >>>>> Caused by: java.lang.ClassNotFoundException: >>>>> org.jboss.netty.channel.ChannelFactory >>>>> at java.net.URLClassLoader$1.run(Unknown Source) >>>>> at java.net.URLClassLoader$1.run(Unknown Source) >>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>> at java.net.URLClassLoader.findClass(Unknown Source) >>>>> at java.lang.ClassLoader.loadClass(Unknown Source) >>>>> at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) >>>>> at java.lang.ClassLoader.loadClass(Unknown Source) >>>>> ... 16 more >>>>> log4j:WARN No appenders could be found for logger (LogTest). >>>>> log4j:WARN Please initialize the log4j system properly. >>>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigf= or more info. >>>>> >>>>> >>>>> Appreciate your help, >>>>> Yogi >>>>> >>>> >>>> >>> >> > --f46d04083a054bb7cb04d3fa445f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I don't use Eclipse but my understanding is that mvn e= clipse:eclipse will create a usable Eclipse project file which you can impo= rt. the AvroFlumeEvent class is automatically generated at build time by th= e maven avro compiler.

If you want to avoid maven entirely, you have the option of = pulling in all the jar files in the lib directory of the Flume binary archi= ve. Those are all the dependencies Flume needs to run.

Hope that helps!

=

On Wed, Jan 23, 2013 at 12:03 PM, yogi n= erella <ynerella999@gmail.com> wrote:
Mike,

I = am importing the project into eclipse using maven, but the project has issu= es in the legacy-sources module.

Description Resource Path Location <= /span>Type
AvroFlumeEvent cannot be resolved to a type NettyAvroRpcClient.java /flume-ng-sdk/src/main/java/org/apache/flume/api line 189 Java Problem


Runtime issues are with 1.3.1
= 1. =C2=A0 If I include just ng-core, I run into issues of FlumeException no= t found.

Classpath: C:\ServiceManager\workspa= ce\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.= 1-bin\lib\flume-ng-core-1.3.1.jar;C:\apache\apache-flume-1.3.1-bin\lib\flum= e-ng-log4jappender-1.3.1.jar
log4j:WARN Error during default initialization
java.la= ng.NoClassDefFoundError: org/apache/flume/FlumeException
at java.lang.Class.getDeclaredConstruc= tors0(Native Method)
at java.lang.Class.privat= eGetDeclaredConstructors(Unknown Source)
at java.lang.Class.getConstructor0(Unknown Source)
at java.lang.Class.newIns= tance0(Unknown Source)


2. =C2=A0 If= I include ng-core, and ng-sdk, I run into the following exception.
Classpath: C:\ServiceManager\workspace\mongodb\Mongodb\bin;C:\tes= t\log4j-1.2.16.jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-core-1.3.1= .jar;C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-log4jappender-1.3.1.jar;= C:\apache\apache-flume-1.3.1-bin\lib\flume-ng-sdk-1.3.1.jar
log4j:WARN Error during default initialization
java.lang.NoC= lassDefFoundError: org/jboss/netty/channel/ChannelFactory
at org.apache.flume.api.RpcClientFact= ory.getDefaultInstance(RpcClientFactory.java:168)
at org.apache.flume.api.R= pcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
at org.apache.flume.clients= .log4jappender.Log4jAppender.activateOptions(Log4jAppender.java:184)


Appreciate your help,
<= div>Yogi



On We= d, Jan 23, 2013 at 11:54 AM, Mike Percy <mpercy@apache.org> = wrote:
Yogi,=C2=A0Flume has lots o= f dependencies. You can't just drop in one jar. That is what Maven is f= or.

Regards
Mike


On Wed, Jan 23, 2013 at 11:51 AM, yogi nerella <ynerella999@gmail.com<= /a>> wrote:
HI,

I have tried the 1.3.0 and ran into= issues, so I am building from the latest source and still has the same iss= ue.

Yogi


On Wed, Jan 23, 2013 at 11:36 AM, Mike P= ercy <mpercy@apache.org> wrote:
What version of Flume are you using? Are you using Maven f= or your build?

You should be able to get away with just = flume-ng-core.


On Wed, Jan 23, 2013 at 10:02 AM, yogend= er nerella <ynerella@gmail.com> wrote:
Hi,

I would like to make my app directly write events to= an flume agent.

What are the libraries needed to = add into my application?

I have tried to add the f= ollowing three but runs into class not found errors.


log4j.properties are as follows:


log4j.rootLogger=3DTRACE, flume
=
log4j.appender.flume =3D org.apache.flume.clients.log4jappender.Log4jA= ppender
log4j.appender.flume.Hostname =3D example.com
log4j.appender.flume.Port =3D 44444<= /div>
log4j.appender.flume.layout=3Dorg.apache.log4j.TTCCLayout


Error In Initialization

Classp= ath: C:\\workspace\mongodb\Mongodb\bin;C:\test\log4j-1.2.16.jar;C:\test\flu= me\flume-ng-core-1.4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-log4jappender-1.= 4.0-SNAPSHOT.jar;C:\test\flume\flume-ng-sdk-1.4.0-SNAPSHOT.jar
log4j:WARN Error during default initialization
java.lang.NoC= lassDefFoundError: org/jboss/netty/channel/ChannelFactory
at org.apache.flume.api.RpcClientFact= ory.getDefaultInstance(RpcClientFactory.java:168)
at org.apache.flume.api.R= pcClientFactory.getDefaultInstance(RpcClientFactory.java:128)
at org.apache.flume.clients.log4j= appender.Log4jAppender.activateOptions(Log4jAppender.java:195)
at org.apache.log4j.confi= g.PropertySetter.activate(PropertySetter.java:307)
at org.apache.log4j.config.PropertySetter.se= tProperties(PropertySetter.java:172)
at org.apache.log4j.confi= g.PropertySetter.setProperties(PropertySetter.java:104)
at org.apache.log4j.PropertyConfigurato= r.parseAppender(PropertyConfigurator.java:809)
at org.apache.log4j.Prope= rtyConfigurator.parseCategory(PropertyConfigurator.java:735)
at org.apache.log4j.PropertyConfig= urator.configureRootCategory(PropertyConfigurator.java:615)
at org.apache.log4j.Prope= rtyConfigurator.doConfigure(PropertyConfigurator.java:502)
at org.apache.log4j.PropertyConfigur= ator.doConfigure(PropertyConfigurator.java:547)
at org.apache.log4j.helpe= rs.OptionConverter.selectAndConfigure(OptionConverter.java:483)
<= span style=3D"white-space:pre-wrap"> at org.apache.log4j.LogManager.= <clinit>(LogManager.java:127)
at org.apache.log4j.Logge= r.getLogger(Logger.java:117)
at LogTest.<init>(LogTest.java:7)
at LogTest.main(LogTest.j= ava:11)
Caused by: java.lang.ClassNotFoundException: org.jboss.ne= tty.channel.ChannelFactory
= at java.net.URLClassLoader$1.run(Unknown Source)
at java.net.URLClassLoade= r$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoade= r.findClass(Unknown Source)
= at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppC= lassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
... 16 more
log= 4j:WARN No appenders could be found for logger (LogTest).
log4j:W= ARN Please initialize the log4j system properly.
=C2=A0 =C2=A0 =C2=A0

Appreciate your help,
Yogi





--f46d04083a054bb7cb04d3fa445f--