flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Luce Sylvain <sylvain.luce....@gmail.com>
Subject Error with Lucene
Date Fri, 07 Feb 2014 07:24:30 GMT
Hi all,

I'm using for few days apache flume with elasticsearch.

My source is a JMS queue
My sink is elasticsearch


In the flume's libdir, I copy activemq-all.jar and the
elasticsearch.0.90.10.jar

My conf file :

a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source

a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory =
org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.providerURL = tcp://my_source:61616
a1.sources.r1.destinationName = foo
a1.sources.r1.destinationType = QUEUE

# Describe the sink
a1.sinks.k1.type = elasticsearch
a1.sinks.k1.hostNames = localhost:9300
a1.sinks.k1.batchSize = 500
a1.sinks.k1.ttl = 5
a1.sinks.k1.indexName = foo


# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1


Apache Flume send me an error at startup  :


2014-02-07 08:18:08,620 (lifecycleSupervisor-1-1) [ERROR -
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)]
Unable to start SinkRunner: {
policy:org.apache.flume.sink.DefaultSinkProcessor@1058c283 counterGroup:{
name:null counters:{} } } - Exception follows.
java.lang.NoSuchFieldError: org/apache/lucene/util/Version.LUCENE_44
at org.elasticsearch.Version.<clinit>(Version.java:130)
at java.lang.J9VMInternals.initializeImpl(Native Method)
at java.lang.J9VMInternals.initialize(J9VMInternals.java:237)
at
org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:164)
at
org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:120)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.openClient(ElasticSearchSink.java:371)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.openConnection(ElasticSearchSink.java:351)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.start(ElasticSearchSink.java:326)
at
org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
at
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:482)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:315)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:189)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1156)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:626)
at java.lang.Thread.run(Thread.java:804)


Thanks for your help

Sylvain

Mime
View raw message