flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug McClure <dmccl...@gmail.com>
Subject Re: Flume 1.6 and Java 1.8 with spooldir source bug?
Date Fri, 18 Sep 2015 02:14:07 GMT
Do you recommend I test with other versions?  I'm using Cloudera's RPM
based version so I'll need to see where that's being set.

Doug

On Thu, Sep 17, 2015 at 5:05 PM, Gonzalo Herreros <gherreros@gmail.com>
wrote:

> Does it happen with Oracle JDK 8 or is only with OpenJDK?
>
> Regards,
> Gonzalo
> On Sep 17, 2015 8:06 PM, "Doug McClure" <dmcclure@gmail.com> wrote:
>
>> When trying to use Flume 1.6 and the spooldir source I'm getting this
>> error.  Other sources work fine.  Are there known issues with Java 1.8.0_51?
>>
>> Tks - Doug
>>
>>
>> *agent source*
>>
>> agent.sources.spooldir-source-1.type = spooldir
>> agent.sources.spooldir-source-1.spoolDir = /opt/flumelogs/
>> agent.sources.spooldir-source-1.fileHeader = true
>> agent.sources.spooldir-source-1.basenameHeader = true
>>
>>
>> *error*
>>
>> 17 Sep 2015 12:13:35,417 INFO  [conf-file-poller-0]
>> (org.apache.flume.node.Application.startAllComponents:184)  - Starting
>> Source spooldir-source-1
>> 17 Sep 2015 12:13:35,418 INFO  [lifecycleSupervisor-1-7]
>> (org.apache.flume.source.SpoolDirectorySource.start:78)  -
>> SpoolDirectorySource source starting with directory: /opt/scala/flumelogs/
>> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
>> (org.apache.flume.instrumentation.MonitoredCounterGroup.register:120)  -
>> Monitored counter group for type: SOURCE, name: spooldir-source-1:
>> Successfully registered new MBean.
>> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
>> (org.apache.flume.instrumentation.MonitoredCounterGroup.start:96)  -
>> Component type: SOURCE, name: spooldir-source-1 started
>> 17 Sep 2015 12:13:35,764 ERROR [pool-3-thread-1]
>> (org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run:256)
>>  - FATAL: Spool Directory source spooldir-source-1: { spoolDir:
>> /opt/flumelogs/ }: Uncaught exception in SpoolDirectorySource thread.
>> Restart or reconfigure Flume to continue processing.
>> java.lang.UnsupportedClassVersionError: org/apache/avro/io/DatumWriter :
>> Unsupported major.minor version 51.0
>>         at java.lang.ClassLoader.defineClass1(Native Method)
>>         at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
>>         at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
>>         at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
>>         at
>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.openFile(ReliableSpoolingFileEventReader.java:501)
>>         at
>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getNextFile(ReliableSpoolingFileEventReader.java:482)
>>         at
>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:243)
>>         at
>> org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:228)
>>         at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>         at
>> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
>>         at
>> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
>>         at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
>>         at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
>>         at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>         at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>         at java.lang.Thread.run(Thread.java:701)
>> 17 Sep 2015 12:13:35,824 INFO  [lifecycleSupervisor-1-6]
>> (org.apache.flume.source.SyslogTcpSource.start:119)  - Syslog TCP Source
>> starting...
>>
>>
>> *java-version*
>>
>> openjdk version "1.8.0_51"
>> OpenJDK Runtime Environment (build 1.8.0_51-b16)
>> OpenJDK 64-Bit Server VM (build 25.51-b03, mixed mode)
>>
>>
>>
>>

Mime
View raw message