flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gonzalo Herreros <gherre...@gmail.com>
Subject Re: Flume 1.6 and Java 1.8 with spooldir source bug?
Date Fri, 18 Sep 2015 07:31:20 GMT
Cloudera only supports Oracle JDK and AFAIK they still include version 7 by
default.
However, be careful because if you don't force a JAVA_HOME, it has an
algorithm based on Bigtop to decide which version to use which gives
preference to newer versions.

Gonzalo

On 18 September 2015 at 03:14, Doug McClure <dmcclure@gmail.com> wrote:

> Do you recommend I test with other versions?  I'm using Cloudera's RPM
> based version so I'll need to see where that's being set.
>
> Doug
>
> On Thu, Sep 17, 2015 at 5:05 PM, Gonzalo Herreros <gherreros@gmail.com>
> wrote:
>
>> Does it happen with Oracle JDK 8 or is only with OpenJDK?
>>
>> Regards,
>> Gonzalo
>> On Sep 17, 2015 8:06 PM, "Doug McClure" <dmcclure@gmail.com> wrote:
>>
>>> When trying to use Flume 1.6 and the spooldir source I'm getting this
>>> error.  Other sources work fine.  Are there known issues with Java 1.8.0_51?
>>>
>>> Tks - Doug
>>>
>>>
>>> *agent source*
>>>
>>> agent.sources.spooldir-source-1.type = spooldir
>>> agent.sources.spooldir-source-1.spoolDir = /opt/flumelogs/
>>> agent.sources.spooldir-source-1.fileHeader = true
>>> agent.sources.spooldir-source-1.basenameHeader = true
>>>
>>>
>>> *error*
>>>
>>> 17 Sep 2015 12:13:35,417 INFO  [conf-file-poller-0]
>>> (org.apache.flume.node.Application.startAllComponents:184)  - Starting
>>> Source spooldir-source-1
>>> 17 Sep 2015 12:13:35,418 INFO  [lifecycleSupervisor-1-7]
>>> (org.apache.flume.source.SpoolDirectorySource.start:78)  -
>>> SpoolDirectorySource source starting with directory: /opt/scala/flumelogs/
>>> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
>>> (org.apache.flume.instrumentation.MonitoredCounterGroup.register:120)  -
>>> Monitored counter group for type: SOURCE, name: spooldir-source-1:
>>> Successfully registered new MBean.
>>> 17 Sep 2015 12:13:35,710 INFO  [lifecycleSupervisor-1-7]
>>> (org.apache.flume.instrumentation.MonitoredCounterGroup.start:96)  -
>>> Component type: SOURCE, name: spooldir-source-1 started
>>> 17 Sep 2015 12:13:35,764 ERROR [pool-3-thread-1]
>>> (org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run:256)
>>>  - FATAL: Spool Directory source spooldir-source-1: { spoolDir:
>>> /opt/flumelogs/ }: Uncaught exception in SpoolDirectorySource thread.
>>> Restart or reconfigure Flume to continue processing.
>>> java.lang.UnsupportedClassVersionError: org/apache/avro/io/DatumWriter :
>>> Unsupported major.minor version 51.0
>>>         at java.lang.ClassLoader.defineClass1(Native Method)
>>>         at java.lang.ClassLoader.defineClass(ClassLoader.java:643)
>>>         at
>>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>>>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:277)
>>>         at java.net.URLClassLoader.access$000(URLClassLoader.java:73)
>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:212)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
>>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
>>>         at
>>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.openFile(ReliableSpoolingFileEventReader.java:501)
>>>         at
>>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.getNextFile(ReliableSpoolingFileEventReader.java:482)
>>>         at
>>> org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:243)
>>>         at
>>> org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:228)
>>>         at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>         at
>>> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
>>>         at
>>> java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
>>>         at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
>>>         at
>>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
>>>         at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>         at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>         at java.lang.Thread.run(Thread.java:701)
>>> 17 Sep 2015 12:13:35,824 INFO  [lifecycleSupervisor-1-6]
>>> (org.apache.flume.source.SyslogTcpSource.start:119)  - Syslog TCP Source
>>> starting...
>>>
>>>
>>> *java-version*
>>>
>>> openjdk version "1.8.0_51"
>>> OpenJDK Runtime Environment (build 1.8.0_51-b16)
>>> OpenJDK 64-Bit Server VM (build 25.51-b03, mixed mode)
>>>
>>>
>>>
>>>
>

Mime
View raw message