flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brock Noland <br...@cloudera.com>
Subject Re: FileChannel error on Flume 1.3.1
Date Sat, 02 Feb 2013 22:32:50 GMT
Hi,

That isn't a good error message. Could you share your entire log file? Post
it on a JIRA or pastebin.

Did you delete the checkpoint before starting the channel after changing
capacity? Capacity is fixed for the file channel as such the checkpoint
must be deleted to change the capacity.

Brock

On Saturday, February 2, 2013, Rahul Ravindran wrote:

> Hi,
>   I increased the capacity and the max file size parameters of the
> filechannel in our config and began seeing the below exception. I continue
> seeing the below on restarting the channel. I fixed this by removing the
> files in the checkpoint and data folders.
>
> 02 Feb 2013 21:45:51,113 WARN
>  [SinkRunner-PollingRunner-LoadBalancingSinkProcessor]
> (org.apache.flume.sink.LoadBalancingSinkProcessor.process:158)  - Sink
> failed to consume event. Attempting next sink if available.
> java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to
> java.io.EOFException: null
> at
> org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
> at
> org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
> at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
> at
> org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.EOFException
> at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
> at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
> at
> org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
> at
> org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
> at org.apache.flume.channel.file.Log.replay(Log.java:365)
> at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
> at
> org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
> at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>


-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Mime
View raw message