flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Ravindran <rahu...@yahoo.com>
Subject File Channel error stops flume
Date Mon, 25 Feb 2013 20:07:47 GMT
Hi,
   I modified a parameter to the HDFS sink on a flume config (added an idleInterval) on
2 machines. Things worked fine on one, and not on the other. I tried restarting flume a couple
of times and I continue seeing the same log statement (bolded below) with no writes to HDFS

25 Feb 2013 08:27:00,174 INFO  [Log-BackgroundWorker-ch2] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:109)
 - Start checkpoint for /flume2/checkpoint/checkpoint, elements to sync = 8506
:%
25 Feb 2013 19:55:51,577 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-17
25 Feb 2013 19:55:51,585 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume1/data/log-17
25 Feb 2013 19:55:51,588 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.tools.DirectMemoryUtils.getDefaultDirectMemorySize:113)
 - Unable to get maxDirectMemory from VM: NoSuchMethodException: sun.misc.VM.maxDirectMemory(null)
25 Feb 2013 19:55:51,592 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.tools.DirectMemoryUtils.allocate:47)
 - Direct Memory Allocation:  Allocation = 1048576, Allocated = 0, MaxDirectMemorySize =
268435456, Remaining = 268435456
25 Feb 2013 19:55:51,634 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622812128
25 Feb 2013 19:55:51,634 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622720601
25 Feb 2013 19:55:51,654 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-18
25 Feb 2013 19:55:51,655 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622821593
25 Feb 2013 19:55:51,655 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-19
25 Feb 2013 19:55:51,656 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622678590
25 Feb 2013 19:55:51,656 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-20
25 Feb 2013 19:55:51,657 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 244707334
25 Feb 2013 19:55:51,657 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-21
25 Feb 2013 19:55:51,657 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 530601497
25 Feb 2013 19:55:51,658 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 530601497 in /flume2/data/log-21
25 Feb 2013 19:55:51,658 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-22
25 Feb 2013 19:55:51,658 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume1/data/log-18
25 Feb 2013 19:55:51,658 WARN  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:470)
 - Checkpoint for file(/flume2/data/log-22) is: 1361844516782, which is beyond the requested
checkpoint time: 1361844516783 and position 0
25 Feb 2013 19:55:51,659 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622674426
25 Feb 2013 19:55:51,659 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume2/data/log-23
25 Feb 2013 19:55:51,659 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume1/data/log-19
25 Feb 2013 19:55:51,659 WARN  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:470)
 - Checkpoint for file(/flume2/data/log-23) is: 1361844516783, which is beyond the requested
checkpoint time: 1361844516783 and position 0
25 Feb 2013 19:55:51,660 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 1622239091
25 Feb 2013 19:55:51,660 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume1/data/log-20
25 Feb 2013 19:55:51,661 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 221490603
25 Feb 2013 19:55:51,661 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.ReplayHandler.replayLog:236)
 - Replaying /flume1/data/log-21
25 Feb 2013 19:55:51,661 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.skipToLastCheckpointPosition:466)
 - fast-forward to checkpoint position: 532696754
25 Feb 2013 19:55:52,048 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195597 in /flume1/data/log-17
25 Feb 2013 19:55:52,103 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195583 in /flume2/data/log-17
25 Feb 2013 19:55:52,308 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195536 in /flume2/data/log-18
25 Feb 2013 19:55:52,319 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195584 in /flume1/data/log-18
25 Feb 2013 19:55:52,418 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195600 in /flume2/data/log-19
25 Feb 2013 19:55:52,439 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 244816205 in /flume2/data/log-20
25 Feb 2013 19:55:52,440 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.ReplayHandler.replayLog:320)
 - read: 12348, put: 0, take: 0, rollback: 0, commit: 0, skip: 12348, eventCount:0
25 Feb 2013 19:55:52,441 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.Log.replay:399)
 - Rolling /flume2/data
25 Feb 2013 19:55:52,441 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.Log.roll:811)
 - Roll start /flume2/data
25 Feb 2013 19:55:52,443 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$Writer.<init>:171)
 - Opened /flume2/data/log-24
25 Feb 2013 19:55:52,449 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.Log.roll:826)
 - Roll end
25 Feb 2013 19:55:52,453 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:109)
 - Start checkpoint for /flume2/checkpoint/checkpoint, elements to sync = 0
25 Feb 2013 19:55:52,455 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.EventQueueBackingStoreFile.checkpoint:117)
 - Updating checkpoint metadata: logWriteOrderID: 1361844516784, queueSize: 34525000, queueHead:
40625267
25 Feb 2013 19:55:52,489 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-24.meta currentPosition = 0, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,491 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.Log.writeCheckpoint:886)
 - Updated checkpoint for file: /flume2/data/log-24 position: 0 logWriteOrderID: 1361844516784
25 Feb 2013 19:55:52,491 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$RandomReader.close:356)
 - Closing RandomReader /flume2/data/log-17
25 Feb 2013 19:55:52,497 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-17.meta currentPosition = 1622720601, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,499 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$RandomReader.close:356)
 - Closing RandomReader /flume2/data/log-18
25 Feb 2013 19:55:52,500 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 1623195593 in /flume1/data/log-19
25 Feb 2013 19:55:52,505 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-18.meta currentPosition = 1622821593, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,507 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$RandomReader.close:356)
 - Closing RandomReader /flume2/data/log-19
25 Feb 2013 19:55:52,513 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-19.meta currentPosition = 1622678590, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,514 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$RandomReader.close:356)
 - Closing RandomReader /flume2/data/log-20
25 Feb 2013 19:55:52,520 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-20.meta currentPosition = 244707334, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,521 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFile$RandomReader.close:356)
 - Closing RandomReader /flume2/data/log-21
25 Feb 2013 19:55:52,527 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.LogFileV3$MetaDataWriter.markCheckpoint:85)
 - Updating log-21.meta currentPosition = 530601497, logWriteOrderID = 1361844516784
25 Feb 2013 19:55:52,529 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.channel.file.FileChannel.start:309)
 - Queue Size after replay: 34525000 [channel=ch2]
25 Feb 2013 19:55:52,594 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.instrumentation.MonitoredCounterGroup.register:89)
 - Monitoried counter group for type: CHANNEL, name: ch2, registered successfully.
25 Feb 2013 19:55:52,594 INFO  [lifecycleSupervisor-1-0] (org.apache.flume.instrumentation.MonitoredCounterGroup.start:73)
 - Component type: CHANNEL, name: ch2 started
25 Feb 2013 19:55:52,619 INFO  [lifecycleSupervisor-1-1] (org.apache.flume.channel.file.LogFile$SequentialReader.next:491)
 - Encountered EOF at 222290119 in /flume1/data/log-20
Mime
View raw message