Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8507310240 for ; Sat, 1 Jun 2013 15:50:21 +0000 (UTC) Received: (qmail 50602 invoked by uid 500); 1 Jun 2013 15:50:21 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 50213 invoked by uid 500); 1 Jun 2013 15:50:20 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 50174 invoked by uid 99); 1 Jun 2013 15:50:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Jun 2013 15:50:19 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of emaillenin@gmail.com designates 209.85.223.179 as permitted sender) Received: from [209.85.223.179] (HELO mail-ie0-f179.google.com) (209.85.223.179) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Jun 2013 15:50:13 +0000 Received: by mail-ie0-f179.google.com with SMTP id c10so859440ieb.38 for ; Sat, 01 Jun 2013 08:49:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=Y2A6uWheYFRvJmisoIBaHxzQjug1tqoSGZRy5n5dToU=; b=rwqIU01iH1f+Buaj/r6Nm1cr8b40KX2X4KQoDeN6aO2lSF4g2i+QPqXvp97ysyjbBz aFPurfhvqiyVdl9FJKBZfVnxHdg6a66jooCeT8iW96HeOiWsCp9e7pRtQcN+AKNjS7Dk guIP1t64lnaq8r5OGGebakqAXh7mg5WNDryk6QnD/CIijJeXziXSSXotJL7tpyg0DTw4 Qrr8v1OJxGodp6oJAgL7ZeECrQMcMa2jHelNzlFd1FEW8Q4MM1uHXaFTflcBFM9QVCqX j6jSHD+41w71PrH8+1H6L6vg6CLvyZ5JeoR+qWOG48efZ041I0qjKZCoxusX1QdYvCFM VN3w== X-Received: by 10.50.78.37 with SMTP id y5mr4045924igw.60.1370101792243; Sat, 01 Jun 2013 08:49:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.64.28.146 with HTTP; Sat, 1 Jun 2013 08:49:32 -0700 (PDT) In-Reply-To: References: From: Lenin Raj Date: Sat, 1 Jun 2013 21:19:32 +0530 Message-ID: Subject: Re: Flume service stopped automatically To: user@flume.apache.org Content-Type: multipart/alternative; boundary=089e011838eaa2084604de19aefc X-Virus-Checked: Checked by ClamAV on apache.org --089e011838eaa2084604de19aefc Content-Type: text/plain; charset=ISO-8859-1 Hi Brock, Which log file should I check under /var/log? Following are the list of files under /var/log modified from yesterdat: -rw-r----- 1 syslog adm 1227 2013-05-31 06:25 syslog.2.gz -rw-r----- 1 mysql adm 20 2013-05-31 06:25 mysql.log.1.gz -rw-rw-r-- 1 root utmp 40704 2013-05-31 23:15 wtmp.1 -rw-r----- 1 syslog adm 14296 2013-06-01 06:25 syslog.1 -rw-r--r-- 1 root root 0 2013-06-01 06:25 dpkg.log drwxr-xr-x 2 root root 4096 2013-06-01 06:25 apt -rw-r--r-- 1 root root 0 2013-06-01 06:25 alternatives.log -rw-r----- 1 mysql adm 0 2013-06-01 06:25 mysql.log drwxr-s--- 2 Debian-exim adm 4096 2013-06-01 06:25 exim4 -rw-rw---- 1 root utmp 0 2013-06-01 06:25 btmp -rw-r----- 1 syslog adm 119666 2013-06-01 18:03 kern.log -rw-r----- 1 syslog adm 8845 2013-06-01 21:09 syslog -rw-r----- 1 syslog adm 4713281 2013-06-01 21:14 auth.log -rw-rw-r-- 1 root utmp 3456 2013-06-01 21:14 wtmp -rw-r--r-- 1 root root 293752 2013-06-01 21:14 lastlog Thanks, Lenin On Sat, Jun 1, 2013 at 9:12 PM, Brock Noland wrote: > Weird... It could have been the linux oom killer? You'd see something in > /var/log/message if that was the case. > > > On Sat, Jun 1, 2013 at 2:47 AM, Lenin Raj wrote: > >> Hello, >> >> I have a flume service which pulls twitter data and sinks to HDFS. I >> started it last night at 8 PM. It was going well. When I checked the status >> today morning, it seems flume service stopped at around 11:15 PM. >> >> I could not find any valid reason in the log file. Flume is doing "Flume >> node stopping - TwitterAgent" automatically without throwing any error. >> >> >> 31 May 2013 23:13:32,226 INFO [hdfs-HDFS-call-runner-7] >> (org.apache.flume.sink.hdfs.BucketWriter.doOpen:208) - Creating >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23//FlumeData.1370021414624.tmp >> 31 May 2013 23:14:02,247 INFO [hdfs-HDFS-roll-timer-0] >> (org.apache.flume.sink.hdfs.BucketWriter.renameBucket:427) - Renaming >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414624.tmp >> to >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414624 >> 31 May 2013 23:14:26,260 INFO [hdfs-HDFS-call-runner-1] >> (org.apache.flume.sink.hdfs.BucketWriter.doOpen:208) - Creating >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23//FlumeData.1370021414625.tmp >> 31 May 2013 23:14:56,288 INFO [hdfs-HDFS-roll-timer-0] >> (org.apache.flume.sink.hdfs.BucketWriter.renameBucket:427) - Renaming >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414625.tmp >> to >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414625 >> 31 May 2013 23:15:02,317 INFO [hdfs-HDFS-call-runner-5] >> (org.apache.flume.sink.hdfs.BucketWriter.doOpen:208) - Creating >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23//FlumeData.1370021414626.tmp >> 31 May 2013 23:15:32,340 INFO [hdfs-HDFS-roll-timer-0] >> (org.apache.flume.sink.hdfs.BucketWriter.renameBucket:427) - Renaming >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414626.tmp >> to >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414626 >> 31 May 2013 23:15:43,632 INFO [hdfs-HDFS-call-runner-9] >> (org.apache.flume.sink.hdfs.BucketWriter.doOpen:208) - Creating >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/23//FlumeData.1370021414627.tmp >> 31 May 2013 23:15:56,604 INFO [node-shutdownHook] >> (org.apache.flume.node.FlumeNode.stop:67) - Flume node stopping - >> TwitterAgent >> 31 May 2013 23:15:56,604 INFO [node-shutdownHook] >> (org.apache.flume.lifecycle.LifecycleSupervisor.stop:78) - Stopping >> lifecycle supervisor 7 >> 31 May 2013 23:15:56,606 INFO [node-shutdownHook] >> (org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.stop:215) - >> Node manager stopping >> 31 May 2013 23:15:56,606 INFO [node-shutdownHook] >> (org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.stopAllComponents:68) >> - Shutting down configuration: { >> sourceRunners:{Twitter=EventDrivenSourceRunner: { >> source:com.cloudera.flume.source.TwitterSource{name:Twitter,state:START} }} >> sinkRunners:{HDFS=SinkRunner: { >> policy:org.apache.flume.sink.DefaultSinkProcessor@1d80e6d counterGroup:{ >> name:null counters:{runner.backoffs.consecutive=2, runner.backoffs=1252} >> } }} channels:{MemChannel=org.apache.flume.channel.MemoryChannel{name: >> MemChannel}} } >> 31 May 2013 23:15:56,607 INFO [node-shutdownHook] >> (org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.stopAllComponents:72) >> - Stopping Source Twitter >> 31 May 2013 23:15:56,607 INFO [node-shutdownHook] >> (org.apache.flume.lifecycle.LifecycleSupervisor.unsupervise:156) - >> Stopping component: EventDrivenSourceRunner: { >> source:com.cloudera.flume.source.TwitterSource{name:Twitter,state:START} } >> 31 May 2013 23:15:56,682 WARN [Twitter Stream consumer-1[Disposing >> thread]] (twitter4j.internal.logging.SLF4JLogger.warn:99) - Stream already >> closed. >> 31 May 2013 23:15:56,682 INFO [node-shutdownHook] >> (org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.stopAllComponents:82) >> - Stopping Sink HDFS >> 31 May 2013 23:15:56,683 INFO [node-shutdownHook] >> (org.apache.flume.lifecycle.LifecycleSupervisor.unsupervise:156) - >> Stopping component: SinkRunner: { >> policy:org.apache.flume.sink.DefaultSinkProcessor@1d80e6d counterGroup:{ >> name:null counters:{runner.backoffs.consecutive=2, runner.backoffs=1252} } } >> 31 May 2013 23:15:56,754 WARN >> [SinkRunner-PollingRunner-DefaultSinkProcessor] >> (org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout:372) - >> Unexpected Exception null >> java.lang.InterruptedException >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1325) >> at >> java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:257) >> at java.util.concurrent.FutureTask.get(FutureTask.java:119) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:345) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.flush(HDFSEventSink.java:741) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:443) >> at >> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) >> at >> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) >> at java.lang.Thread.run(Thread.java:679) >> 31 May 2013 23:15:56,797 ERROR >> [SinkRunner-PollingRunner-DefaultSinkProcessor] >> (org.apache.flume.sink.hdfs.HDFSEventSink.process:460) - process failed >> java.lang.InterruptedException >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1325) >> at >> java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:257) >> at java.util.concurrent.FutureTask.get(FutureTask.java:119) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:345) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.flush(HDFSEventSink.java:741) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:443) >> at >> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) >> at >> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) >> at java.lang.Thread.run(Thread.java:679) >> 31 May 2013 23:15:56,797 ERROR >> [SinkRunner-PollingRunner-DefaultSinkProcessor] >> (org.apache.flume.SinkRunner$PollingRunner.run:160) - Unable to deliver >> event. Exception follows. >> org.apache.flume.EventDeliveryException: java.lang.InterruptedException >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:464) >> at >> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68) >> at >> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147) >> at java.lang.Thread.run(Thread.java:679) >> Caused by: java.lang.InterruptedException >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1325) >> at >> java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:257) >> at java.util.concurrent.FutureTask.get(FutureTask.java:119) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:345) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.flush(HDFSEventSink.java:741) >> at >> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:443) >> ... 3 more >> 31 May 2013 23:16:01,798 INFO [node-shutdownHook] >> (org.apache.flume.sink.hdfs.HDFSEventSink.stop:475) - Closing >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/20//FlumeData >> 31 May 2013 23:16:01,811 INFO [hdfs-HDFS-call-runner-4] >> (org.apache.flume.sink.hdfs.BucketWriter.doClose:283) - HDFSWriter is >> already closed: >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/20//FlumeData.1370013399555.tmp >> 31 May 2013 23:16:01,812 INFO [node-shutdownHook] >> (org.apache.flume.sink.hdfs.HDFSEventSink.stop:475) - Closing >> hdfs://localhost:54310/user/flume/tweets/2013/05/31/21//FlumeData >> >> Any reason Flume stopped the service? >> >> Thanks, >> Lenin >> > > > > -- > Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org > --089e011838eaa2084604de19aefc Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Brock,

Which log file should I check = under /var/log?

Following are the list of files under /var/log modif= ied from yesterdat:

-rw-r----- 1 syslog=A0=A0=A0=A0=A0 adm=A0=A0=A0= =A0=A0=A0=A0=A0 1227 2013-05-31 06:25 syslog.2.gz
-rw-r----- 1 mysql=A0=A0=A0=A0=A0=A0 adm=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 20 2= 013-05-31 06:25 mysql.log.1.gz
-rw-rw-r-- 1 root=A0=A0=A0=A0=A0=A0=A0 ut= mp=A0=A0=A0=A0=A0=A0 40704 2013-05-31 23:15 wtmp.1
-rw-r----- 1 syslog= =A0=A0=A0=A0=A0 adm=A0=A0=A0=A0=A0=A0=A0 14296 2013-06-01 06:25 syslog.1-rw-r--r-- 1 root=A0=A0=A0=A0=A0=A0=A0 root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 = 0 2013-06-01 06:25 dpkg.log
drwxr-xr-x 2 root=A0=A0=A0=A0=A0=A0=A0 root=A0=A0=A0=A0=A0=A0=A0 4096 2013-= 06-01 06:25 apt
-rw-r--r-- 1 root=A0=A0=A0=A0=A0=A0=A0 root=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0 0 2013-06-01 06:25 alternatives.log
-rw-r----- 1 mysq= l=A0=A0=A0=A0=A0=A0 adm=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2013-06-01 06:25= mysql.log
drwxr-s--- 2 Debian-exim adm=A0=A0=A0=A0=A0=A0=A0=A0 4096 201= 3-06-01 06:25 exim4
-rw-rw---- 1 root=A0=A0=A0=A0=A0=A0=A0 utmp=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0= 2013-06-01 06:25 btmp
-rw-r----- 1 syslog=A0=A0=A0=A0=A0 adm=A0=A0=A0= =A0=A0=A0 119666 2013-06-01 18:03 kern.log
-rw-r----- 1 syslog=A0=A0=A0= =A0=A0 adm=A0=A0=A0=A0=A0=A0=A0=A0 8845 2013-06-01 21:09 syslog
-rw-r---= -- 1 syslog=A0=A0=A0=A0=A0 adm=A0=A0=A0=A0=A0 4713281 2013-06-01 21:14 auth= .log
-rw-rw-r-- 1 root=A0=A0=A0=A0=A0=A0=A0 utmp=A0=A0=A0=A0=A0=A0=A0 3456 2013-= 06-01 21:14 wtmp
-rw-r--r-- 1 root=A0=A0=A0=A0=A0=A0=A0 root=A0=A0=A0=A0= =A0 293752 2013-06-01 21:14 lastlog



Thanks,
Lenin


On Sat, Jun 1, 2013 at 9:12 PM, Brock No= land <brock@cloudera.com> wrote:
Weird... It could have been the linux oom killer? You'= d see something in /var/log/message if that was the case.


= On Sat, Jun 1, 2013 at 2:47 AM, Lenin Raj <emaillenin@gmail.com>= wrote:
Hello,

I have a flume service which pulls twitter data and sinks to HDFS. I sta= rted it last night at 8 PM. It was going well. When I checked the status to= day morning, it seems flume service stopped at around 11:15 PM.

I could not find any valid reason in the log file. Flume is doing= "Flume node stopping - TwitterAgent" automatically without throw= ing any error.


31 May 2013 23:13:32,226 INFO=A0 [hdfs-HDFS-call-= runner-7] (org.apache.flume.sink.hdfs.BucketWriter.doOpen:208)=A0 - Creatin= g hdfs://localhost:54310/user/flume/tweets/2013/05/31/23//FlumeData.1370021= 414624.tmp
31 May 2013 23:14:02,247 INFO=A0 [hdfs-HDFS-roll-timer-0] (org.apache.flume= .sink.hdfs.BucketWriter.renameBucket:427)=A0 - Renaming hdfs://localhost:54= 310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414624.tmp to hdfs://l= ocalhost:54310/user/flume/tweets/2013/05/31/23/FlumeData.1370021414624
31 May 2013 23:14:26,260 INFO=A0 [hdfs-HDFS-call-runner-1] (org.apache.flum= e.sink.hdfs.BucketWriter.doOpen:208)=A0 - Creating hdfs://localhost:54310/u= ser/flume/tweets/2013/05/31/23//FlumeData.1370021414625.tmp
31 May 2013 = 23:14:56,288 INFO=A0 [hdfs-HDFS-roll-timer-0] (org.apache.flume.sink.hdfs.B= ucketWriter.renameBucket:427)=A0 - Renaming hdfs://localhost:54310/user/flu= me/tweets/2013/05/31/23/FlumeData.1370021414625.tmp to hdfs://localhost:543= 10/user/flume/tweets/2013/05/31/23/FlumeData.1370021414625
31 May 2013 23:15:02,317 INFO=A0 [hdfs-HDFS-call-runner-5] (org.apache.flum= e.sink.hdfs.BucketWriter.doOpen:208)=A0 - Creating hdfs://localhost:54310/u= ser/flume/tweets/2013/05/31/23//FlumeData.1370021414626.tmp
31 May 2013 = 23:15:32,340 INFO=A0 [hdfs-HDFS-roll-timer-0] (org.apache.flume.sink.hdfs.B= ucketWriter.renameBucket:427)=A0 - Renaming hdfs://localhost:54310/user/flu= me/tweets/2013/05/31/23/FlumeData.1370021414626.tmp to hdfs://localhost:543= 10/user/flume/tweets/2013/05/31/23/FlumeData.1370021414626
31 May 2013 23:15:43,632 INFO=A0 [hdfs-HDFS-call-runner-9] (org.apache.flum= e.sink.hdfs.BucketWriter.doOpen:208)=A0 - Creating hdfs://localhost:54310/u= ser/flume/tweets/2013/05/31/23//FlumeData.1370021414627.tmp
31 May 2013 = 23:15:56,604 INFO=A0 [node-shutdownHook] (org.apache.flume.node.FlumeNode.s= top:67)=A0 - Flume node stopping - TwitterAgent
31 May 2013 23:15:56,604 INFO=A0 [node-shutdownHook] (org.apache.flume.life= cycle.LifecycleSupervisor.stop:78)=A0 - Stopping lifecycle supervisor 7
= 31 May 2013 23:15:56,606 INFO=A0 [node-shutdownHook] (org.apache.flume.node= .nodemanager.DefaultLogicalNodeManager.stop:215)=A0 - Node manager stopping=
31 May 2013 23:15:56,606 INFO=A0 [node-shutdownHook] (org.apache.flume.node= .nodemanager.DefaultLogicalNodeManager.stopAllComponents:68)=A0 - Shutting = down configuration: { sourceRunners:{Twitter=3DEventDrivenSourceRunner: { s= ource:com.cloudera.flume.source.TwitterSource{name:Twitter,state:START} }} = sinkRunners:{HDFS=3DSinkRunner: { policy:org.apache.flume.sink.DefaultSinkP= rocessor@1d80e6d counterGroup:{ name:null counters:{runner.backoffs.consecu= tive=3D2, runner.backoffs=3D1252}
=A0} }} channels:{MemChannel=3Dorg.apache.flume.channel.MemoryChannel{name:= MemChannel}} }
31 May 2013 23:15:56,607 INFO=A0 [node-shutdownHook] (or= g.apache.flume.node.nodemanager.DefaultLogicalNodeManager.stopAllComponents= :72)=A0 - Stopping Source Twitter
31 May 2013 23:15:56,607 INFO=A0 [node-shutdownHook] (org.apache.flume.life= cycle.LifecycleSupervisor.unsupervise:156)=A0 - Stopping component: EventDr= ivenSourceRunner: { source:com.cloudera.flume.source.TwitterSource{name:Twi= tter,state:START} }
31 May 2013 23:15:56,682 WARN=A0 [Twitter Stream consumer-1[Disposing threa= d]] (twitter4j.internal.logging.SLF4JLogger.warn:99)=A0 - Stream already cl= osed.
31 May 2013 23:15:56,682 INFO=A0 [node-shutdownHook] (org.apache.f= lume.node.nodemanager.DefaultLogicalNodeManager.stopAllComponents:82)=A0 - = Stopping Sink HDFS
31 May 2013 23:15:56,683 INFO=A0 [node-shutdownHook] (org.apache.flume.life= cycle.LifecycleSupervisor.unsupervise:156)=A0 - Stopping component: SinkRun= ner: { policy:org.apache.flume.sink.DefaultSinkProcessor@1d80e6d counterGro= up:{ name:null counters:{runner.backoffs.consecutive=3D2, runner.backoffs= =3D1252} } }
31 May 2013 23:15:56,754 WARN=A0 [SinkRunner-PollingRunner-DefaultSinkProce= ssor] (org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout:372)=A0 - U= nexpected Exception null
java.lang.InterruptedException
=A0=A0=A0=A0= =A0=A0=A0 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcqui= reSharedNanos(AbstractQueuedSynchronizer.java:1325)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.FutureTask$Sync.innerGet(Futu= reTask.java:257)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.FutureTas= k.get(FutureTask.java:119)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sin= k.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:345)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs.HDFSEventSink.flush(HDF= SEventSink.java:741)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs= .HDFSEventSink.process(HDFSEventSink.java:443)
=A0=A0=A0=A0=A0=A0=A0 at = org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.jav= a:68)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.SinkRunner$PollingRunner.run(Sink= Runner.java:147)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.ja= va:679)
31 May 2013 23:15:56,797 ERROR [SinkRunner-PollingRunner-Default= SinkProcessor] (org.apache.flume.sink.hdfs.HDFSEventSink.process:460)=A0 - = process failed
java.lang.InterruptedException
=A0=A0=A0=A0=A0=A0=A0 at java.util.concur= rent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedS= ynchronizer.java:1325)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.Fut= ureTask$Sync.innerGet(FutureTask.java:257)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.FutureTask.get(FutureTask.jav= a:119)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs.HDFSEventSink= .callWithTimeout(HDFSEventSink.java:345)
=A0=A0=A0=A0=A0=A0=A0 at org.ap= ache.flume.sink.hdfs.HDFSEventSink.flush(HDFSEventSink.java:741)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs.HDFSEventSink.process(H= DFSEventSink.java:443)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.De= faultSinkProcessor.process(DefaultSinkProcessor.java:68)
=A0=A0=A0=A0=A0= =A0=A0 at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147= )
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:679)
31 May 20= 13 23:15:56,797 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.= apache.flume.SinkRunner$PollingRunner.run:160)=A0 - Unable to deliver event= . Exception follows.
org.apache.flume.EventDeliveryException: java.lang.InterruptedException
= =A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs.HDFSEventSink.process(H= DFSEventSink.java:464)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.De= faultSinkProcessor.process(DefaultSinkProcessor.java:68)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.SinkRunner$PollingRunner.run(Sink= Runner.java:147)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.ja= va:679)
Caused by: java.lang.InterruptedException
=A0=A0=A0=A0=A0=A0= =A0 at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireShar= edNanos(AbstractQueuedSynchronizer.java:1325)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.FutureTask$Sync.innerGet(Futu= reTask.java:257)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.FutureTas= k.get(FutureTask.java:119)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sin= k.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:345)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs.HDFSEventSink.flush(HDF= SEventSink.java:741)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.sink.hdfs= .HDFSEventSink.process(HDFSEventSink.java:443)
=A0=A0=A0=A0=A0=A0=A0 ...= 3 more
31 May 2013 23:16:01,798 INFO=A0 [node-shutdownHook] (org.apache= .flume.sink.hdfs.HDFSEventSink.stop:475)=A0 - Closing hdfs://localhost:5431= 0/user/flume/tweets/2013/05/31/20//FlumeData
31 May 2013 23:16:01,811 INFO=A0 [hdfs-HDFS-call-runner-4] (org.apache.flum= e.sink.hdfs.BucketWriter.doClose:283)=A0 - HDFSWriter is already closed: hd= fs://localhost:54310/user/flume/tweets/2013/05/31/20//FlumeData.13700133995= 55.tmp
31 May 2013 23:16:01,812 INFO=A0 [node-shutdownHook] (org.apache.flume.sink= .hdfs.HDFSEventSink.stop:475)=A0 - Closing hdfs://localhost:54310/user/flum= e/tweets/2013/05/31/21//FlumeData

=
Any reason Flume stopped the service?

Thanks,
Lenin



--
Apache MRUn= it - Unit testing MapReduce - http://mrunit.apache.org

--089e011838eaa2084604de19aefc--