Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1DC86E575 for ; Tue, 15 Jan 2013 00:14:43 +0000 (UTC) Received: (qmail 80608 invoked by uid 500); 15 Jan 2013 00:14:42 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 80551 invoked by uid 500); 15 Jan 2013 00:14:42 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 80543 invoked by uid 99); 15 Jan 2013 00:14:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 00:14:42 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of brock@cloudera.com designates 209.85.216.172 as permitted sender) Received: from [209.85.216.172] (HELO mail-qc0-f172.google.com) (209.85.216.172) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Jan 2013 00:14:35 +0000 Received: by mail-qc0-f172.google.com with SMTP id b25so2879244qca.17 for ; Mon, 14 Jan 2013 16:14:15 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding:x-gm-message-state; bh=ySVn61yVL7GiDLRIZvV/3ijxT0y9Dq37VmNxpJrt8pc=; b=SRfIXVLBV0E5Bog6+C2R0gei3Pob+FvkD5GjXJU2Ned6Vv3imBqqSZHuuc0IUyhKcC N9c50dv7YkdM3jflHOvrA6I99ICoON9aiVhKas0bUsQnAtKE62aFxR3xQjqojIHAZvoE EfvN6vEPCScyjiFpGt7e5R3KqSvHTGSlOLT0NIkhmd2Hphmd6Vy2bi9R9e1yCe1wUhP3 nHs5RRVMUSZb8yrwjOL36uvhL/KdYRm3/OzfOEMxjx3FYgph6nGkHBh/hv2HSSq3wVfH OEktuYmyJvblw8tdNCxDo4lLKF6G6MDso9rFsMRHDKxj/Kg4OVHdofQR1jHT0NLQGMfi woog== Received: by 10.224.72.197 with SMTP id n5mr75046533qaj.38.1358208855171; Mon, 14 Jan 2013 16:14:15 -0800 (PST) MIME-Version: 1.0 Received: by 10.49.83.200 with HTTP; Mon, 14 Jan 2013 16:13:35 -0800 (PST) In-Reply-To: References: From: Brock Noland Date: Mon, 14 Jan 2013 16:13:35 -0800 Message-ID: Subject: Re: flume-ng data recovery To: "user@flume.apache.org" Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQmSli4nXoE2p+j1zCz/KOEQV61AzsqJ18y5OfgO08alVPtqS7F7NsgTDvxguJ7Krivs5x1V X-Virus-Checked: Checked by ClamAV on apache.org Roy, You deleted the checkpoint files AND the inflights and you got the same err= or? Brock On Mon, Jan 14, 2013 at 4:10 PM, Camp, Roy wrote: > I somehow got one of my instances into a bad state where I continue to ge= t > the following error. I have two data log files with about 2GB worth of d= ata > that I=92d like to save. Removing the current checkpoint and/or inflight > files did not work. Any ideas? > > > > Thanks, > > > > Roy > > > > > > Flume-NG 1.3 SNAPSHOT =96 not the 1.3 stable release > > > > 2013-01-14 17:03:53,570 (lifecycleSupervisor-1-1) [INFO - > org.apache.flume.channel.file.Log.replay(Log.java:355)] Replaying logs wi= th > v2 replay logic > > 2013-01-14 17:03:53,574 (lifecycleSupervisor-1-1) [INFO - > org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:= 223)] > Starting replay of [/var/log/flume-ng/collectorfix/data/log-240, > /var/log/flume-ng/collectorfix/data/log-241] > > 2013-01-14 17:03:53,576 (lifecycleSupervisor-1-1) [ERROR - > org.apache.flume.channel.file.Log.replay(Log.java:373)] Failed to initial= ize > Log on [channel=3Dcollectorfilefix] > > java.lang.IllegalStateException: Checksum of inflights file differs from = the > checksum expected. > > at > org.apache.flume.channel.file.FlumeEventQueue$InflightEventWrapper.deseri= alize(FlumeEventQueue.java:487) > > at > org.apache.flume.channel.file.FlumeEventQueue.deserializeInflightPuts(Flu= meEventQueue.java:83) > > at > org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:= 226) > > at org.apache.flume.channel.file.Log.replay(Log.java:356) > > at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:2= 58) > > at > org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(Lifecy= cleSupervisor.java:236) > > at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source= ) > > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Sour= ce) > > at java.util.concurrent.FutureTask.runAndReset(Unknown Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce= ss$101(Unknown > Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runP= eriodic(Unknown > Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(= Unknown > Source) > > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown > Source) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) > > at java.lang.Thread.run(Unknown Source) > > 2013-01-14 17:03:53,579 (lifecycleSupervisor-1-1) [ERROR - > org.apache.flume.channel.file.FileChannel.start(FileChannel.java:269)] > Failed to start the file channel [channel=3Dcollectorfilefix] > > java.lang.IllegalStateException: Checksum of inflights file differs from = the > checksum expected. > > at > org.apache.flume.channel.file.FlumeEventQueue$InflightEventWrapper.deseri= alize(FlumeEventQueue.java:487) > > at > org.apache.flume.channel.file.FlumeEventQueue.deserializeInflightPuts(Flu= meEventQueue.java:83) > > at > org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:= 226) > > at org.apache.flume.channel.file.Log.replay(Log.java:356) > > at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:2= 58) > > at > org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(Lifecy= cleSupervisor.java:236) > > at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source= ) > > at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Sour= ce) > > at java.util.concurrent.FutureTask.runAndReset(Unknown Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce= ss$101(Unknown > Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runP= eriodic(Unknown > Source) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(= Unknown > Source) > > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown > Source) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) > > at java.lang.Thread.run(Unknown Source) --=20 Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit= /