Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8E97910AEE for ; Wed, 18 Dec 2013 12:51:21 +0000 (UTC) Received: (qmail 33256 invoked by uid 500); 18 Dec 2013 12:51:21 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 32846 invoked by uid 500); 18 Dec 2013 12:51:19 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 32659 invoked by uid 99); 18 Dec 2013 12:51:19 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Dec 2013 12:51:19 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sarah.libing@gmail.com designates 74.125.82.53 as permitted sender) Received: from [74.125.82.53] (HELO mail-wg0-f53.google.com) (74.125.82.53) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Dec 2013 12:51:12 +0000 Received: by mail-wg0-f53.google.com with SMTP id k14so7486134wgh.20 for ; Wed, 18 Dec 2013 04:50:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=IHRcu7lu9jUia6WsQ48CpXlrF7n90u5OycC2heGy394=; b=xoMYEtKgnau2lJ/H6Kv7kj9jHb7qhEcznxikQZXCWGzPFiKOhWEleIsolTozSK9VYI dAGjC9rsBuiCmIvMKmh2Q0AMIbec7ZxaPxqrqPIavWpuLtNFcl6HS/p6eK/hOQ0yDRgz DiqHUkcCcasBBoKBktPosTV/e/H/tBUYQz8DGB3fvHAsuopuX5iwR8ZXN0/u2SFh/i0A vcm7Behw/EkMiZCr3zjkGQMhgyIdZF8NlSESijHPHk8YHKtXWI/M4HzmKxNOuhIw/srj GaiInsx0SUivAEzZKgzAeNo1o6tVa81lhHjAFZYDsoS2TyN2Tzj13RSVAL9A/YLnmuar w61w== MIME-Version: 1.0 X-Received: by 10.194.108.100 with SMTP id hj4mr1982711wjb.83.1387371052184; Wed, 18 Dec 2013 04:50:52 -0800 (PST) Received: by 10.227.200.73 with HTTP; Wed, 18 Dec 2013 04:50:52 -0800 (PST) Date: Wed, 18 Dec 2013 20:50:52 +0800 Message-ID: Subject: FileChannel doesn't work when upgrade protobuf to 2.5.0 in Flume 1.3.1 From: Bing Li To: user@flume.apache.org, dev@flume.apache.org Content-Type: multipart/alternative; boundary=047d7bf109febcba8904edce7eba X-Virus-Checked: Checked by ClamAV on apache.org --047d7bf109febcba8904edce7eba Content-Type: text/plain; charset=ISO-8859-1 Hi, guys I'm using Flume 1.3.1 + protobuf 2.5.0, and got a failure in TestFlileChannel, the target file is empty. I have applied changes in https://issues.apache.org/jira/browse/FLUME-1929 https://issues.apache.org/jira/browse/FLUME-2172 and update filechannel.proto to the latest. Is there a simple way to fix this instead of port all changes related to FileChannel from Flume 1.4.0? Thank you! ================= *Results :* Failed tests: testInOut(org.apache.flume.test.agent.TestFileChannel): FILE_ROLL sink's actual output doesn't match expected output. 2013-12-18 04:16:43,959 (main) [ERROR - org.apache.flume.test.agent.TestFileChannel.testInOut(TestFileChannel.java:156)] Actual output doesn't match expected output. ================== *Stack trace in Flume log:* 2013-12-17 23:21:18,027 (lifecycleSupervisor-1-0) [ERROR - org.apache.flume.channel.file.Log.replay(Log.java:410)] Failed to initialize Log on [channel=c1] java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses. at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180) at *org.apache.flume.channel.file.proto.ProtosFactory* $Checkpoint.getSerializedSize(ProtosFactory.java:233) at *com.google.protobuf.AbstractMessageLite.writeDelimitedTo* (AbstractMessageLite.java:84) at *org.apache.flume.channel.file.EventQueueBackingStoreFileV3* .(EventQueueBackingStoreFileV3.java:100) at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:64) at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36) at org.apache.flume.channel.file.Log.replay(Log.java:390) at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303) at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:450) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:328) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:161) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:109) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:191) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:215) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:906) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:929) at java.lang.Thread.run(Thread.java:738) --047d7bf109febcba8904edce7eba Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi, guys
I'm using Flume 1.3.1 + pr= otobuf 2.5.0, and got a failure in TestFlileChannel, the target file is emp= ty.

I have applied changes in
https://issues.apache.org/jira/browse/FLUME-1929=
https://issues= .apache.org/jira/browse/FLUME-2172

and upd= ate filechannel.proto to the latest.

Is there a simple wa= y to fix this instead of port all changes related to FileChannel from Flume= 1.4.0?

Thank you!

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D
Results :

Failed tests:=A0=A0 testIn= Out(org.apache.flume.test.agent.TestFileChannel): FILE_ROLL sink's actu= al output doesn't match expected output.

2013-12-18 04:16:43,959 (main) [ERROR - org.apache.flume.test.agent.Tes= tFileChannel.testInOut(TestFileChannel.java:156)] Actual output doesn&a= pos;t match expected output.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D

Stack trace in Flume log:

2013-12-17 23:21:18,027 (lifecycleS= upervisor-1-0) [ERROR - org.apache.flume.channel.file.Log.replay(Log.java:4= 10)] Failed to initialize Log on [channel=3Dc1]
java.lang.UnsupportedOpe= rationException: This is supposed to be overridden by subclasses.
=A0=A0=A0=A0=A0=A0=A0 at com.google.protobuf.GeneratedMessage.getUnknownFie= lds(GeneratedMessage.java:180)
=A0=A0=A0=A0=A0=A0=A0 at org.apache= .flume.channel.file.proto.ProtosFactory$Checkpoint.getSerializedSiz= e(ProtosFactory.java:233)
=A0=A0=A0=A0=A0=A0=A0 at com.google.protobuf.AbstractMessageLite.writ= eDelimitedTo(AbstractMessageLite.java:84)
=A0=A0=A0=A0=A0=A0=A0 = at org.apache.flume.channel.file.EventQueueBackingStoreFileV3= .<init>(EventQueueBackingStoreFileV3.java:100)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.channel.file.EventQueueBackingSto= reFactory.get(EventQueueBackingStoreFactory.java:64)
=A0=A0=A0=A0=A0=A0= =A0 at org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(Even= tQueueBackingStoreFactory.java:36)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.channel.file.Log.replay(Log.java:= 390)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.channel.file.FileChannel.= start(FileChannel.java:303)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.flume.li= fecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:23= 6)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.Executors$RunnableAdapter.cal= l(Executors.java:450)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.Futu= reTask$Sync.innerRunAndReset(FutureTask.java:328)
=A0=A0=A0=A0=A0=A0=A0 = at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:161)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ScheduledThreadPoolExecutor$S= cheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:109)
=A0= =A0=A0=A0=A0=A0=A0 at java.util.concurrent.ScheduledThreadPoolExecutor$Sche= duledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:191)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ScheduledThreadPoolExecutor$S= cheduledFutureTask.run(ScheduledThreadPoolExecutor.java:215)
=A0=A0=A0= =A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Thre= adPoolExecutor.java:906)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run= (ThreadPoolExecutor.java:929)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.= run(Thread.java:738)



--047d7bf109febcba8904edce7eba--