Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A53852009F8 for ; Fri, 3 Jun 2016 11:35:58 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A3BB5160A2A; Fri, 3 Jun 2016 09:35:58 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id ED898160A25 for ; Fri, 3 Jun 2016 11:35:57 +0200 (CEST) Received: (qmail 73245 invoked by uid 500); 3 Jun 2016 09:35:56 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 73235 invoked by uid 99); 3 Jun 2016 09:35:56 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Jun 2016 09:35:56 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 4D44EC0D0F for ; Fri, 3 Jun 2016 09:35:56 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.429 X-Spam-Level: * X-Spam-Status: No, score=1.429 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ctpmza8edZpq for ; Fri, 3 Jun 2016 09:35:55 +0000 (UTC) Received: from mail-wm0-f66.google.com (mail-wm0-f66.google.com [74.125.82.66]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 037535F2C3 for ; Fri, 3 Jun 2016 09:35:55 +0000 (UTC) Received: by mail-wm0-f66.google.com with SMTP id n184so21640171wmn.1 for ; Fri, 03 Jun 2016 02:35:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:subject:from:to:date:in-reply-to:references:mime-version; bh=kvOLXDcCKaxTfCGSHM5Cu0jeJsmuRrs/qm5vpClsF3E=; b=oNeBO5mGWx+atMgGCqrijO6wr/jRluFGs4VpKX8BCULt/sN2gwpAHP9L30qfXAXe6n VkttlGL3vqHlyBFtpbh9WJmV69fykWreNELixCM78i6FbVDhr5wJzeGpzdTXtgqPJ5+A 9uVi9uRkRTUxC8WXZo9i3hsYGaXRSbka7TgPcd9qBkAvypKEumCEbfkS9JnyGXUY3nLE /bS5agzJVrrE0bMuGuKjmcv0KIY5DKEiPxaLIj7bb6JNr5Oyt9EYzF3ImvHk9oq8ka3/ Mth74WzXwaYIqx7jxrQ6UElNYVWL1xQGiyRXpqAAf8tBzR5Js0+dAs7TBBV7gfUX9bDS 8WGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:subject:from:to:date:in-reply-to :references:mime-version; bh=kvOLXDcCKaxTfCGSHM5Cu0jeJsmuRrs/qm5vpClsF3E=; b=EiIXxbj/DXeZT1JDs4+MCEtrn4qJDUiKq9Pe9fVvGz+yppiH2LTHXi4VkWAWa5+/n4 87cqotDNtDmeyYnOopTlo2jI5/1BWtlw3CL4OO5AcZL0Zi3+4KPizi768z7WeAWKFpnF EIYXJinJMXtDh/4dGzDEf6v0PTXllFD3HSJppikvpQD4oG7fMkEsiQGNAUPvD8kKti9n gVSR3wkwea3T6N312c3XOjTcqq7tu3xyBzf3a9vs8LbNi84zMsN+wu+0vJzt6MzVmwhM mO00iEgjMdsuL15dLmL3FYIIDYCbk9AmNwn4yrreaYlcqGjyPl8VaFvyEanP9pDwClbE p7LQ== X-Gm-Message-State: ALyK8tJIdPaoX7Ct4tGyPuCrZLRTmuz+jIhKwYEYkFIWIWSMbtLH3dSz+Gh5DBJDKzCx2Q== X-Received: by 10.194.83.136 with SMTP id q8mr2784336wjy.146.1464946554561; Fri, 03 Jun 2016 02:35:54 -0700 (PDT) Received: from pc-gbaneza (ip84.dominioabsoluto.com. [217.116.1.84]) by smtp.googlemail.com with ESMTPSA id c7sm4757837wji.38.2016.06.03.02.35.53 for (version=TLSv1/SSLv3 cipher=OTHER); Fri, 03 Jun 2016 02:35:53 -0700 (PDT) Message-ID: <1464946551.12415.38.camel@gmail.com> Subject: Re: [Flume 1.7.0] 'parseAsFlumeEvent = false' works in Kafka channel? From: "George M." To: user@flume.apache.org Date: Fri, 03 Jun 2016 11:35:51 +0200 In-Reply-To: References: <1464866529.32560.34.camel@gmail.com> <1464873123.32560.63.camel@gmail.com> <1464880838.32560.79.camel@gmail.com> <1464883167.32560.85.camel@gmail.com> <1464943724.12415.32.camel@gmail.com> Content-Type: multipart/alternative; boundary="=-JK6citVmR2ChanE8b5G/" X-Mailer: Evolution 3.12.9-1+b1 Mime-Version: 1.0 archived-at: Fri, 03 Jun 2016 09:35:58 -0000 --=-JK6citVmR2ChanE8b5G/ Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit > The explanation could be clearer but it boils down to this: > > > > -If you use parseAsEvent=true (default) > Then the events in the channel are avro FlumeEvents. So you have to > read/write avro but you have all the object metadata (timestamp, > headers, etc) > > > -If you use parseAsEvent=false > Then the events in the channel is just text (no metadata) > > > You have to choose either to use pure text or have a richer FlumeEvent > object. > > > > Ok. But both without morphline interceptors. Is it correct? Thanks. --=-JK6citVmR2ChanE8b5G/ Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: 7bit
The explanation could be clearer but it boils down to this:


-If you use parseAsEvent=true (default)
 Then the events in the channel are avro FlumeEvents. So you have to read/write avro but you have all the object metadata (timestamp, headers, etc)


-If you use parseAsEvent=false
  Then the events in the channel is just text (no metadata)


You have to choose either to use pure text or have a richer FlumeEvent object.




Ok. But both without morphline interceptors. Is it correct?

Thanks.
--=-JK6citVmR2ChanE8b5G/--