Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@nifi.apache.org
From: Sumanth Chinthagunta <xmlking@gmail.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_F466AB48-55EF-43E1-8863-A710394730BA"
Message-Id: <62332FAC-1CC7-4CB9-90B9-6E92D7A754B9@gmail.com>
Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\))
Subject: Re: ConsumeKafka vs getKafka
Date: Sun, 17 Jul 2016 20:44:56 -0700
References: <4996BE21-8664-4764-B32C-5736A9057DD2@gmail.com>
To: dev@nifi.apache.org
In-Reply-To: <4996BE21-8664-4764-B32C-5736A9057DD2@gmail.com>
archived-at: Mon, 18 Jul 2016 03:45:16 -0000

--Apple-Mail=_F466AB48-55EF-43E1-8863-A710394730BA
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

Done.

https://issues.apache.org/jira/browse/NIFI-2298 =
<https://issues.apache.org/jira/browse/NIFI-2298>

Thanks=20
-Sumo

> On Jul 17, 2016, at 1:37 PM, Sumanth Chinthagunta <xmlking@gmail.com> =
wrote:
>=20
> Env: Linux , Kafka 9.0.x, NiFi: 0.7=20
>=20
> We like to use new ConsumeKafka processor  but found critical =
limitations compared to old getKafka processor.=20
> New ConsumeKafka is not writing critical Kafka attributes  i.e., =
kafka.key, kafka.offset, kafka.partition etc into flowFile attributes.=20=

>=20
>=20
> Old getKafka processor:=20
>=20
> Standard FlowFile Attributes
> Key: 'entryDate'
>                Value: 'Sun Jul 17 15:17:00 CDT 2016'
> Key: 'lineageStartDate'
>                Value: 'Sun Jul 17 15:17:00 CDT 2016'
> Key: 'fileSize'
>                Value: '183'
> FlowFile Attribute Map Content
> Key: 'filename'
>                Value: '19709945781167274'
> Key: 'kafka.key'
>                Value: =
'{"database":"test","table":"sc_job","pk.systemid":1}'
> Key: 'kafka.offset'
>                Value: '1184010261'
> Key: 'kafka.partition'
>                Value: '0'
> Key: 'kafka.topic'
>                Value: =E2=80=98data'
> Key: 'path'
>                Value: './'
> Key: 'uuid'
>                Value: '244059bb-9ad9-4d74-b1fb-312eee72124a'
> =20
> =E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94=E2=80=94=
=E2=80=94
> new ConsumeKafka processor :=20
> =20
> Standard FlowFile Attributes
> Key: 'entryDate'
>                Value: 'Sun Jul 17 15:18:41 CDT 2016'
> Key: 'lineageStartDate'
>                Value: 'Sun Jul 17 15:18:41 CDT 2016'
> Key: 'fileSize'
>                Value: '183'
> FlowFile Attribute Map Content
> Key: 'filename'
>                Value: '19710046870478139'
> Key: 'path'
>                Value: './'
> Key: 'uuid'
>                Value: '349fbeb3-e342-4533-be4c-424793fa5c59=E2=80=99
>=20
> Thanks=20
> Sumo=20


--Apple-Mail=_F466AB48-55EF-43E1-8863-A710394730BA--