beam-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amit Sela <amitsel...@gmail.com>
Subject Re: KafkaIO Example
Date Wed, 11 Jan 2017 22:12:43 GMT
I assume you're using the Spark runner since ConsoleIO is a Spark runner
only transform (mostly for POCs and playground).
if so, could you please share the error you see ?

Amit.

On Wed, Jan 11, 2017 at 11:57 PM Madhire, Naveen <
Naveen.Madhire@capitalone.com> wrote:

> Hi,
>
>
>
> I am trying to read data from secured Kafka cluster and print on the
> console, however it doesn’t seem to work. I can confirm the authorization
> and authentication to Kafka is behaving correctly,
>
>
>
> Is there some other code which I need to add?
>
>
>
>
>
> Code:
>
>
>
> p.apply(KafkaIO.*read*()
>         .withTopics(ImmutableList.*of*(*"Topic"*))
>         .withKeyCoder(BigEndianLongCoder.*of*())
>         .withValueCoder(StringUtf8Coder.*of*())
>         .updateConsumerProperties((Map) Maps.*fromProperties*(properties))
>         .withoutMetadata())
>         .apply(ConsoleIO.Write.*from*());
>
>
>
>
>
> ------------------------------
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>

Mime
View raw message