samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yan Fang <yanfang...@gmail.com>
Subject Re: Samza Consumer / Producer Question
Date Tue, 09 Jun 2015 17:59:24 GMT
Hi Chas,

In terms of the consumer, you can also refer to the Kafka Consumer
<https://github.com/apache/samza/blob/master/samza-kafka/src/main/scala/org/apache/samza/system/kafka/KafkaSystemConsumer.scala>
,
which will give you another view of how to implement the consumer. But I am
very curious, why do you want to keep your own zookeeper connection and not
use the Kafka consumer's?

In terms of the error, as Yi said, pasting the config will help.

Thanks,

Fang, Yan
yanfang724@gmail.com

On Mon, Jun 8, 2015 at 11:48 AM, Yi Pan <nickpan47@gmail.com> wrote:

> Hi, Chas,
>
> Could you share your job configuration as well?
>
> Thanks!
>
> -Yi
>
> On Mon, Jun 8, 2015 at 8:42 AM, Chas Personal <c.pezanko@hotmail.com>
> wrote:
>
> > Hello,
> >
> >
> >
> > I am working on a Samza script currently and had a couple questions. I am
> > able to work with the Hello-Samza application and have been able to add
> to
> > that example. The goal is to be able to write one from scratch and be
> able
> > to implement and iterate upon it indefinitely. The questions I have are
> the
> > following.
> >
> >
> >
> > I understand the StreamTask handles the logic. I can create a StreamTask
> > that just consumers and produces raw data but where my problem comes in
> is
> > with the consumer. The Wikipedia example connects to an IRC in order to
> > have a stream of constant data. Instead of connecting to IRC in my
> consumer
> > I am aiming to connect to a zookeeper connection that listens to an input
> > Kafka topic. Is there an example somewhere to see how to implement this,
> or
> > any direction? I understand the flow, I believe, am just struggling with
> > the code implementation.
> >
> >
> >
> > Second question is an error that I am having which may be solved by a
> > solution to the above inquiry. I am receiving an error saying “Failed to
> > update metadata after 98 ms.” I’ve attached a txt document with a log of
> > the information if you can provide any assistance.
> >
> >
> >
> > Apologies for the probably obvious questions but I am really wanting to
> > fully understand this whole system so I can manipulate it to my liking
> > soon.
> >
> >
> >
> > Thank you,
> >
> > Chas Pezanko
> >
> >
> >
> >
> >
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message