Mailing-List: contact dev-help@samza.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@samza.apache.org
MIME-Version: 1.0
In-Reply-To: <CAFTE_V0fxcBkFeuPVwbbAW9km636NpQ0iN7jgxrYABg-y=Vagg@mail.gmail.com>
References: <CAFTE_V0fxcBkFeuPVwbbAW9km636NpQ0iN7jgxrYABg-y=Vagg@mail.gmail.com>
From: Jake Maes <jmakes@apache.org>
Date: Wed, 18 Oct 2017 08:57:51 -0700
Message-ID: <CAHUevGF0LoMNmj67jMgsHRb2d3D1-XjUcSYyjeqgho7ad3+1GQ@mail.gmail.com>
Subject: Re: Samza Standalone from multiple machines
To: dev@samza.apache.org
Content-Type: multipart/alternative; boundary="001a113ecd667cb567055bd44e4e"
archived-at: Wed, 18 Oct 2017 15:58:15 -0000

--001a113ecd667cb567055bd44e4e
Content-Type: text/plain; charset="UTF-8"

Hey Giridhar,

Boris would have more knowledge on this, but I'll offer a couple pointers:

Running the "Hello Samza" application on multiple hosts should just be a
matter of changing the "job.coordinator.zk.connect" property in the config
<https://github.com/apache/samza-hello-samza/blob/master/src/main/config/wikipedia-application-local-runner.properties#L22>
to an external/shared ZK instance and starting more processors. The ZK Job
Coordinator will automatically utilize more processors as they are started.

However, if I remember correctly, the wikipedia stream is only a single
partition and can't be processed by more than one processor, so you would
probably want to change the input to a Kafka topic with at least as many
partitions as your intended processors.

More details about how standalone works can be found here:
http://samza.apache.org/startup/preview/#flexible-deployment-model

-Jake

On Wed, Oct 18, 2017 at 4:06 AM, Giridhar Addepalli <giridhar1202@gmail.com>
wrote:

> Hi,
>
> i am new to Samza.
> We are evaluating using Samza in Standalone mode.
>
> Was able to run "Hello Samza" using Zookeeper Deployment Model , on single
> machine
> http://samza.apache.org/learn/tutorials/latest/hello-samza-
> high-level-zk.html
>
> We are wondering how to run Samza Job using  Zookeeper Deployment Model
> from multiple machines.
>
> Please point to relevant documentation or suggestions.
>
> Thanks,
> Giridhar.
>

--001a113ecd667cb567055bd44e4e--