Mailing-List: contact dev-help@samza.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@samza.apache.org
Content-Type: multipart/signed;
 boundary="Apple-Mail=_17C19C14-3771-4A8F-9B36-8FBE36746780";
 protocol="application/pgp-signature"; micalg=pgp-sha256
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\))
Subject: Re: Does Samza work with ResourceManager in HA?
From: Rick Mangi <rick@chartbeat.com>
In-Reply-To: 
 <VI1PR08MB0813E683CC4E5EAB7B6562BE992B0@VI1PR08MB0813.eurprd08.prod.outlook.com>
Date: Tue, 3 Nov 2015 14:55:06 -0500
Message-Id: <C616D257-D714-40F1-A895-0EF5154D9C87@chartbeat.com>
References: 
 <VI1PR08MB081358778FAE0E3BBABE1C18992B0@VI1PR08MB0813.eurprd08.prod.outlook.com>
 <VI1PR08MB0813631B5BC75A278106E37D992B0@VI1PR08MB0813.eurprd08.prod.outlook.com>
 <VI1PR08MB0813FB7B1855C4FB86CEFBA3992B0@VI1PR08MB0813.eurprd08.prod.outlook.com>
 <7426CD70-8E2C-4973-9FC8-F7E5C01055E2@chartbeat.com>
 <VI1PR08MB0813E683CC4E5EAB7B6562BE992B0@VI1PR08MB0813.eurprd08.prod.outlook.com>
To: dev@samza.apache.org

--Apple-Mail=_17C19C14-3771-4A8F-9B36-8FBE36746780
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

Nope, we left it out.

Rick


> On Nov 3, 2015, at 11:04 AM, John Tipper <john_tipper@hotmail.com> =
wrote:
>=20
> Thanks Rick, much appreciated.  Did you have to set =
yarn.resourcemanager.hostname or can you leave this out?
>=20
> Thanks,
>=20
> John
>=20
> ________________________________________
> From: Rick Mangi <rick@chartbeat.com>
> Sent: 03 November 2015 15:46
> To: dev@samza.apache.org
> Subject: Re: Does Samza work with ResourceManager in HA?
>=20
> Hi John,
>=20
> We just got this set up last week. I haven=92t fully tested the =
failover but it certainly works for testing out our samza jobs on a =
pretty large cluster.
>=20
> All of the server names are fqdn in our live yarn-site.xml
>=20
> Hope this helps,
>=20
> Rick
>=20
>=20
> <property>
>  <name>yarn.resourcemanager.ha.enabled</name>
>  <value>true</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.ha.automatic-failover.enabled</name>
>  <value>true</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.cluster-id</name>
>  <value>ops02</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.ha.rm-ids</name>
>  <value>rm1,rm2</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.hostname.rm1</name>
>  <value>yarnmaster01</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.hostname.rm2</name>
>  <value>yarnmaster02</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.webapp.address.rm1</name>
>  <value>yarnmaster01:8088</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.webapp.address.rm2</name>
>  <value>yarnmaster02:8088</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.zk-address</name>
>  <value>zk01:2181,zk02:2181,zk03:2181,zk04:2181,zk06:2181</va
> lue>
> </property>
> <property>
>  <name>yarn.resourcemanager.store.class</name>
>  =
<value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateSto=
re</value>
> </property>
>=20
> <property>
>  <name>yarn.resourcemanager.recovery.enabled</name>
>  <value>true</value>
> </property>
> <property>
>  <name>yarn.resourcemanager.zk-state-store.parent-path</name>
>  <value>/yarn_ops02_rmstore</value>
> </property>
>=20
>=20
>=20
>> On Nov 3, 2015, at 6:10 AM, John Tipper <john_tipper@hotmail.com> =
wrote:
>>=20
>>=20
>>=20
>> Does anyone have Samza working with resource manager in HA? If so, =
what do I set yarn.resourcemanager.hostname to in yarn-site.xml?  Can =
anyone share a working yarn-site.xml please?
>>=20
>>=20
>> If I set it to the first of my RMs, the the job submission works ok =
if I submit the job from that RM and the RM is the active one. If the RM =
machine that I run the job submission from is not active, I get =
connection refused errors on port 8032.  If I don't set it, I get errors =
where run-job.sh tries to submit to 0.0.0.0:8032
>>=20
>>=20
>> Many thanks,
>>=20
>>=20
>> John
>=20


--Apple-Mail=_17C19C14-3771-4A8F-9B36-8FBE36746780
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----

iQEcBAEBCAAGBQJWOREaAAoJENgofZAtxzWQ0MMH/RALqX5KIB7JcK622J2Ok/9B
WLpRLON2IC7zKSRKt6xhJUubg5KVHvu653f8V1CuBi57G6ydPRpRVbLQ2T+d96BI
9wjJQTO4M9x/wcPNE/t8FT2duFaJI7K5uar6e9dsm5lEIhnqF424hlJmKxh5QR6a
pGbDD3hzSYOwjv40wgSWYAxOZawDaDfpHHXTE6fCZNW1NQQGOGsr7iDGUkCx4UqB
9Mhx5csEbeFrG8oJkdzY5KtzAF1dsAvCPrF+MeVklF/wZ9F7AfXGh9xIqr2Q1Qi7
loHvWiM/9bGeDqSDxaHoPQ/j17p9ljq4ddSVqN21sWfsVpBKhIfqXMn0lChLzv8=
=KZOb
-----END PGP SIGNATURE-----

--Apple-Mail=_17C19C14-3771-4A8F-9B36-8FBE36746780--