Mailing-List: contact dev-help@samza.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@samza.apache.org
Content-Type: multipart/signed;
 boundary="Apple-Mail=_20075DF1-26C2-4F21-A719-E2464EA826FF";
 protocol="application/pgp-signature"; micalg=pgp-sha256
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\))
Subject: Re: Sporadic errors in JobRunner
From: Rick Mangi <rick@chartbeat.com>
In-Reply-To: <3D3FB3B9-020B-4AA7-99B4-C632FF2CC40E@chartbeat.com>
Date: Wed, 18 Nov 2015 15:42:39 -0500
Message-Id: <49500F32-6668-4DC6-B9FC-7213795ADDF7@chartbeat.com>
References: <24AD0C26-0448-4B13-8486-CBCFBA442AE2@chartbeat.com>
 <CAFvExu3372aHzwA3JSAWFL922jjWuSrHWSW19re-qa=Y_-P79w@mail.gmail.com>
 <3D3FB3B9-020B-4AA7-99B4-C632FF2CC40E@chartbeat.com>
To: dev@samza.apache.org

--Apple-Mail=_20075DF1-26C2-4F21-A719-E2464EA826FF
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

I take that back, it happened again. Will try your patch.


> On Nov 18, 2015, at 3:36 PM, Rick Mangi <rick@chartbeat.com> wrote:
>=20
> I seem to have solved it by only specifying a single zookeeper node in =
my job config. Maybe a race condition of some sort?
>=20
>=20
>> On Nov 18, 2015, at 2:37 PM, Yi Pan <nickpan47@gmail.com> wrote:
>>=20
>> Hi, Rick,
>>=20
>> I think that you are running into SAMZA-754. I have a RB available =
for it
>> already. I will upload the patch and it would be good if you can try =
the
>> patch to see whether that solves your problem.
>>=20
>> -Yi
>>=20
>> On Tue, Nov 17, 2015 at 12:01 PM, Rick Mangi <rick@chartbeat.com> =
wrote:
>>=20
>>> Hi, getting things working on samza 0.10.0 finally :)
>>>=20
>>> I=E2=80=99m seeing the following error about 1/4 of the time from =
run-job.sh when
>>> starting jobs:
>>>=20
>>> [yarnmaster01] out: 2015-11-17 14:56:00 KafkaSystemAdmin$ [INFO] Got
>>> metadata: Map(__samza_coordinator_t-key-grouper_dev -> =
SystemStreamMetadata
>>> [streamName=3D__samza_coordinator_t-key-grouper_dev,
>>> partitionMetadata=3D{Partition =
[partition=3D0]=3DSystemStreamPartitionMetadata
>>> [oldestOffset=3Dnull, newestOffset=3Dnull, upcomingOffset=3D0]}])
>>> [yarnmaster01] out: Exception in thread "main"
>>> java.lang.NullPointerException
>>> [yarnmaster01] out:     at
>>> =
java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1124)
>>> [yarnmaster01] out:     at
>>> =
scala.collection.convert.Wrappers$JMapWrapperLike$class.update(Wrappers.sc=
ala:257)
>>> [yarnmaster01] out:     at
>>> =
scala.collection.convert.Wrappers$JConcurrentMapWrapper.update(Wrappers.sc=
ala:348)
>>> [yarnmaster01] out:     at
>>> =
scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
>>> [yarnmaster01] out:     at
>>> scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
>>> [yarnmaster01] out:     at
>>> =
org.apache.samza.system.kafka.KafkaSystemConsumer.register(KafkaSystemCons=
umer.scala:108)
>>> [yarnmaster01] out:     at
>>> =
org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer.regist=
er(CoordinatorStreamSystemConsumer.java:112)
>>> [yarnmaster01] out:     at
>>> org.apache.samza.job.JobRunner.run(JobRunner.scala:88)
>>> [yarnmaster01] out:     at
>>> org.apache.samza.job.JobRunner$.main(JobRunner.scala:43)
>>> [yarnmaster01] out:     at
>>> org.apache.samza.job.JobRunner.main(JobRunner.scala)
>>> [yarnmaster01] out:
>>>=20
>>>=20
>>> The same job will startup fine a minute later.
>>>=20
>=20


--Apple-Mail=_20075DF1-26C2-4F21-A719-E2464EA826FF
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----

iQEcBAEBCAAGBQJWTOK/AAoJENgofZAtxzWQZoIH/jxauqCXnCD1mfmgXvnoPjyI
q6qoLV6RGnHFavA4mcGzTcpXNrDv2M/RmXhiUseijQWI8G1CO6/zZjOzA6sVC6OY
hPtEjSGd0EkLtk63waD3ZWMe62txuF4NUraLCpZLRWi53THE11YchmuzEN7WidS5
5ds9xcZ/Z0Tj4sV6yiIGVAA41oRn4AcIvHL82iw0QlVmVOQmDyWBLr5s1LN0QO4h
EpIHAMOm1DsqCK2jX3TY/VvLbR4TxgnVWdK4qd8PgINxZTT4tjXh+AQG9hgVRVk/
6Cac8vltN5wZlEJVabjjUq5Fjw668heEQ1HLyCsrLeZEdAH+NtQiUohgyfTrQqY=
=XEiZ
-----END PGP SIGNATURE-----

--Apple-Mail=_20075DF1-26C2-4F21-A719-E2464EA826FF--