Mailing-List: contact dev-help@samza.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@samza.apache.org
From: Davide Simoncelli <netcelli.tux@gmail.com>
Content-Type: multipart/alternative;
 boundary="Apple-Mail=_E9943AB8-0054-4D7B-9B66-D1572D237EF2"
Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\))
Subject: Re: Kafka client.id collision
Date: Thu, 20 Jul 2017 15:50:37 +0100
References: <FA62D4B4-E7C2-46A5-90F1-F55BD2E33630@gmail.com>
 <CAMd3yjidzbBn-um73xi2+6L=AfrzavrDgF=e9zcXtoSh1Xvg2A@mail.gmail.com>
To: dev@samza.apache.org
In-Reply-To: <CAMd3yjidzbBn-um73xi2+6L=AfrzavrDgF=e9zcXtoSh1Xvg2A@mail.gmail.com>
Message-Id: <DBC0DCE7-7C29-431C-8D73-4059DA9D0A3F@gmail.com>
archived-at: Thu, 20 Jul 2017 14:50:48 -0000

--Apple-Mail=_E9943AB8-0054-4D7B-9B66-D1572D237EF2
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

Hi,

Thanks for the reply.

It is a warning, but the application fails. Here is the logging:


017-07-20 10:43:06.349 [main] AppInfoParser [INFO] Kafka version : =
0.10.1.1
2017-07-20 10:43:06.349 [main] AppInfoParser [INFO] Kafka commitId : =
f10ef2720b03b247
2017-07-20 10:43:06.351 [main] AppInfoParser [WARN] Error registering =
AppInfo mbean
javax.management.InstanceAlreadyExistsException: =
kafka.producer:type=3Dapp-info,id=3Dsamza_producer-wikipedia_feed-1
	at =
com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
	at =
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithReposito=
ry(DefaultMBeanServerInterceptor.java:1898)
	at =
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean=
(DefaultMBeanServerInterceptor.java:966)
	at =
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(Defau=
ltMBeanServerInterceptor.java:900)
	at =
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(Defaul=
tMBeanServerInterceptor.java:324)
	at =
com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:5=
22)
	at =
org.apache.kafka.common.utils.AppInfoParser.registerAppInfo(AppInfoParser.=
java:58)
	at =
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:=
331)
	at =
org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:=
163)
	at =
org.apache.samza.system.kafka.KafkaSystemFactory$$anonfun$3.apply(KafkaSys=
temFactory.scala:89)
	at =
org.apache.samza.system.kafka.KafkaSystemFactory$$anonfun$3.apply(KafkaSys=
temFactory.scala:89)
	at =
org.apache.samza.system.kafka.KafkaSystemProducer.send(KafkaSystemProducer=
.scala:144)
	at =
org.apache.samza.coordinator.stream.CoordinatorStreamSystemProducer.send(C=
oordinatorStreamSystemProducer.java:113)
	at =
org.apache.samza.coordinator.stream.CoordinatorStreamWriter.sendSetConfigM=
essage(CoordinatorStreamWriter.java:98)
	at =
org.apache.samza.coordinator.stream.CoordinatorStreamWriter.sendMessage(Co=
ordinatorStreamWriter.java:82)
	at =
org.apache.samza.job.yarn.SamzaYarnAppMasterService.onInit(SamzaYarnAppMas=
terService.scala:68)
	at =
org.apache.samza.job.yarn.YarnClusterResourceManager.start(YarnClusterReso=
urceManager.java:180)
	at =
org.apache.samza.clustermanager.ContainerProcessManager.start(ContainerPro=
cessManager.java:167)
	at =
org.apache.samza.clustermanager.ClusterBasedJobCoordinator.run(ClusterBase=
dJobCoordinator.java:154)
	at =
org.apache.samza.clustermanager.ClusterBasedJobCoordinator.main(ClusterBas=
edJobCoordinator.java:222)
2017-07-20 10:43:06.549 [main] CoordinatorStreamWriter [INFO] Stopping =
the coordinator stream producer.
2017-07-20 10:43:06.549 [main] CoordinatorStreamSystemProducer [INFO] =
Stopping coordinator stream producer.
2017-07-20 10:43:06.549 [main] KafkaProducer [INFO] Closing the Kafka =
producer with timeoutMillis =3D 9223372036854775807 ms.


> On 20 Jul 2017, at 3:16 pm, Jagadish Venkatraman =
<jagadish1989@gmail.com> wrote:
>=20
> Hi Davide,
>=20
> Is this logged as an error or as a warning?
>=20
> IIUC, this warning should not fail the job. It may not cause some =
Mbean
> sensors / metrics emitted from Kafka to be correctly reported (since, =
those
> are reported per-clientId).
>=20
> The job should still continue to run.
>=20
> The entire log file will be helpful for further debugging!
>=20
> On Thu, Jul 20, 2017 at 3:32 AM, Davide Simoncelli =
<netcelli.tux@gmail.com <mailto:netcelli.tux@gmail.com>>
> wrote:
>=20
>> Hello,
>>=20
>> We are running Kafka 0.10.1.1 in production. Unfortunately the Samza =
app
>> fails to start because of this bug: https://issues.apache.org/ =
<https://issues.apache.org/>
>> jira/browse/SAMZA-1027 =
<https://issues.apache.org/jira/browse/SAMZA-1027 =
<https://issues.apache.org/jira/browse/SAMZA-1027>>.
>>=20
>> Even hello-samza on YARN fails to start. Here its the error:
>>=20
>> javax.management.InstanceAlreadyExistsException:
>> kafka.producer:type=3Dapp-info,id=3Dsamza_producer-wikipedia_feed-1
>>        at com.sun.jmx.mbeanserver.Repository.addMBean(
>> Repository.java:437)
>>        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.
>> registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
>>        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.
>> registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
>>        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.
>> registerObject(DefaultMBeanServerInterceptor.java:900)
>>        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.
>> registerMBean(DefaultMBeanServerInterceptor.java:324)
>>        at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(
>> JmxMBeanServer.java:522)
>>        at =
org.apache.kafka.common.utils.AppInfoParser.registerAppInfo(
>> AppInfoParser.java:58)
>>        at org.apache.kafka.clients.producer.KafkaProducer.<init>(
>> KafkaProducer.java:331)
>>        at org.apache.kafka.clients.producer.KafkaProducer.<init>(
>> KafkaProducer.java:163)
>>        at =
org.apache.samza.system.kafka.KafkaSystemFactory$$anonfun$3.
>> apply(KafkaSystemFactory.scala:89)
>>        at =
org.apache.samza.system.kafka.KafkaSystemFactory$$anonfun$3.
>> apply(KafkaSystemFactory.scala:89)
>>        at org.apache.samza.system.kafka.KafkaSystemProducer.send(
>> KafkaSystemProducer.scala:144)
>>        at org.apache.samza.coordinator.stream.
>> CoordinatorStreamSystemProducer.send(CoordinatorStreamSystemProduce
>> r.java:113)
>>        at =
org.apache.samza.coordinator.stream.CoordinatorStreamWriter.
>> sendSetConfigMessage(CoordinatorStreamWriter.java:98)
>>        at =
org.apache.samza.coordinator.stream.CoordinatorStreamWriter.
>> sendMessage(CoordinatorStreamWriter.java:82)
>>        at org.apache.samza.job.yarn.SamzaYarnAppMasterService.onInit(
>> SamzaYarnAppMasterService.scala:68)
>>        at org.apache.samza.job.yarn.YarnClusterResourceManager.start(
>> YarnClusterResourceManager.java:180)
>>        at =
org.apache.samza.clustermanager.ContainerProcessManager.start(
>> ContainerProcessManager.java:167)
>>        at =
org.apache.samza.clustermanager.ClusterBasedJobCoordinator.run(
>> ClusterBasedJobCoordinator.java:154)
>>        at org.apache.samza.clustermanager.ClusterBasedJobCoordinator.
>> main(ClusterBasedJobCoordinator.java:222)
>>=20
>>=20
>> According to samza-job-coordinator.log file, it is creating two =
producers
>> with the same client ID:
>>=20
>> 2017-07-20 04:03:12.208 [main] KafkaSystemProducer [INFO] Creating a =
new
>> producer for system kafka.
>> 2017-07-20 04:03:12.224 [main] ProducerConfig [INFO] ProducerConfig =
values:
>>        acks =3D 1
>>        batch.size =3D 16384
>>        block.on.buffer.full =3D false
>>        buffer.memory =3D 33554432
>>        client.id =3D samza_producer-wikipedia_feed-1
>>=20
>>=20
>> 2017-07-20 04:03:13.510 [main] KafkaSystemProducer [INFO] Creating a =
new
>> producer for system kafka.
>> 2017-07-20 04:03:13.510 [main] ProducerConfig [INFO] ProducerConfig =
values:
>>        acks =3D 1
>>        batch.size =3D 16384
>>        block.on.buffer.full =3D false
>>        buffer.memory =3D 33554432
>>        client.id =3D samza_producer-wikipedia_feed-1
>>        compression.type =3D none
>>=20
>> Any idea why it is happening?
>>=20
>> Thanks
>>=20
>> Davide
>=20
>=20
>=20
>=20
> --=20
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University


--Apple-Mail=_E9943AB8-0054-4D7B-9B66-D1572D237EF2--