samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Pan <nickpa...@gmail.com>
Subject Re: Sporadic errors in JobRunner
Date Wed, 18 Nov 2015 19:37:21 GMT
Hi, Rick,

I think that you are running into SAMZA-754. I have a RB available for it
already. I will upload the patch and it would be good if you can try the
patch to see whether that solves your problem.

-Yi

On Tue, Nov 17, 2015 at 12:01 PM, Rick Mangi <rick@chartbeat.com> wrote:

> Hi, getting things working on samza 0.10.0 finally :)
>
> I’m seeing the following error about 1/4 of the time from run-job.sh when
> starting jobs:
>
> [yarnmaster01] out: 2015-11-17 14:56:00 KafkaSystemAdmin$ [INFO] Got
> metadata: Map(__samza_coordinator_t-key-grouper_dev -> SystemStreamMetadata
> [streamName=__samza_coordinator_t-key-grouper_dev,
> partitionMetadata={Partition [partition=0]=SystemStreamPartitionMetadata
> [oldestOffset=null, newestOffset=null, upcomingOffset=0]}])
> [yarnmaster01] out: Exception in thread "main"
> java.lang.NullPointerException
> [yarnmaster01] out:     at
> java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1124)
> [yarnmaster01] out:     at
> scala.collection.convert.Wrappers$JMapWrapperLike$class.update(Wrappers.scala:257)
> [yarnmaster01] out:     at
> scala.collection.convert.Wrappers$JConcurrentMapWrapper.update(Wrappers.scala:348)
> [yarnmaster01] out:     at
> scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)
> [yarnmaster01] out:     at
> scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)
> [yarnmaster01] out:     at
> org.apache.samza.system.kafka.KafkaSystemConsumer.register(KafkaSystemConsumer.scala:108)
> [yarnmaster01] out:     at
> org.apache.samza.coordinator.stream.CoordinatorStreamSystemConsumer.register(CoordinatorStreamSystemConsumer.java:112)
> [yarnmaster01] out:     at
> org.apache.samza.job.JobRunner.run(JobRunner.scala:88)
> [yarnmaster01] out:     at
> org.apache.samza.job.JobRunner$.main(JobRunner.scala:43)
> [yarnmaster01] out:     at
> org.apache.samza.job.JobRunner.main(JobRunner.scala)
> [yarnmaster01] out:
>
>
> The same job will startup fine a minute later.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message