kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siddhartha Singh Sandhu <sandhus...@gmail.com>
Subject Corrupted Message Issue
Date Fri, 02 Oct 2015 19:27:04 GMT
Hi,

I am receiving this in the server logs.
[2015-10-02 17:58:31,726] ERROR [KafkaApi-0] Error processing
ProducerRequest with correlation id 103815 from client
prod-dcs-stats-producer-1034 on partition [prod-dcs-stats,0]
(kafka.server.KafkaApis)
kafka.message.InvalidMessageException: Message is corrupt (stored crc =
423648070, computed crc = 1402134007)
at kafka.message.Message.ensureValid(Message.scala:166)
at
kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:327)
at
kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:315)
at scala.collection.Iterator$class.foreach(Iterator.scala:772)
at kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:32)
at kafka.log.Log.analyzeAndValidateMessageSet(Log.scala:315)
at kafka.log.Log.append(Log.scala:228)
at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:354)
at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:285)
at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:275)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
at scala.collection.Iterator$class.foreach(Iterator.scala:772)
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157)
at
scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.HashMap.map(HashMap.scala:45)
at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:275)
at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:201)
at kafka.server.KafkaApis.handle(KafkaApis.scala:68)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:744)

What are potential ways in which a message can be corrupted?

Thank you for your time.
-Khris

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message