kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manikumar Reddy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-4076) Kafka broker shuts down due to irrecoverable IO error
Date Tue, 23 Aug 2016 06:54:21 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432252#comment-15432252
] 

Manikumar Reddy commented on KAFKA-4076:
----------------------------------------

You are storing kafka data logs to /tmp folder. This is not a good practice,  since your OS
may clean the tmp space.
Suggest you to change the kafka log.dirs  to some other valid directory.

> Kafka broker shuts down due to irrecoverable IO error
> -----------------------------------------------------
>
>                 Key: KAFKA-4076
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4076
>             Project: Kafka
>          Issue Type: Bug
>          Components: log
>    Affects Versions: 0.9.0.0
>            Reporter: Anyun 
>
> kafka.common.KafkaStorageException: I/O exception in append to log '__consumer_offsets-48'
>         at kafka.log.Log.append(Log.scala:318)
>         at kafka.cluster.Partition$$anonfun$9.apply(Partition.scala:442)
>         at kafka.cluster.Partition$$anonfun$9.apply(Partition.scala:428)
>         at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
>         at kafka.utils.CoreUtils$.inReadLock(CoreUtils.scala:268)
>         at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:428)
>         at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:401)
>         at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:386)
>         at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
>         at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
>         at scala.collection.immutable.Map$Map1.foreach(Map.scala:109)
>         at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
>         at scala.collection.AbstractTraversable.map(Traversable.scala:105)
>         at kafka.server.ReplicaManager.appendToLocalLog(ReplicaManager.scala:386)
>         at kafka.server.ReplicaManager.appendMessages(ReplicaManager.scala:322)
>         at kafka.coordinator.GroupMetadataManager.store(GroupMetadataManager.scala:227)
>         at kafka.coordinator.GroupCoordinator$$anonfun$doSyncGroup$3.apply(GroupCoordinator.scala:312)
>         at kafka.coordinator.GroupCoordinator$$anonfun$doSyncGroup$3.apply(GroupCoordinator.scala:312)
>         at scala.Option.foreach(Option.scala:236)
>         at kafka.coordinator.GroupCoordinator.doSyncGroup(GroupCoordinator.scala:312)
>         at kafka.coordinator.GroupCoordinator.handleSyncGroup(GroupCoordinator.scala:247)
>         at kafka.server.KafkaApis.handleSyncGroupRequest(KafkaApis.scala:819)
>         at kafka.server.KafkaApis.handle(KafkaApis.scala:82)
>         at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:60)
>         at java.lang.Thread.run(Thread.java:724)
> Caused by: java.io.FileNotFoundException: /tmp/kafka-logs-new/__consumer_offsets-48/00000000000000000000.index
(No such file or directory)
>         at java.io.RandomAccessFile.open(Native Method)
>         at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>         at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:277)
>         at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:276)
>         at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
>         at kafka.log.OffsetIndex.resize(OffsetIndex.scala:276)
>         at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply$mcV$sp(OffsetIndex.scala:265)
>         at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply(OffsetIndex.scala:265)
>         at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply(OffsetIndex.scala:265)
>         at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
>         at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:264)
>         at kafka.log.Log.roll(Log.scala:627)
>         at kafka.log.Log.maybeRoll(Log.scala:602)
>         at kafka.log.Log.append(Log.scala:357)
>         ... 24 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message