Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6F553200B6D for ; Tue, 23 Aug 2016 08:54:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 6E1F6160AA5; Tue, 23 Aug 2016 06:54:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B5E21160ABF for ; Tue, 23 Aug 2016 08:54:22 +0200 (CEST) Received: (qmail 99753 invoked by uid 500); 23 Aug 2016 06:54:21 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 99741 invoked by uid 99); 23 Aug 2016 06:54:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2016 06:54:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 6D8152C0153 for ; Tue, 23 Aug 2016 06:54:21 +0000 (UTC) Date: Tue, 23 Aug 2016 06:54:21 +0000 (UTC) From: "Manikumar Reddy (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (KAFKA-4076) Kafka broker shuts down due to irrecoverable IO error MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 23 Aug 2016 06:54:23 -0000 [ https://issues.apache.org/jira/browse/KAFKA-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432252#comment-15432252 ] Manikumar Reddy commented on KAFKA-4076: ---------------------------------------- You are storing kafka data logs to /tmp folder. This is not a good practice, since your OS may clean the tmp space. Suggest you to change the kafka log.dirs to some other valid directory. > Kafka broker shuts down due to irrecoverable IO error > ----------------------------------------------------- > > Key: KAFKA-4076 > URL: https://issues.apache.org/jira/browse/KAFKA-4076 > Project: Kafka > Issue Type: Bug > Components: log > Affects Versions: 0.9.0.0 > Reporter: Anyun > > kafka.common.KafkaStorageException: I/O exception in append to log '__consumer_offsets-48' > at kafka.log.Log.append(Log.scala:318) > at kafka.cluster.Partition$$anonfun$9.apply(Partition.scala:442) > at kafka.cluster.Partition$$anonfun$9.apply(Partition.scala:428) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.utils.CoreUtils$.inReadLock(CoreUtils.scala:268) > at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:428) > at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:401) > at kafka.server.ReplicaManager$$anonfun$appendToLocalLog$2.apply(ReplicaManager.scala:386) > at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) > at scala.collection.immutable.Map$Map1.foreach(Map.scala:109) > at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) > at scala.collection.AbstractTraversable.map(Traversable.scala:105) > at kafka.server.ReplicaManager.appendToLocalLog(ReplicaManager.scala:386) > at kafka.server.ReplicaManager.appendMessages(ReplicaManager.scala:322) > at kafka.coordinator.GroupMetadataManager.store(GroupMetadataManager.scala:227) > at kafka.coordinator.GroupCoordinator$$anonfun$doSyncGroup$3.apply(GroupCoordinator.scala:312) > at kafka.coordinator.GroupCoordinator$$anonfun$doSyncGroup$3.apply(GroupCoordinator.scala:312) > at scala.Option.foreach(Option.scala:236) > at kafka.coordinator.GroupCoordinator.doSyncGroup(GroupCoordinator.scala:312) > at kafka.coordinator.GroupCoordinator.handleSyncGroup(GroupCoordinator.scala:247) > at kafka.server.KafkaApis.handleSyncGroupRequest(KafkaApis.scala:819) > at kafka.server.KafkaApis.handle(KafkaApis.scala:82) > at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:60) > at java.lang.Thread.run(Thread.java:724) > Caused by: java.io.FileNotFoundException: /tmp/kafka-logs-new/__consumer_offsets-48/00000000000000000000.index (No such file or directory) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.(RandomAccessFile.java:241) > at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:277) > at kafka.log.OffsetIndex$$anonfun$resize$1.apply(OffsetIndex.scala:276) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.log.OffsetIndex.resize(OffsetIndex.scala:276) > at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply$mcV$sp(OffsetIndex.scala:265) > at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply(OffsetIndex.scala:265) > at kafka.log.OffsetIndex$$anonfun$trimToValidSize$1.apply(OffsetIndex.scala:265) > at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) > at kafka.log.OffsetIndex.trimToValidSize(OffsetIndex.scala:264) > at kafka.log.Log.roll(Log.scala:627) > at kafka.log.Log.maybeRoll(Log.scala:602) > at kafka.log.Log.append(Log.scala:357) > ... 24 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)