Return-Path: X-Original-To: apmail-kafka-users-archive@www.apache.org Delivered-To: apmail-kafka-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B06EC10B55 for ; Tue, 15 Oct 2013 04:49:58 +0000 (UTC) Received: (qmail 83428 invoked by uid 500); 15 Oct 2013 04:49:58 -0000 Delivered-To: apmail-kafka-users-archive@kafka.apache.org Received: (qmail 83275 invoked by uid 500); 15 Oct 2013 04:49:53 -0000 Mailing-List: contact users-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@kafka.apache.org Delivered-To: mailing list users@kafka.apache.org Received: (qmail 83267 invoked by uid 99); 15 Oct 2013 04:49:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Oct 2013 04:49:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of kane.isturm@gmail.com designates 209.85.212.178 as permitted sender) Received: from [209.85.212.178] (HELO mail-wi0-f178.google.com) (209.85.212.178) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Oct 2013 04:49:48 +0000 Received: by mail-wi0-f178.google.com with SMTP id hn9so940939wib.17 for ; Mon, 14 Oct 2013 21:49:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=Y/UeHW6YINEwCshwQsAhoufIBL89WwSta7KUuoVOiQQ=; b=T7THwQkDkeOqSyLIAQHv43z9q4msNk5oI07hkEisu3+Y46DT+Vq0QL9urhtg5bBUSD vmTXuj20/3t4uEmB7ZBDuqPQnsBzGxTQa75IKiD74dJAzNB/k59BmNxjSvJvB1Ka7Eaf F7z/mQmn/duNwmYMl2RJWlFFsw/xS5ze0pxIw8Ay4MqjT51mpUYWhPZcCW4NRngYv8ZO MgCc3ltxVfhyjJO1Wto9dmZ84YrKxlAbl3fNCY3CRXJtYv4SYv7faSvkCkhoTVX4V9WZ FbzbE3ZKGz8FcGaG7LDUzMEJytKwyfAoWP0J3TSNA9SFtXFdaXD+QsCV7gFhud0NiMuB JtGQ== X-Received: by 10.180.185.145 with SMTP id fc17mr15921054wic.60.1381812567609; Mon, 14 Oct 2013 21:49:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.227.142.74 with HTTP; Mon, 14 Oct 2013 21:49:07 -0700 (PDT) In-Reply-To: References: From: Kane Kane Date: Mon, 14 Oct 2013 21:49:07 -0700 Message-ID: Subject: Re: unclean shutdown To: users@kafka.apache.org Content-Type: multipart/alternative; boundary=001a11c354983d171b04e8c04fad X-Virus-Checked: Checked by ClamAV on apache.org --001a11c354983d171b04e8c04fad Content-Type: text/plain; charset=ISO-8859-1 I couldn't reproduce it yet, I'm rolling out the fresh install and trying to do so. On Mon, Oct 14, 2013 at 8:40 PM, Jun Rao wrote: > Is this issue reproducible? > > Thanks, > > Jun > > > On Mon, Oct 14, 2013 at 8:30 PM, Kane Kane wrote: > > > Yes, my expectation would be that broker will try to restore or delete it > > itself. > > > > > > On Mon, Oct 14, 2013 at 5:55 PM, Sriram Subramanian < > > srsubramanian@linkedin.com> wrote: > > > > > Is this a bug? Can an unclean shutdown leave the index in a corrupt > state > > > that the broker cannot start (expected state)? > > > > > > On 10/14/13 4:52 PM, "Neha Narkhede" wrote: > > > > > > > It is possible that the unclean broker shutdown left the index in an > > > >inconsistent state. You can delete the corrupted index files, that > will > > > >make the Kafka server rebuild the index on startup. > > > > > > > >Thanks, > > > >Neha > > > > > > > > > > > >On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane > > wrote: > > > > > > > >> After unclean shutdown kafka reports this error on startup: > > > >> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable > > > >> startup. Prepare to shutdown (kafka.server.KafkaServerStartable) > > > >> java.lang.IllegalArgumentException: requirement failed: Corrupt > index > > > >> found, index file > > > >>(/disk1/kafka-logs/perf2-22/00000000000000000000.index) > > > >> has non-zero size but the last offset is 0 and the base offset is 0 > > > >> > > > >> How it's supposed to bring broker back after unclean shutdown? > > > >> > > > >> Thanks. > > > >> > > > > > > > > > --001a11c354983d171b04e8c04fad--