Return-Path: X-Original-To: apmail-kafka-users-archive@www.apache.org Delivered-To: apmail-kafka-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E918110465 for ; Mon, 14 Oct 2013 17:01:05 +0000 (UTC) Received: (qmail 560 invoked by uid 500); 14 Oct 2013 17:01:05 -0000 Delivered-To: apmail-kafka-users-archive@kafka.apache.org Received: (qmail 517 invoked by uid 500); 14 Oct 2013 17:00:59 -0000 Mailing-List: contact users-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@kafka.apache.org Delivered-To: mailing list users@kafka.apache.org Received: (qmail 509 invoked by uid 99); 14 Oct 2013 17:00:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Oct 2013 17:00:57 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of gargmoni03@gmail.com designates 209.85.223.177 as permitted sender) Received: from [209.85.223.177] (HELO mail-ie0-f177.google.com) (209.85.223.177) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Oct 2013 17:00:50 +0000 Received: by mail-ie0-f177.google.com with SMTP id e14so9176195iej.8 for ; Mon, 14 Oct 2013 10:00:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=VHqZGOcPfXxbt47BrOYDDmbtAro805ruaivD0y4CkBk=; b=cZnKVLyFSrImDkMstVXFg3fUs9tb/UKdugA9+HSKbYIBpE6LsGbMZ4ICCyBm2VlbST Ves9UBhJPpqqCMp6wWrbEz1TyQGxC1fv3AaR4c7H2op2xLPvoxgviE2iDqhKFnWafgP1 0UV5tmabI5PcqWDV1buIvMTNaStiO2OZujJx+bu8G5KbQOC2WdoQzTJD3NxQ+9fP94aC XvCZuDZr91/5Pn6tjEU3Nh9cuJRrORVdKaUwuAu9RR9laGlYy5wz+MCuI5P6uKfuN9e0 o1AC/5IKsODh/YGw946YSm2cOlGxnv6BH+Y/SfqLPxJw0BSPr2r+d0hc6KSM1v49pN4u QkRA== MIME-Version: 1.0 X-Received: by 10.50.78.162 with SMTP id c2mr14115511igx.20.1381770029431; Mon, 14 Oct 2013 10:00:29 -0700 (PDT) Received: by 10.64.252.71 with HTTP; Mon, 14 Oct 2013 10:00:29 -0700 (PDT) In-Reply-To: References: Date: Mon, 14 Oct 2013 22:30:29 +0530 Message-ID: Subject: Re: Messages from producer are immediately going to /tmp/logs in kafka From: Monika Garg To: users@kafka.apache.org Content-Type: multipart/alternative; boundary=089e0111e074c40a9004e8b667b1 X-Virus-Checked: Checked by ClamAV on apache.org --089e0111e074c40a9004e8b667b1 Content-Type: text/plain; charset=ISO-8859-1 Thanks for replying Jun. I also thought the same. But I got the same messages in my /kafka/logs dir even after rebooting my machine in less than the time given by log.flush.interval.ms=900000. So can you please suggest me any way to check that messages are actually loosing after machine shutdown? On Fri, Oct 11, 2013 at 8:56 PM, Jun Rao wrote: > Those messages could still be in file system pagecache and may not be > flushed to disks. > > Thanks, > > Jun > > > On Thu, Oct 10, 2013 at 11:20 PM, Monika Garg > wrote: > > > Hi, > > > > In kafka-0.8 there are three important properties given for > > > > log.flush.interval.messages=10000 > > > > log.flush.interval.ms=900000 > > > > log.flush.scheduler.interval.ms=900000 > > > > I have set the above properties as I have mentioned above.Then I started > > Kafka Console Producer given with kafka bundle-0.8 and gave some > > messages.The message are going to log partitions of given topic > > immediately. > > > > I am confused why the messages are flushing to /tmp/logs immediately,They > > should wait as per log.flush.interval.messages= > > 10000 or log.flush.interval.ms=900000. > > > > Please check. > > > > -- > > *Moniii* > > > > > > > > -- > > *Moniii* > > > -- *Moniii* --089e0111e074c40a9004e8b667b1--