Return-Path: X-Original-To: apmail-kafka-dev-archive@www.apache.org Delivered-To: apmail-kafka-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F00629592 for ; Wed, 9 Jan 2013 17:06:12 +0000 (UTC) Received: (qmail 90411 invoked by uid 500); 9 Jan 2013 17:06:12 -0000 Delivered-To: apmail-kafka-dev-archive@kafka.apache.org Received: (qmail 90376 invoked by uid 500); 9 Jan 2013 17:06:12 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 90368 invoked by uid 99); 9 Jan 2013 17:06:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jan 2013 17:06:12 +0000 Date: Wed, 9 Jan 2013 17:06:12 +0000 (UTC) From: "John Fung (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (KAFKA-662) Create testcases for unclean shut down MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/KAFKA-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13548683#comment-13548683 ] John Fung commented on KAFKA-662: --------------------------------- 1. testcase_9071 - This testcase is to test the basic behavior of unclean shutdown where no log truncation takes place. B1 B2 ======= ======= a. Both brokers are up running b. Send 5 messages m0 m0 m1 m1 m2 m2 m3 m3 m4 m4 c. Shut down B2 d. Send 5 messages m5 m6 m7 m8 m9 e. Shut down B1 (B1 & B2 are both down) f. Sleep 5 seconds g. Start B2 (B1 is still down) h. Send 5 messages m10 m11 m12 m13 m14 i. Start B1 (both B1 & B2 are up running) Recovering ... j. Since there are no discrepancy in no. of messages maintained by the internal "index", there will not be any log truncation: m0 m0 m1 m1 m2 m2 m3 m3 m4 m4 m5 m10 m6 m11 m7 m12 m8 m13 m9 m14 $ bin/kafka-run-class.sh kafka.tools.DumpLogSegments --print-data-log --files /tmp/kafka_server_1_logs/t001-0/00000000000000000000.log Dumping /tmp/kafka_server_1_logs/t001-0/00000000000000000000.log Starting offset: 0 offset: 0 position: 0 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 2307843899 payload: Topic:t001:ThreadID:0:MessageID:0000000000 offset: 1 position: 126 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 3770868426 payload: Topic:t001:ThreadID:0:MessageID:0000000001 offset: 2 position: 252 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1528229081 payload: Topic:t001:ThreadID:0:MessageID:0000000002 offset: 3 position: 378 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 844818728 payload: Topic:t001:ThreadID:0:MessageID:0000000003 offset: 4 position: 504 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 4157601470 payload: Topic:t001:ThreadID:0:MessageID:0000000004 offset: 5 position: 630 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 2659447631 payload: Topic:t001:ThreadID:0:MessageID:0000000005 offset: 6 position: 756 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 626523484 payload: Topic:t001:ThreadID:0:MessageID:0000000006 offset: 7 position: 882 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1276901549 payload: Topic:t001:ThreadID:0:MessageID:0000000007 offset: 8 position: 1008 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1963770929 payload: Topic:t001:ThreadID:0:MessageID:0000000008 offset: 9 position: 1134 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 474005952 payload: Topic:t001:ThreadID:0:MessageID:0000000009 $ bin/kafka-run-class.sh kafka.tools.DumpLogSegments --print-data-log --files /tmp/kafka_server_2_logs/t001-0/00000000000000000000.log Dumping /tmp/kafka_server_2_logs/t001-0/00000000000000000000.log Starting offset: 0 offset: 0 position: 0 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 2307843899 payload: Topic:t001:ThreadID:0:MessageID:0000000000 offset: 1 position: 126 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 3770868426 payload: Topic:t001:ThreadID:0:MessageID:0000000001 offset: 2 position: 252 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1528229081 payload: Topic:t001:ThreadID:0:MessageID:0000000002 offset: 3 position: 378 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 844818728 payload: Topic:t001:ThreadID:0:MessageID:0000000003 offset: 4 position: 504 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 4157601470 payload: Topic:t001:ThreadID:0:MessageID:0000000004 offset: 5 position: 630 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1130195380 payload: Topic:t001:ThreadID:0:MessageID:0000000010 offset: 6 position: 756 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 705784901 payload: Topic:t001:ThreadID:0:MessageID:0000000011 offset: 7 position: 882 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 2445632086 payload: Topic:t001:ThreadID:0:MessageID:0000000012 offset: 8 position: 1008 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 4169754535 payload: Topic:t001:ThreadID:0:MessageID:0000000013 offset: 9 position: 1134 isvalid: true payloadsize: 100 magic: 0 compresscodec: NoCompressionCodec crc: 1025275953 payload: Topic:t001:ThreadID:0:MessageID:0000000014 > Create testcases for unclean shut down > -------------------------------------- > > Key: KAFKA-662 > URL: https://issues.apache.org/jira/browse/KAFKA-662 > Project: Kafka > Issue Type: Task > Reporter: John Fung > Assignee: John Fung > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira