Return-Path: 
 <user-return-18854-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org>
X-Original-To: apmail-cassandra-user-archive@www.apache.org
Delivered-To: apmail-cassandra-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 93AC178CD
	for <apmail-cassandra-user-archive@www.apache.org>;
 Mon, 18 Jul 2011 17:52:39 +0000 (UTC)
Received: (qmail 73826 invoked by uid 500); 18 Jul 2011 17:52:36 -0000
Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org
Received: (qmail 73768 invoked by uid 500); 18 Jul 2011 17:52:36 -0000
Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@cassandra.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@cassandra.apache.org>
List-Post: <mailto:user@cassandra.apache.org>
List-Id: <user.cassandra.apache.org>
Reply-To: user@cassandra.apache.org
Delivered-To: mailing list user@cassandra.apache.org
Received: (qmail 73760 invoked by uid 99); 18 Jul 2011 17:52:36 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jul 2011 17:52:36 +0000
X-ASF-Spam-Status: No, hits=4.3 required=5.0
	tests=FREEMAIL_FROM,FREEMAIL_REPLY,HTML_FONT_FACE_BAD,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of dretzlaff@gmail.com designates
 74.125.82.172 as permitted sender)
Received: from [74.125.82.172] (HELO mail-wy0-f172.google.com) (74.125.82.172)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jul 2011 17:52:22 +0000
Received: by wyj26 with SMTP id 26so1539670wyj.31
        for <user@cassandra.apache.org>; Mon, 18 Jul 2011 10:52:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=pvCJuUPBSIkT8LAcBHpzSfm+EFEM0i3y4bOGOky5Nqw=;
        b=K4diEcyKd+hI3AT/haVIZHEslIhxpxgEscOcb1QEsET3F4eO4qyKSQkNA3USY27hgi
         XBNv11bfJIJNcE6p4OOXy0QdH/2G3uv0QMJzpXCoQb7zke7S0rdue7njF6gygb4ug1+x
         acIQVpXCASEQU3oxLjRpJ5GFCipJ15SquZKkA=
MIME-Version: 1.0
Received: by 10.217.4.66 with SMTP id t44mr3313564wes.25.1311011521602; Mon,
 18 Jul 2011 10:52:01 -0700 (PDT)
Received: by 10.216.173.9 with HTTP; Mon, 18 Jul 2011 10:52:01 -0700 (PDT)
In-Reply-To: 
 <7DA4B654C7FEB24C9998EE4867BEE93EBEABDD@CNMAIL12.cn.utstarcom.com>
References: <7DA4B654C7FEB24C9998EE4867BEE93EBEABA1@CNMAIL12.cn.utstarcom.com>
	<CAFisTNasMmjUCeoJvTCNV3O89b+3PnXOv1JOH9mQ_VLN41NjCQ@mail.gmail.com>
	<7DA4B654C7FEB24C9998EE4867BEE93EBEABDD@CNMAIL12.cn.utstarcom.com>
Date: Mon, 18 Jul 2011 10:52:01 -0700
Message-ID: 
 <CAH0XANbS_9Yvk1OTeTO0JHi9Xm_fuQohqoGqxb74L0J-OCcEfQ@mail.gmail.com>
Subject: Re: gossiper problem
From: Dan Retzlaff <dretzlaff@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=20cf301fb9050aa3a204a85ba84c
X-Virus-Checked: Checked by ClamAV on apache.org

--20cf301fb9050aa3a204a85ba84c
Content-Type: text/plain; charset=GB2312
Content-Transfer-Encoding: quoted-printable

Donna,

I bet it's this issue which we encountered on 0.6.5:
https://issues.apache.org/jira/browse/CASSANDRA-1494

Basically, a runtime exception killed the gossiper thread and caused that
infinite loop. You can upgrade to the latest 0.6 to solve it.

Dan

2011/7/14 Donna Li <donna.li@utstar.com>

> ** ** **
>
> ** **
>
> The following log is GC log of 10.63.61.71, 10.63.61.72-10.63.61.74 have
> no GC on date **2011-07-13**. ****
>
> 10.63.61.71 and 10.63.61.72 are seed nodes.****
>
> My cassandra version is **0.6.3**, and the configuration about gc on
> storage_conf.xml is ****
>
> <GCGraceSeconds>864000</GCGraceSeconds>****
>
> ** **
>
> JVM configuration is as following:****
>
> JVM_OPTS=3D" \****
>
>         -ea \****
>
>         -Xms**256M** \****
>
>         -Xmx**1G** \****
>
>         -XX:+UseParNewGC \****
>
>         -XX:+UseConcMarkSweepGC \****
>
>         -XX:+CMSParallelRemarkEnabled \****
>
>         -XX:SurvivorRatio=3D8 \****
>
>         -XX:MaxTenuringThreshold=3D1 \****
>
>         -XX:+HeapDumpOnOutOfMemoryError \****
>
>         -Dcom.sun.management.jmxremote.port=3D8080 \****
>
>         -Dcom.sun.management.jmxremote.ssl=3Dfalse \****
>
>         -Dcom.sun.management.jmxremote.authenticate=3Dfalse"****
>
> ** **
>
> Can I decrease the JVM_OPTS to =A8CXms**128M** =A8CXmx**512M** to avoid s=
wap,
> the data saved in cassandra is small, I do not need so much memory.****
>
> ** **
>
> INFO [GC inspection] 2011-07-13 03:12:06,153 GCInspector.java (line 110) =
GC
> for ConcurrentMarkSweep: 1097 ms, 371528920 reclaimed leaving 17677528 us=
ed;
> max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 03:12:07,351 GCInspector.java (line 110)
> GC for ParNew: 466 ms, 20619976 reclaimed leaving 157240232 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 03:25:54,378 GCInspector.java (line 110)
> GC for ParNew: 283 ms, 26850072 reclaimed leaving 154180424 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 06:29:58,092 GCInspector.java (line 110)
> GC for ParNew: 538 ms, 17358792 reclaimed leaving 222959936 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 09:48:33,379 GCInspector.java (line 110)
> GC for ParNew: 547 ms, 22483632 reclaimed leaving 291693248 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 10:44:57,435 GCInspector.java (line 110)
> GC for ParNew: 1621 ms, 9916072 reclaimed leaving 402812912 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 10:45:14,598 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 12561 ms, 382596784 reclaimed leaving 1705660=
8
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 10:50:24,947 GCInspector.java (line 110)
> GC for ParNew: 1186 ms, 23912976 reclaimed leaving 153561960 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 11:50:50,150 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 253 ms, 403457896 reclaimed leaving 16975080
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 12:56:27,178 GCInspector.java (line 110)
> GC for ParNew: 359 ms, 21478776 reclaimed leaving 390794352 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 14:33:24,143 GCInspector.java (line 110)
> GC for ParNew: 658 ms, 26563640 reclaimed leaving 93002800 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 14:39:52,280 GCInspector.java (line 110)
> GC for ParNew: 449 ms, 26268648 reclaimed leaving 93554288 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 14:56:37,596 GCInspector.java (line 110)
> GC for ParNew: 1247 ms, 14271008 reclaimed leaving 239807832 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 15:14:47,254 GCInspector.java (line 110)
> GC for ParNew: 303 ms, 3355464 reclaimed leaving 408815760 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 15:14:47,255 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 11719 ms, 387618656 reclaimed leaving 2119710=
4
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 15:56:57,674 GCInspector.java (line 110)
> GC for ParNew: 4566 ms, 21030184 reclaimed leaving 166815416 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 16:03:24,392 GCInspector.java (line 110)
> GC for ParNew: 254 ms, 22468136 reclaimed leaving 305100176 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 16:03:37,105 GCInspector.java (line 110)
> GC for ParNew: 3953 ms, 18264560 reclaimed leaving 344948328 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 16:08:50,476 GCInspector.java (line 110)
> GC for ParNew: 2038 ms, 18900864 reclaimed leaving 416409032 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 16:09:29,023 GCInspector.java (line 110)
> GC for ParNew: 347 ms, 27133904 reclaimed leaving 52726592 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 16:15:21,151 GCInspector.java (line 110)
> GC for ParNew: 250 ms, 26106864 reclaimed leaving 53400456 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 17:02:33,948 GCInspector.java (line 110)
> GC for ParNew: 253 ms, 20448152 reclaimed leaving 226672208 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 17:38:34,250 GCInspector.java (line 110)
> GC for ParNew: 456 ms, 22461776 reclaimed leaving 363131080 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 18:02:24,432 GCInspector.java (line 110)
> GC for ParNew: 226 ms, 21273048 reclaimed leaving 156029352 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 18:08:25,259 GCInspector.java (line 110)
> GC for ParNew: 1077 ms, 8876672 reclaimed leaving 299731248 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 18:44:24,703 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 449 ms, 380503216 reclaimed leaving 17038144
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:20:09,714 GCInspector.java (line 110)
> GC for ParNew: 353 ms, 26769688 reclaimed leaving 436912856 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:20:36,022 GCInspector.java (line 110)
> GC for ParNew: 7706 ms, 18728880 reclaimed leaving 478596160 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:21:41,233 GCInspector.java (line 110)
> GC for ParNew: 903 ms, 21769296 reclaimed leaving 516347064 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:21:41,246 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 63440 ms, 495156848 reclaimed leaving 2119021=
6
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:22:54,033 GCInspector.java (line 110)
> GC for ParNew: 232 ms, 26753464 reclaimed leaving 54874568 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:24:08,813 GCInspector.java (line 110)
> GC for ParNew: 1673 ms, 25808320 reclaimed leaving 123027728 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:24:16,498 GCInspector.java (line 110)
> GC for ParNew: 7515 ms, 11078160 reclaimed leaving 138793320 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:25:44,602 GCInspector.java (line 110)
> GC for ParNew: 222 ms, 26316512 reclaimed leaving 139425816 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:26:16,958 GCInspector.java (line 110)
> GC for ParNew: 265 ms, 27367784 reclaimed leaving 138927792 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:27:37,065 GCInspector.java (line 110)
> GC for ParNew: 264 ms, 26687704 reclaimed leaving 138982208 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:32:59,096 GCInspector.java (line 110)
> GC for ParNew: 1131 ms, 22081488 reclaimed leaving 244346808 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-13 22:44:36,817 GCInspector.java (line 110)
> GC for ParNew: 380 ms, 22375728 reclaimed leaving 348001304 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-14 00:26:27,381 GCInspector.java (line 110)
> GC for ParNew: 3116 ms, 9875432 reclaimed leaving 300588328 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-14 00:44:30,918 GCInspector.java (line 110)
> GC for ParNew: 2434 ms, 12998784 reclaimed leaving 417469656 used; max is
> 1187840000****
>
>  INFO [GC inspection] 2011-07-14 01:26:35,149 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 457 ms, 502581896 reclaimed leaving 17225448
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-14 04:54:53,268 GCInspector.java (line 110)
> GC for ConcurrentMarkSweep: 278 ms, 407773688 reclaimed leaving 17250640
> used; max is 1187840000****
>
>  INFO [GC inspection] 2011-07-14 07:08:25,240 GCInspector.java (line 110)
> GC for ParNew: 774 ms, 8645712 reclaimed leaving 368647304 used; max is
> 1187840000****
>
> ** **
>
> Thanks****
>
> Donna li****
>  ------------------------------
>
> *=B7=A2=BC=FE=C8=CB:* Vijay [mailto:vijay2win@gmail.com]
> *=B7=A2=CB=CD=CA=B1=BC=E4:* **2011=C4=EA7=D4=C215=C8=D5** 9:27
> *=CA=D5=BC=FE=C8=CB:* **user@cassandra.apache.org**
> *=D6=F7=CC=E2:* Re: gossiper problem****
>
> ** **
>
> How about GC logs, what are your pause times? JVM settings might help....=
*
> ***
>
> If you are not sure how to enable GC logs check cassandra.yaml look
> for application pause times. it is highly recommended not to swap -- incl=
ude
> JNA jar.****
>
>
> Regards,
> </VJ>
>
>
> ****
>
> On Thu, Jul 14, 2011 at 1:42 AM, Donna Li <donna.li@utstar.com> wrote:***=
*
>
> All:****
>
> I have four cassandra servers in cluster. I do not restart any one of the
> servers, why the following print show the four servers restart many times=
?
> What is the possible reason? The connection between the four server=A1=AF=
s is
> good.****
>
> Swap may be used, because there are other applications run with cassandra
> server.****
>
>  ****
>
> 10.63.61.71 log****
>
> INFO [Timer-0] 2011-07-13 10:44:55,732 Gossiper.java (line 181) InetAddre=
ss
> /10.63.61.74 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:44:57,748 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:56:44,630 Gossiper.java (line 181)
> InetAddress /10.63.61.74 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:56:44,653 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:03:24,391 Gossiper.java (line 181)
> InetAddress /10.63.61.72 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:03:24,405 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.72 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:21:41,246 Gossiper.java (line 181)
> InetAddress /10.63.61.74 is now dead.****
>
>  INFO [Timer-0] 2011-07-13 22:22:45,602 Gossiper.java (line 181)
> InetAddress /10.63.61.73 is now dead.****
>
>  INFO [Timer-0] 2011-07-13 22:22:45,602 Gossiper.java (line 181)
> InetAddress /10.63.61.72 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:22:45,993 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.73 is now UP****
>
>  INFO [GMFD:1] 2011-07-13 22:22:46,107 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.72 is now UP****
>
>  INFO [GMFD:1] 2011-07-13 22:22:46,107 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:24:08,812 Gossiper.java (line 181)
> InetAddress /10.63.61.74 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:24:08,920 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  ****
>
> 10.63.61.72 log****
>
> INFO [Timer-0] 2011-07-13 02:06:03,941 Gossiper.java (line 181) InetAddre=
ss
> /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 02:06:05,109 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 03:39:41,918 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 03:39:45,536 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:10:17,449 Gossiper.java (line 181)
> InetAddress /10.63.61.74 is now dead.****
>
>  INFO [Timer-0] 2011-07-13 10:10:17,471 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:10:18,451 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  INFO [GMFD:1] 2011-07-13 10:10:18,451 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:44:36,140 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:44:57,417 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:45:10,141 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:45:14,478 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:14:44,044 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:14:47,610 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:56:36,857 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:56:44,417 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:02:37,260 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:02:52,651 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:03:05,289 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:03:11,260 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:08:47,666 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:08:48,668 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 17:38:32,569 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 17:38:34,572 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:20:45,706 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:22:46,143 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:23:32,875 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:24:08,948 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:32:37,421 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:32:38,036 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  ****
>
> 10.63.61.73 log****
>
>  INFO [Timer-0] 2011-07-13 03:39:42,066 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 03:39:45,536 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:42:37,274 Gossiper.java (line 181)
> InetAddress /10.63.61.74 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:42:37,275 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.74 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:44:48,406 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:44:57,550 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:14:45,754 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:14:47,486 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:56:39,927 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:56:44,755 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:02:40,289 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:02:53,076 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:03:08,316 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:03:11,689 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:20:48,906 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:22:45,936 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:23:34,072 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:24:08,901 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  ****
>
> 10.63.61.74 log****
>
>  INFO [Timer-0] 2011-07-13 02:06:05,952 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 02:06:05,953 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 03:39:44,699 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 03:39:45,700 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 10:44:46,676 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 10:44:57,656 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:14:47,547 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:14:49,269 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 15:56:39,594 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 15:56:44,825 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:02:38,959 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:02:53,173 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 16:03:07,988 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 16:03:11,787 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:20:46,859 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:22:46,020 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  INFO [Timer-0] 2011-07-13 22:23:33,860 Gossiper.java (line 181)
> InetAddress /10.63.61.71 is now dead.****
>
>  INFO [GMFD:1] 2011-07-13 22:24:08,897 Gossiper.java (line 579) InetAddre=
ss
> /10.63.61.71 is now UP****
>
>  ****
>
> Best Regards****
>
> Donna li****
>
> ** **
>

--20cf301fb9050aa3a204a85ba84c
Content-Type: text/html; charset=GB2312
Content-Transfer-Encoding: quoted-printable

Donna,<div><br></div><div>I bet it&#39;s this issue which we encountered on=
 0.6.5:&nbsp;<a href=3D"https://issues.apache.org/jira/browse/CASSANDRA-149=
4">https://issues.apache.org/jira/browse/CASSANDRA-1494</a><div><br></div><=
div>
Basically, a runtime exception killed the gossiper thread and caused that i=
nfinite loop. You can upgrade to the latest 0.6 to solve it.</div><div><br>=
</div><div>Dan<br><br><div class=3D"gmail_quote">2011/7/14 Donna Li <span d=
ir=3D"ltr">&lt;<a href=3D"http://donna.li">donna.li</a>@<a href=3D"http://u=
tstar.com">utstar.com</a>&gt;</span><br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex;">




<u></u>
<u></u>
<u></u>





<div lang=3D"ZH-CN" link=3D"blue" vlink=3D"blue">

<div>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black"><u=
></u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">Th=
e following log is GC
log of </span></font><font size=3D"1" color=3D"black" face=3D"Arial"><span =
lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">10.6=
3.61.71, 10.63.61.72-10.63.61.74
have no GC on date </span></font><u></u><font size=3D"1" color=3D"black" fa=
ce=3D"Arial"><span lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Aria=
l;color:black">2011-07-13</span></font><u></u><font size=3D"1" color=3D"bla=
ck" face=3D"Arial"><span lang=3D"EN-US" style=3D"font-size:9.0pt;font-famil=
y:Arial;color:black">. <u></u><u></u></span></font></p>


<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">10=
.63.61.</span></font><font size=3D"1" color=3D"black" face=3D"Arial"><span =
lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">71 a=
nd </span></font><font size=3D"1" color=3D"black" face=3D"Arial"><span lang=
=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">10.63.61=
.</span></font><font size=3D"1" color=3D"black" face=3D"Arial"><span lang=
=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">72 are s=
eed
nodes.<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">My=
 cassandra version is <u></u>0.6.3<u></u>,
and the configuration about gc on storage_conf.xml is <u></u><u></u></span>=
</font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&l=
t;GCGraceSeconds&gt;864000&lt;/GCGraceSeconds&gt;<u></u><u></u></span></fon=
t></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black"><u=
></u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">JV=
M configuration is as
following:<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">JV=
M_OPTS=3D&quot; \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-ea \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-Xms<u></u>256M<u></u> \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-Xmx<u></u>1G<u></u> \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:+UseParNewGC \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:+UseConcMarkSweepGC \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:+CMSParallelRemarkEnabled \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:SurvivorRatio=3D8 \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:MaxTenuringThreshold=3D1 \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-XX:+HeapDumpOnOutOfMemoryError \<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-Dcom.sun.management.jmxremote.port=3D8080 \<u></u><u></u></span></font></p=
>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-Dcom.sun.management.jmxremote.ssl=3Dfalse \<u></u><u></u></span></font></p=
>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
-Dcom.sun.management.jmxremote.authenticate=3Dfalse&quot;<u></u><u></u></sp=
an></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy"><u><=
/u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"black" face=3D"Arial"><spa=
n lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:black">Ca=
n I decrease the JVM_OPTS
to &ndash;Xms<u></u>128M<u></u> &ndash;Xmx<u></u>512M<u></u> to avoid swap,=
 the data saved in
cassandra is small, I do not need so much memory.<u></u><u></u></span></fon=
t></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy"><u><=
/u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">INFO=
 [GC inspection]
2011-07-13 03:12:06,153 GCInspector.java (line 110) GC for ConcurrentMarkSw=
eep:
1097 ms, 371528920 reclaimed leaving 17677528 used; max is 1187840000<u></u=
><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 03:12:07,351 GCInspector.java (line 110) GC for ParNew: 466 ms,
20619976 reclaimed leaving 157240232 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 03:25:54,378 GCInspector.java (line 110) GC for ParNew: 283 ms,
26850072 reclaimed leaving 154180424 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 06:29:58,092 GCInspector.java (line 110) GC for ParNew: 538 ms,
17358792 reclaimed leaving 222959936 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 09:48:33,379 GCInspector.java (line 110) GC for ParNew: 547 ms,
22483632 reclaimed leaving 291693248 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 10:44:57,435 GCInspector.java (line 110) GC for ParNew: 1621 ms,=
 9916072
reclaimed leaving 402812912 used; max is 1187840000<u></u><u></u></span></f=
ont></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 10:45:14,598 GCInspector.java (line 110) GC for</span></font><fo=
nt size=3D"1" color=3D"red" face=3D"Arial"><span lang=3D"EN-US" style=3D"fo=
nt-size:9.0pt;font-family:Arial;color:red"> ConcurrentMarkSweep: 12561 ms</=
span></font><font size=3D"1" color=3D"navy" face=3D"Arial"><span lang=3D"EN=
-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">, 382596784 rec=
laimed leaving 17056608 used; max is 1187840000<u></u><u></u></span></font>=
</p>


<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 10:50:24,947 GCInspector.java (line 110) GC for ParNew: 1186 ms,
23912976 reclaimed leaving 153561960 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 11:50:50,150 GCInspector.java (line 110) GC for ConcurrentMarkSw=
eep:
253 ms, 403457896 reclaimed leaving 16975080 used; max is 1187840000<u></u>=
<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 12:56:27,178 GCInspector.java (line 110) GC for ParNew: 359 ms,
21478776 reclaimed leaving 390794352 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 14:33:24,143 GCInspector.java (line 110) GC for ParNew: 658 ms,
26563640 reclaimed leaving 93002800 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 14:39:52,280 GCInspector.java (line 110) GC for ParNew: 449 ms,
26268648 reclaimed leaving 93554288 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 14:56:37,596 GCInspector.java (line 110) GC for ParNew: 1247 ms,
14271008 reclaimed leaving 239807832 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 15:14:47,254 GCInspector.java (line 110) GC for ParNew: 303 ms,
3355464 reclaimed leaving 408815760 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 15:14:47,255 GCInspector.java (line 110) GC for </span></font><f=
ont size=3D"1" color=3D"red" face=3D"Arial"><span lang=3D"EN-US" style=3D"f=
ont-size:9.0pt;font-family:Arial;color:red">ConcurrentMarkSweep: 11719 ms</=
span></font><font size=3D"1" color=3D"navy" face=3D"Arial"><span lang=3D"EN=
-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">, 387618656 rec=
laimed leaving 21197104 used; max is 1187840000<u></u><u></u></span></font>=
</p>


<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 15:56:57,674 GCInspector.java (line 110) GC for ParNew: 4566 ms,
21030184 reclaimed leaving 166815416 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 16:03:24,392 GCInspector.java (line 110) GC for ParNew: 254 ms,
22468136 reclaimed leaving 305100176 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 16:03:37,105 GCInspector.java (line 110) GC for ParNew: 3953 ms,
18264560 reclaimed leaving 344948328 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 16:08:50,476 GCInspector.java (line 110) GC for ParNew: 2038 ms,
18900864 reclaimed leaving 416409032 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 16:09:29,023 GCInspector.java (line 110) GC for ParNew: 347 ms,
27133904 reclaimed leaving 52726592 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 16:15:21,151 GCInspector.java (line 110) GC for ParNew: 250 ms,
26106864 reclaimed leaving 53400456 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 17:02:33,948 GCInspector.java (line 110) GC for ParNew: 253 ms,
20448152 reclaimed leaving 226672208 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 17:38:34,250 GCInspector.java (line 110) GC for ParNew: 456 ms,
22461776 reclaimed leaving 363131080 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 18:02:24,432 GCInspector.java (line 110) GC for ParNew: 226 ms,
21273048 reclaimed leaving 156029352 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 18:08:25,259 GCInspector.java (line 110) GC for ParNew: 1077 ms,
8876672 reclaimed leaving 299731248 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 18:44:24,703 GCInspector.java (line 110) GC for ConcurrentMarkSw=
eep:
449 ms, 380503216 reclaimed leaving 17038144 used; max is 1187840000<u></u>=
<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:20:09,714 GCInspector.java (line 110) GC for ParNew: 353 ms,
26769688 reclaimed leaving 436912856 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:20:36,022 GCInspector.java (line 110) GC for ParNew: 7706 ms,
18728880 reclaimed leaving 478596160 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:21:41,233 GCInspector.java (line 110) GC for ParNew: 903 ms,
21769296 reclaimed leaving 516347064 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:21:41,246 GCInspector.java (line 110) GC for </span></font><f=
ont size=3D"1" color=3D"red" face=3D"Arial"><span lang=3D"EN-US" style=3D"f=
ont-size:9.0pt;font-family:Arial;color:red">ConcurrentMarkSweep: 63440 ms</=
span></font><font size=3D"1" color=3D"navy" face=3D"Arial"><span lang=3D"EN=
-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">, 495156848 rec=
laimed leaving 21190216 used; max is 1187840000<u></u><u></u></span></font>=
</p>


<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:22:54,033 GCInspector.java (line 110) GC for ParNew: 232 ms,
26753464 reclaimed leaving 54874568 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:24:08,813 GCInspector.java (line 110) GC for ParNew: 1673 ms,
25808320 reclaimed leaving 123027728 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:24:16,498 GCInspector.java (line 110) GC for ParNew: 7515 ms,
11078160 reclaimed leaving 138793320 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:25:44,602 GCInspector.java (line 110) GC for ParNew: 222 ms,
26316512 reclaimed leaving 139425816 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:26:16,958 GCInspector.java (line 110) GC for ParNew: 265 ms,
27367784 reclaimed leaving 138927792 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:27:37,065 GCInspector.java (line 110) GC for ParNew: 264 ms, =
26687704
reclaimed leaving 138982208 used; max is 1187840000<u></u><u></u></span></f=
ont></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:32:59,096 GCInspector.java (line 110) GC for ParNew: 1131 ms,
22081488 reclaimed leaving 244346808 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-13 22:44:36,817 GCInspector.java (line 110) GC for ParNew: 380 ms,
22375728 reclaimed leaving 348001304 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-14 00:26:27,381 GCInspector.java (line 110) GC for ParNew: 3116 ms,
9875432 reclaimed leaving 300588328 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-14 00:44:30,918 GCInspector.java (line 110) GC for ParNew: 2434 ms,
12998784 reclaimed leaving 417469656 used; max is 1187840000<u></u><u></u><=
/span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-14 01:26:35,149 GCInspector.java (line 110) GC for ConcurrentMarkSw=
eep:
457 ms, 502581896 reclaimed leaving 17225448 used; max is 1187840000<u></u>=
<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-14 04:54:53,268 GCInspector.java (line 110) GC for ConcurrentMarkSw=
eep:
278 ms, 407773688 reclaimed leaving 17250640 used; max is 1187840000<u></u>=
<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">&nbs=
p;INFO [GC inspection]
2011-07-14 07:08:25,240 GCInspector.java (line 110) GC for ParNew: 774 ms,
8645712 reclaimed leaving 368647304 used; max is 1187840000<u></u><u></u></=
span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy"><u><=
/u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">Than=
ks<u></u><u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"1" color=3D"navy" face=3D"Arial"><span=
 lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:Arial;color:navy">Donn=
a li<u></u><u></u></span></font></p>

<div>

<div class=3D"MsoNormal" align=3D"center" style=3D"text-align:center"><font=
 size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D"EN-US" style=3D"font-size:1=
2.0pt">

<hr size=3D"2" width=3D"100%" align=3D"center">

</span></font></div>

<p class=3D"MsoNormal"><b><font size=3D"2" face=3D"=CB=CE=CC=E5"><span styl=
e=3D"font-size:10.0pt;font-weight:bold">=B7=A2=BC=FE=C8=CB<span lang=3D"EN-=
US">:</span></span></font></b><font size=3D"2"><span lang=3D"EN-US" style=
=3D"font-size:10.0pt"> Vijay [mailto:<a href=3D"mailto:vijay2win@gmail.com"=
 target=3D"_blank">vijay2win@gmail.com</a>] <br>

</span></font><b><font size=3D"2"><span style=3D"font-size:10.0pt;font-weig=
ht:bold">=B7=A2=CB=CD=CA=B1=BC=E4<span lang=3D"EN-US">:</span></span></font=
></b><font size=3D"2"><span lang=3D"EN-US" style=3D"font-size:10.0pt"> <u><=
/u>2011<span lang=3D"EN-US"><span lang=3D"EN-US">=C4=EA7</span></span><span=
 lang=3D"EN-US"><span lang=3D"EN-US">=D4=C215</span></span><span lang=3D"EN=
-US"><span lang=3D"EN-US">=C8=D5</span></span><u></u> 9:27<br>

</span></font><b><font size=3D"2"><span style=3D"font-size:10.0pt;font-weig=
ht:bold">=CA=D5=BC=FE=C8=CB<span lang=3D"EN-US">:</span></span></font></b><=
font size=3D"2"><span lang=3D"EN-US" style=3D"font-size:10.0pt"> <u></u><a =
href=3D"mailto:user@cassandra.apache.org" target=3D"_blank">user@cassandra.=
apache.org</a><u></u><br>

</span></font><b><font size=3D"2"><span style=3D"font-size:10.0pt;font-weig=
ht:bold">=D6=F7=CC=E2<span lang=3D"EN-US">:</span></span></font></b><font s=
ize=3D"2"><span lang=3D"EN-US" style=3D"font-size:10.0pt"> Re: gossiper pro=
blem</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>


</div><div><div></div><div class=3D"h5">

<p class=3D"MsoNormal"><font size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D=
"EN-US" style=3D"font-size:12.0pt"><u></u>&nbsp;<u></u></span></font></p>

<p class=3D"MsoNormal"><font size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D=
"EN-US" style=3D"font-size:12.0pt">How
about GC logs, what are your pause times? JVM settings might help....<u></u=
><u></u></span></font></p>

<div>

<p class=3D"MsoNormal"><font size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D=
"EN-US" style=3D"font-size:12.0pt">If
you are not sure how to enable GC logs check cassandra.yaml look
for&nbsp;application&nbsp;pause times. it is highly recommended not to swap=
 --
include JNA jar.<u></u><u></u></span></font></p>

<div>

<p class=3D"MsoNormal" style=3D"margin-bottom:12.0pt"><font size=3D"3" face=
=3D"=CB=CE=CC=E5"><span lang=3D"EN-US" style=3D"font-size:12.0pt"><br clear=
=3D"all">
Regards,<br>
&lt;/VJ&gt;<br>
<br>
<br>
<u></u><u></u></span></font></p>

<div>

<p class=3D"MsoNormal"><font size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D=
"EN-US" style=3D"font-size:12.0pt">On
Thu, Jul 14, 2011 at 1:42 AM, Donna Li &lt;<a href=3D"http://donna.li" targ=
et=3D"_blank">donna.li</a>@<a href=3D"http://utstar.com" target=3D"_blank">=
utstar.com</a>&gt; wrote:<u></u><u></u></span></font></p>

<div link=3D"blue" vlink=3D"purple">

<div>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">All:</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">I
have four cassandra servers in cluster. I do not restart any one of the
servers, why the following print show the four servers restart many times? =
What
is the possible reason? The connection between the four server&rsquo;s is g=
ood.</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">Swap
may be used, because there are other applications run with cassandra server=
.</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">10.63.61.71
log</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">INFO
[Timer-0] 2011-07-13 10:44:55,732 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:44:57,748 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:56:44,630 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:56:44,653 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:03:24,391 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.72" target=3D"_blank">10.63.61.72</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:03:24,405 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.72" target=3D"_blank">10.63.61.72</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:21:41,246 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:22:45,602 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.73" target=3D"_blank">10.63.61.73</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:22:45,602 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.72" target=3D"_blank">10.63.61.72</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:45,993 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.73" target=3D"_blank">10.63.61.73</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:46,107 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.72" target=3D"_blank">10.63.61.72</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:46,107 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:24:08,812 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:24:08,920 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">10.63.61.72
log</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">INFO
[Timer-0] 2011-07-13 02:06:03,941 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 02:06:05,109 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 03:39:41,918 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 03:39:45,536 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:10:17,449 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:10:17,471 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:10:18,451 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:10:18,451 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:44:36,140 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:44:57,417 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:45:10,141 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:45:14,478 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:14:44,044 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:14:47,610 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:56:36,857 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:56:44,417 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:02:37,260 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:02:52,651 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:03:05,289 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:03:11,260 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:08:47,666 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:08:48,668 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 17:38:32,569 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 17:38:34,572 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:20:45,706 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:46,143 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:23:32,875 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:24:08,948 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:32:37,421 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:32:38,036 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">10.63.61.73
log</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 03:39:42,066 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 03:39:45,536 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:42:37,274 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:42:37,275 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.74" target=3D"_blank">10.63.61.74</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:44:48,406 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:44:57,550 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:14:45,754 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:14:47,486 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:56:39,927 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:56:44,755 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:02:40,289 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:02:53,076 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:03:08,316 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:03:11,689 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:20:48,906 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:45,936 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:23:34,072 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:24:08,901 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">10.63.61.74
log</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 02:06:05,952 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 02:06:05,953 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 03:39:44,699 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 03:39:45,700 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 10:44:46,676 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 10:44:57,656 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:14:47,547 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:14:49,269 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 15:56:39,594 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 15:56:44,825 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:02:38,959 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:02:53,173 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 16:03:07,988 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 16:03:11,787 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:20:46,859 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:22:46,020 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[Timer-0] 2011-07-13 22:23:33,860 Gossiper.java (line 181) InetAddress /<a =
href=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now dead.<=
/span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;INFO
[GMFD:1] 2011-07-13 22:24:08,897 Gossiper.java (line 579) InetAddress /<a h=
ref=3D"http://10.63.61.71" target=3D"_blank">10.63.61.71</a> is now UP</spa=
n></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">&nbsp;</span></font><span lang=
=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">Best
Regards</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

<p class=3D"MsoNormal"><font size=3D"1" face=3D"Arial"><span lang=3D"EN-US"=
 style=3D"font-size:9.0pt;font-family:Arial">Donna
li</span></font><span lang=3D"EN-US"><u></u><u></u></span></p>

</div>

</div>

</div>

<p class=3D"MsoNormal"><font size=3D"3" face=3D"=CB=CE=CC=E5"><span lang=3D=
"EN-US" style=3D"font-size:12.0pt"><u></u>&nbsp;<u></u></span></font></p>

</div>

</div>

</div></div></div>

</div>


</blockquote></div><br></div></div>

--20cf301fb9050aa3a204a85ba84c--