Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 18B1E200BF1 for ; Tue, 3 Jan 2017 16:09:04 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 17627160B43; Tue, 3 Jan 2017 15:09:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3A4C9160B33 for ; Tue, 3 Jan 2017 16:09:03 +0100 (CET) Received: (qmail 30931 invoked by uid 500); 3 Jan 2017 15:09:01 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 30921 invoked by uid 99); 3 Jan 2017 15:09:01 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Jan 2017 15:09:01 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 440D4C0040 for ; Tue, 3 Jan 2017 15:09:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Mtr6BRL5Pf_n for ; Tue, 3 Jan 2017 15:09:00 +0000 (UTC) Received: from mail-wm0-f42.google.com (mail-wm0-f42.google.com [74.125.82.42]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BCD7E5F1B3 for ; Tue, 3 Jan 2017 15:08:59 +0000 (UTC) Received: by mail-wm0-f42.google.com with SMTP id t79so431714017wmt.0 for ; Tue, 03 Jan 2017 07:08:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=wIEy1PzUEkZ2beMN1QtaInoCTqcphbHWqlQepjpeLGE=; b=qAfp9z8N1GdMwnXmwg9pA2ESn8NPUevjoWHv7sdPuwQgc2HigeC29jTUv0l/Xbiyg0 U0htMjbPTri54/qgwptsJ7zH2pna6FjhKOOIxO6fuIIUUulZoxelzznshXMKuUBCJvzo 2E3t6GO0AJd3MSs/5ClrNu6dQiydERSToANiYbc8dB3UYJZtCSFhVzXsdwRloRf990RO VbztFu52rY+2GVNF7u+k7QvBa3N9OVuqiRynOmM5hxsjyqcD1o3R104Ze/BKf3Dr7T1Q yl5EONP/OVTrGmsW0zw/y8n11YnkSnPlWMkAlKsxKUbul/ho3TutkL66kLX1QlMMTly8 a2tQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=wIEy1PzUEkZ2beMN1QtaInoCTqcphbHWqlQepjpeLGE=; b=N2xcwy6oRRTcusee4DCBeLvWP1dJZY55oNfGrJwSb5QHkKd8dyRyHgzaBG3uyFiG6T oA15Xo3d+kjgvg9pjv0EganIIl2/F591yqIA1PV++rZ0aYlNj/F2pjBXNLNadwWvmLAD KSxiBwtGTIriVqpZoT1WSneUR6HPMmm3TZbcEvHESA6j14j1tbFDW4i0Pfk+LoG9pk/L MnUdTrz85KEv/n9F4y2ltMC8YgpYl7T9qAlAwTgkhP1JOquH3yDOpsNUFvVF8CWuBSlr Os7BqFd0oF7/WEn2C7EEPVGk3yjItN1iZkOlEW9kCOCpLQQNREEmf4y2fJN1TcRfsbdG EVwA== X-Gm-Message-State: AIkVDXLs9GO20VyHle7CVZOgpv/+0qS7G818zz/9ovOOnyR7Iuf5iuzf/w1ZLC5vzR+wM9zyMMgtE1V8M+CAwg== X-Received: by 10.28.93.74 with SMTP id r71mr51308459wmb.67.1483456123705; Tue, 03 Jan 2017 07:08:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.28.31.17 with HTTP; Tue, 3 Jan 2017 07:08:42 -0800 (PST) Received: by 10.28.31.17 with HTTP; Tue, 3 Jan 2017 07:08:42 -0800 (PST) In-Reply-To: References: From: Anshu Vajpayee Date: Tue, 3 Jan 2017 20:38:42 +0530 Message-ID: Subject: Re: Growing Hints To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a1145bc884b1c8e0545320b7d archived-at: Tue, 03 Jan 2017 15:09:04 -0000 --001a1145bc884b1c8e0545320b7d Content-Type: text/plain; charset=UTF-8 Anyone aware about issue ? Hints are still growing although gossip and repair was successfull. Gossip is flowing without any issue as all nodes status is UN. Hints are growing and there is timed out message in log hinted handoff delivery. Hints are not truncating after defined time period. Please let me know if you have any question. Thanks On Dec 29, 2016 10:06 AM, "Anshu Vajpayee" wrote: > Hello All > We have one unusual issue on our cluster. We are seeing growing hints > table on node although all the nodes are up and coming online with > notetool status. > > I know Cassandra appends the hints in case if there is write timeout > for other nodes. In our case all nodes are up and functional , Gossip is > also flowing well. Also write time out value is quite high in our cluster . > Can anyone suggest what could be other possible reason for these growing > hints ? > > > > > > --001a1145bc884b1c8e0545320b7d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Anyone aware about=C2=A0 issue ?

Hints are still growing although gossip and repair was succe= ssfull. Gossip is flowing without any issue as all nodes status is UN.
<= br>

Hints are growing and there is timed out message in log hint= ed handoff delivery.=C2=A0 Hints are not truncating after defined time peri= od.

Please let me know if you have any question. Thanks

<= br>




On Dec 29, 2016 10:06 AM, "Anshu Vajpayee&q= uot; <anshu.vajpayee@gmail.c= om> wrote:
Hello All=C2=A0
We have one unusual issue on our cluster. We are = seeing growing hints table on =C2=A0node although all the nodes are up =C2= =A0and coming online with notetool status.

I know =C2=A0Cassandra =C2= =A0appends the hints in case if there is =C2=A0write timeout for other node= s. In our case =C2=A0all nodes are up and functional , Gossip is also flowi= ng well.=C2=A0 Also write time out value is quite high in our cluster .
Can= anyone suggest what could be other possible reason for these growing hints= ?=C2=A0




--001a1145bc884b1c8e0545320b7d--