From user-return-61457-archive-asf-public=cust-asf.ponee.io@cassandra.apache.org Tue Jun 26 20:42:47 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 9DBA4180636 for ; Tue, 26 Jun 2018 20:42:46 +0200 (CEST) Received: (qmail 48072 invoked by uid 500); 26 Jun 2018 18:42:44 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 48062 invoked by uid 99); 26 Jun 2018 18:42:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Jun 2018 18:42:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 5B8A61801AF for ; Tue, 26 Jun 2018 18:42:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.701 X-Spam-Level: X-Spam-Status: No, score=-0.701 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id GboaF02FAIyw for ; Tue, 26 Jun 2018 18:42:43 +0000 (UTC) Received: from mx0a-00191d01.pphosted.com (mx0b-00191d01.pphosted.com [67.231.157.136]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 30D2C5F33E for ; Tue, 26 Jun 2018 18:42:42 +0000 (UTC) Received: from pps.filterd (m0083689.ppops.net [127.0.0.1]) by m0083689.ppops.net-00191d01. (8.16.0.22/8.16.0.22) with SMTP id w5QIZqeP006245 for ; Tue, 26 Jun 2018 14:42:35 -0400 Received: from tlpd255.enaf.dadc.sbc.com (sbcsmtp3.sbc.com [144.160.112.28]) by m0083689.ppops.net-00191d01. with ESMTP id 2jut6w9ab7-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 26 Jun 2018 14:42:35 -0400 Received: from enaf.dadc.sbc.com (localhost [127.0.0.1]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w5QIgYAM024744 for ; Tue, 26 Jun 2018 13:42:34 -0500 Received: from zlp30499.vci.att.com (zlp30499.vci.att.com [135.46.181.149]) by tlpd255.enaf.dadc.sbc.com (8.14.5/8.14.5) with ESMTP id w5QIgUMv024665 for ; Tue, 26 Jun 2018 13:42:30 -0500 Received: from zlp30499.vci.att.com (zlp30499.vci.att.com [127.0.0.1]) by zlp30499.vci.att.com (Service) with ESMTP id 8F9A5429CD6B for ; Tue, 26 Jun 2018 18:42:30 +0000 (GMT) Received: from MOSTLS1MSGHUBAH.ITServices.sbc.com (unknown [135.41.4.155]) by zlp30499.vci.att.com (Service) with ESMTPS id 6EEA24000349 for ; Tue, 26 Jun 2018 18:42:30 +0000 (GMT) Received: from MOSTLS1MSGUSRFA.ITServices.sbc.com ([169.254.1.16]) by MOSTLS1MSGHUBAH.ITServices.sbc.com ([135.41.4.155]) with mapi id 14.03.0399.000; Tue, 26 Jun 2018 13:42:21 -0500 From: "ZAIDI, ASAD A" To: "user@cassandra.apache.org" Subject: RE: Problem with dropped mutations Thread-Topic: Problem with dropped mutations Thread-Index: AQHUDVzhPrJFtO95R0ynaSWxhdG8JKRy3fBQ Date: Tue, 26 Jun 2018 18:42:21 +0000 Message-ID: <053247A8CBB6754B8345743B8F18D68D487D235D@MOSTLS1MSGUSRFA.ITServices.sbc.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [216.12.244.9] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-06-26_09:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1806210000 definitions=main-1806260208 Are you also seeing time-outs on certain Cassandra operations?? If yes, you= may have to tweak *request_timeout parameter in order to get rid of droppe= d mutation messages if application data model is not upto mark! You can also check if network isn't dropping packets (ifconfig -a tool) + = storage (dstat tool) isn't reporting too slow disks. Cheers/Asad -----Original Message----- From: Hannu Kr=F6ger [mailto:hkroger@gmail.com]=20 Sent: Tuesday, June 26, 2018 9:49 AM To: user Subject: Problem with dropped mutations Hello, We have a cluster with somewhat heavy load and we are seeing dropped mutati= ons (variable amount and not all nodes have those). Are there some clear trigger which cause those? What would be the best prag= matic approach to start debugging those? We have already added more memory = which seemed to help somewhat but not completely. Cheers, Hannu --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org For additional commands, e-mail: user-help@cassandra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org For additional commands, e-mail: user-help@cassandra.apache.org