From user-return-64675-archive-asf-public=cust-asf.ponee.io@cassandra.apache.org Tue Oct 29 20:44:18 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id D4ED01804BB for ; Tue, 29 Oct 2019 21:44:17 +0100 (CET) Received: (qmail 88824 invoked by uid 500); 29 Oct 2019 20:44:13 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 88814 invoked by uid 99); 29 Oct 2019 20:44:13 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Oct 2019 20:44:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 0BA6AC0C94 for ; Tue, 29 Oct 2019 20:44:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.001 X-Spam-Level: X-Spam-Status: No, score=0.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=zalando.de Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id z--wH3wEHVk3 for ; Tue, 29 Oct 2019 20:44:10 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::133; helo=mail-lf1-x133.google.com; envelope-from=oleksandr.shulgin@zalando.de; receiver= Received: from mail-lf1-x133.google.com (mail-lf1-x133.google.com [IPv6:2a00:1450:4864:20::133]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 53BE17E1A0 for ; Tue, 29 Oct 2019 20:44:10 +0000 (UTC) Received: by mail-lf1-x133.google.com with SMTP id z12so11575595lfj.9 for ; Tue, 29 Oct 2019 13:44:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zalando.de; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=wawOClGQmTTXt+Xp8nqef5O9GxWBTz+7pZ9di0EZcK8=; b=nm4tOdiILse+AgQgOXzKG0Fk/lCSEHY9n5BenJ0EjOHgas2qTa8wD9YMGywlHsZjs8 xWo8WfiojuDuux5RnlpcRjrswXFfwm0ttbCERRpNUhp+YR+n4MV4v0bEIZjHyVzPkmaM L/7yd/l9u6OSRSMfStxZwesLc6gmddSMC7DqsyZRJRuEkozdhz7D0q9VUkxNWyHHM+7E 7hJhuBMUz1ZvEvfXeq5lWFkeTpvDBo8GxWR+Bg7rea2rMors9AN2Sgfogcf7IXAL+DC8 YmAEqz90MIAuCmaKJObk4SyQBZnbVH42vbISprC1y3ki+hfiTqb0HqxGYlkNfffs6hPE u9RQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=wawOClGQmTTXt+Xp8nqef5O9GxWBTz+7pZ9di0EZcK8=; b=amqtBMcTMcWivYqsqwVxfZLN5rjDHtoPpJSBtAZbO7px9I3WbTW9rvWrioSdpnnItA H9PHcr/vzJz8WVgAIs85iV80aGKvS5xKA7DPisP3NXPiQGYL2NETYRCoB1LY/83vyWyy R8FI0y1yAqDoJ+4NLxfMWT4gRDGi4UP+ovd9atRh2+tnuDJ4L27qqXRt9vHDYrNRJr6L vtwxGR/Bmna4+/MYlA1un1Ddi4723x4OslNfBO6hTZuqbt7G5YODwVoOAa5e78sCdEcC xRTnwTq+s17yj+0Eik9xSbDbm0FBs5Kr1y1cetTqb2coULvOku/i+WvSkNRqq5Ij809Z KOnA== X-Gm-Message-State: APjAAAVmyus0hq6h+N45gyGNWOnhXsuZm/cG/WFOGVoll2KvErTEKjBo PHoOKf4cM3QaddP4h2P7MdpCQcStTEtsln79QwQRlksVupk= X-Google-Smtp-Source: APXvYqxcMgXzvnD4V5i83FbghKzt+gWQ3gzmXG1nMjFE5fl7kCnUmpS/RmZMmgrVq4C2wV8wktj4F/3x5gkfFq4nsjc= X-Received: by 2002:a19:40c7:: with SMTP id n190mr3736019lfa.37.1572381849009; Tue, 29 Oct 2019 13:44:09 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Oleksandr Shulgin Date: Tue, 29 Oct 2019 21:43:43 +0100 Message-ID: Subject: Re: Aws instance stop and star with ebs To: User Content-Type: multipart/alternative; boundary="0000000000008fff0b059612ad2c" --0000000000008fff0b059612ad2c Content-Type: text/plain; charset="UTF-8" On Tue, Oct 29, 2019 at 9:34 PM Rahul Reddy wrote: > > We have our infrastructure on aws and we use ebs storage . And aws was > retiring on of the node. Since our storage was persistent we did nodetool > drain and stopped and start the instance . This caused 500 errors in the > service. We have local_quorum and rf=3 why does stopping one instance cause > application to have issues? > Can you still look up what was the underlying error from Cassandra driver in the application logs? Was it request timeout or not enough replicas? For example, if you only had 3 Cassandra nodes, restarting one of them reduces your cluster capacity by 33% temporarily. Cheers, -- Alex --0000000000008fff0b059612ad2c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Tue, Oct 29, 2019 at 9:34 PM Rahul Red= dy <rahulreddy1234@gmail.com= > wrote:

We have our infrastructure on aws and we use ebs storage . = And aws was retiring on of the node. Since our storage was persistent we di= d nodetool drain and stopped and start the instance . This caused 500 error= s in the service. We have local_quorum and rf=3D3 why does stopping one ins= tance cause application to have issues?

Can you still look up what was the underlying error from Cassandra= driver in the application logs?=C2=A0 Was it request timeout or not enough= replicas?

For example, if you only had 3 Cassandr= a nodes, restarting one of them reduces your cluster capacity by 33% tempor= arily.

Cheers,
--
Alex
=

=
--0000000000008fff0b059612ad2c--