From user-return-59359-archive-asf-public=cust-asf.ponee.io@cassandra.apache.org Thu Jan 11 04:47:19 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 3E89218072F for ; Thu, 11 Jan 2018 04:47:19 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2E678160C40; Thu, 11 Jan 2018 03:47:19 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 73821160C2E for ; Thu, 11 Jan 2018 04:47:18 +0100 (CET) Received: (qmail 4364 invoked by uid 500); 11 Jan 2018 03:47:16 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 4353 invoked by uid 99); 11 Jan 2018 03:47:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Jan 2018 03:47:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id F0D3FC3842 for ; Thu, 11 Jan 2018 03:47:15 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.998 X-Spam-Level: * X-Spam-Status: No, score=1.998 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=instaclustr-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id i0R7SpQJ4yFS for ; Thu, 11 Jan 2018 03:47:14 +0000 (UTC) Received: from mail-yb0-f175.google.com (mail-yb0-f175.google.com [209.85.213.175]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 46D985F1B9 for ; Thu, 11 Jan 2018 03:47:14 +0000 (UTC) Received: by mail-yb0-f175.google.com with SMTP id j7so524451ybl.3 for ; Wed, 10 Jan 2018 19:47:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=instaclustr-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=lynpZRWaPkW9P4MbJjKY7b42xPf4AXCdc00Fp7FQCTQ=; b=2UHvahqlpdmo11+aK91gnP9GxNzZZO0rq/DvhJODvbd0egiT+FAvp9bZIN/XtYRoOJ eqIkoBsQqVj3nkTNmrJMaFwhJl1WJRrH2gjsWdgD+60mWB0xPeI6OFS5b9ZdhDy0lMzM IBVXpn2TY0aPrumNlEYPIu6lS8Jz9gf6of4SA9ajStRtpojdIjJjLPG3wffzweyxvaYV S8zbDVl87hoAVi8sfVP98Ouh8DHH1/1itXPV9aC/XQyaZL/AiPFel4sdB8IM0Ex+Dw/m rBbumlyvHWa1EFxyAKGKBvv4Ad0yX5f5vwVQ/rLXcbUPZo80ShX+bj7zOtoBBch9zHnQ Q0qQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=lynpZRWaPkW9P4MbJjKY7b42xPf4AXCdc00Fp7FQCTQ=; b=Hqq2XV9R7JcD+uQdabPtP0eGVzv/LTTMIuayu8VprkzVuFXb+JhAAqSNe2sZzmqWBI vmX3iEYk5wE9Uby0bZg3y9R5Ly6lTe4DNMVgaIp4SfdYjugMo6olmtJAq6cLZHim2J2l fpU3Bx2FnHAm2ZOpl2dAFyAaH6JrJw5Bl12IW4p1okzm2aN9HZ4xM36rMP6GJ3kPxBSA 0/XfAJwyA9ZnNaxRKYzba7/DtH/EX17YZya2AI42KKA9GpUxyQHYe6uHVHKGrStQmlSl i2fJQ+mA5wuS5tvj7gseF+JKROg7PtF66PDc2fEvMVLDT4CG77gPeCkBliQSYQQ+jtUo DmSQ== X-Gm-Message-State: AKGB3mJb93gB1zUpi0ALAHqH7VkUrijZxW1Gkciy1azaKYI6UJZfDv6b 0NyvsfROx8ueID6BW5670sMlMxqjoWO7k2LGbDh0aJSKC38= X-Google-Smtp-Source: ACJfBotuSs5EGfJ0eKw1/3o3RwzAqR+r8Fh6ydDs7kbKY7iVi9zvmJkcxb5Dtn3gSwubSvNUwBEiSfoxaiC/QVBmRlU= X-Received: by 10.37.101.137 with SMTP id z131mr17691395ybb.270.1515642433700; Wed, 10 Jan 2018 19:47:13 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.83.67 with HTTP; Wed, 10 Jan 2018 19:46:33 -0800 (PST) In-Reply-To: References: From: kurt greaves Date: Thu, 11 Jan 2018 03:46:33 +0000 Message-ID: Subject: Re: secondary index creation causes C* oom To: User Content-Type: multipart/alternative; boundary="001a1142fa28de1a4e0562780010" --001a1142fa28de1a4e0562780010 Content-Type: text/plain; charset="UTF-8" > 1.not sure if secondary index creation is the same as index rebuild > Fairly sure they are the same. > 2.we noticed that the memory table flush looks still working,not the same > as CASSANDRA-12796 mentioned,but the compactionExecutor pending is > increasing. > Do you by chance have concurrent_compactors only set to 2? Seems like your index builds are blocking other compactions from taking place. Seems that maybe postflush is backed up because it's blocked on writes generated from the rebuild? Maybe, anyway. > 3.I'm wondering if the block only blocks the specified table which is > creating secondary index? > If all your flush writers/post flushers are blocked I assume no other flushes will be able to take place, regardless of table. Seems like CASSANDRA-12796 is related but not sure why it didn't get fixed in 2.1. --001a1142fa28de1a4e0562780010 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

=
1.not sure if secondary index crea= tion is the same as index rebuild
Fairly sure = they are the same.=C2=A0
2.we= noticed that the memory table flush looks still working,not the same as CA= SSANDRA-12796 mentioned,but the compactionExecutor pending is increasing.
Do you by chance have concurrent_compactors onl= y set to 2? Seems like your index builds are blocking other compactions fro= m taking place.
Seems that maybe postflush is backed up because it's= blocked on writes generated from the rebuild? Maybe, anyway.
3.I'm wondering if the block onl= y blocks the specified table which is creating secondary index?
If all your flush writers/post flushers are blocke= d I assume no other flushes will be able to take place, regardless of table= .=C2=A0

Seems like=C2=A0CASSANDRA-12796 is related but = not sure why it didn't get fixed in 2.1.
--001a1142fa28de1a4e0562780010--