Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5E2EB200D65 for ; Mon, 11 Dec 2017 02:23:07 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 5346E160C21; Mon, 11 Dec 2017 01:23:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 976B6160C09 for ; Mon, 11 Dec 2017 02:23:06 +0100 (CET) Received: (qmail 16753 invoked by uid 500); 11 Dec 2017 01:23:05 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 16742 invoked by uid 99); 11 Dec 2017 01:23:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Dec 2017 01:23:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 3CCA6C0675 for ; Mon, 11 Dec 2017 01:23:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.211 X-Spam-Level: X-Spam-Status: No, score=-99.211 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id eStM4LVmXB-a for ; Mon, 11 Dec 2017 01:23:04 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id EE1EF5FAF7 for ; Mon, 11 Dec 2017 01:23:03 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 329A4E0162 for ; Mon, 11 Dec 2017 01:23:03 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 23801212FA for ; Mon, 11 Dec 2017 01:23:01 +0000 (UTC) Date: Mon, 11 Dec 2017 01:23:00 +0000 (UTC) From: "Chance Li (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 11 Dec 2017 01:23:07 -0000 [ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: ------------------------------ Attachment: HBASE-19389-branch-2-V8.patch > Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted > ----------------------------------------------------------------------------------------- > > Key: HBASE-19389 > URL: https://issues.apache.org/jira/browse/HBASE-19389 > Project: HBase > Issue Type: Improvement > Components: Performance > Affects Versions: 2.0.0 > Environment: 2000+ Region Servers > PCI-E ssd > Reporter: Chance Li > Assignee: Chance Li > Fix For: 2.0.0 > > Attachments: CSLM-concurrent-write.png, HBASE-19389-branch-2-V2.patch, HBASE-19389-branch-2-V3.patch, HBASE-19389-branch-2-V4.patch, HBASE-19389-branch-2-V5.patch, HBASE-19389-branch-2-V6.patch, HBASE-19389-branch-2-V7.patch, HBASE-19389-branch-2-V8.patch, HBASE-19389-branch-2.patch, metrics-1.png, ycsb-result.png > > > In a large cluster, with a large number of clients, we found the RS's handlers are all busy sometimes. And after investigation we found the root cause is about CSLM, such as compare function heavy load. We reviewed the related WALs, and found that there were many columns (more than 1000 columns) were writing at that time. -- This message was sent by Atlassian JIRA (v6.4.14#64029)