Return-Path: X-Original-To: apmail-phoenix-dev-archive@minotaur.apache.org Delivered-To: apmail-phoenix-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1DE5818399 for ; Tue, 15 Dec 2015 01:26:49 +0000 (UTC) Received: (qmail 18903 invoked by uid 500); 15 Dec 2015 01:26:49 -0000 Delivered-To: apmail-phoenix-dev-archive@phoenix.apache.org Received: (qmail 18837 invoked by uid 500); 15 Dec 2015 01:26:48 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 18826 invoked by uid 99); 15 Dec 2015 01:26:48 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 01:26:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 7832CC0178 for ; Tue, 15 Dec 2015 01:26:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.426 X-Spam-Level: X-Spam-Status: No, score=0.426 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.554] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id dgnfeMi_Fabz for ; Tue, 15 Dec 2015 01:26:47 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with SMTP id 6251D429C7 for ; Tue, 15 Dec 2015 01:26:47 +0000 (UTC) Received: (qmail 17966 invoked by uid 99); 15 Dec 2015 01:26:46 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Dec 2015 01:26:46 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CAB522C0452 for ; Tue, 15 Dec 2015 01:26:46 +0000 (UTC) Date: Tue, 15 Dec 2015 01:26:46 +0000 (UTC) From: "Samarth Jain (JIRA)" To: dev@phoenix.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (PHOENIX-1261) Update stats table asynchronously MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PHOENIX-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057125#comment-15057125 ] Samarth Jain commented on PHOENIX-1261: --------------------------------------- Also, UPDATE STATS async completed fine on a 200 million row table. I also tested in scenarios where the client initiating UPDATE STATS was still connected/disconnected. In both scenarios UPDATE STATS finished fine. > Update stats table asynchronously > --------------------------------- > > Key: PHOENIX-1261 > URL: https://issues.apache.org/jira/browse/PHOENIX-1261 > Project: Phoenix > Issue Type: Sub-task > Reporter: James Taylor > Assignee: Samarth Jain > Fix For: 4.7.0 > > Attachments: 1261-wip.patch > > > Instead of writing the the stats table directly in the thread performing major compaction, we should instead write to it asynchronously, perhaps using the same asynchronous mechanism used by tracing. Apparently HBase used to have a "custodian" table where they'd write as compaction and other background tasks were running, and this leads to bad things happening if the table being written to can't be reached. -- This message was sent by Atlassian JIRA (v6.3.4#6332)