Return-Path: X-Original-To: apmail-phoenix-dev-archive@minotaur.apache.org Delivered-To: apmail-phoenix-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83859CC9B for ; Fri, 12 Dec 2014 02:09:34 +0000 (UTC) Received: (qmail 50325 invoked by uid 500); 12 Dec 2014 02:09:34 -0000 Delivered-To: apmail-phoenix-dev-archive@phoenix.apache.org Received: (qmail 50270 invoked by uid 500); 12 Dec 2014 02:09:34 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 50259 invoked by uid 99); 12 Dec 2014 02:09:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Dec 2014 02:09:34 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 12 Dec 2014 02:09:33 +0000 Received: (qmail 50118 invoked by uid 99); 12 Dec 2014 02:09:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Dec 2014 02:09:13 +0000 Date: Fri, 12 Dec 2014 02:09:13 +0000 (UTC) From: "James Taylor (JIRA)" To: dev@phoenix.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (PHOENIX-1520) Provide a means of tracking progress of secondary index population MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org James Taylor created PHOENIX-1520: ------------------------------------- Summary: Provide a means of tracking progress of secondary index population Key: PHOENIX-1520 URL: https://issues.apache.org/jira/browse/PHOENIX-1520 Project: Phoenix Issue Type: Bug Reporter: James Taylor When an index is created against a table that already has a substantial amount of data, the initial population of the index can take a long time. We should provide a means of monitoring the percentage complete of the task. It's possible that this could be done in a way that is general enough to apply to any Phoenix query. The secondary index population is done through an UPSERT SELECT statement that selects from the data table and upserts into the index table. We have table stats up front that tell us how many guidepost chunks will be iterated over. We could monitor the thread pool based on the tasks queued in the pool by ParallelIterators to get an idea of total number of remaining tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)