Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@phoenix.apache.org
Date: Tue, 18 Jul 2017 06:45:00 +0000 (UTC)
From: "Ankit Singhal (JIRA)" <jira@apache.org>
To: dev@phoenix.apache.org
Message-ID: <JIRA.13087766.1500330140000.270763.1500360300429@Atlassian.JIRA>
In-Reply-To: <JIRA.13087766.1500330140000@Atlassian.JIRA>
References: <JIRA.13087766.1500330140000@Atlassian.JIRA> <JIRA.13087766.1500330140238@jira-lw-us.apache.org>
Subject: [jira] [Commented] (PHOENIX-4033) Limit number of rows instead of
 time period for partial index rebuilder
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 18 Jul 2017 06:45:06 -0000


    [ https://issues.apache.org/jira/browse/PHOENIX-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091195#comment-16091195 ] 

Ankit Singhal commented on PHOENIX-4033:
----------------------------------------

yeah, the goal was to do the rebuild the indexes in the batches with the checkpointing so that we don't usually time out, also give chance to other indexes and will not lose the work done for the large rebuild when region server holding SYSTEM.CATALOG restarted.

I think, we can't use PageFilter as we don't know from which point we should start for the next batch.


> Limit number of rows instead of time period for partial index rebuilder
> -----------------------------------------------------------------------
>
>                 Key: PHOENIX-4033
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4033
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: James Taylor
>
> There's a mechanism in MetaDataRegionObserver to limit the time period of the partial index rebuilder (based on QueryServices.INDEX_FAILURE_HANDLING_REBUILD_PERIOD). Assuming the goal is to limit the number of rows being processed during one scan, we should push a PageFilter instead, since limiting the time period may not limit the number of rows processed at a time.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)