phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Samarth Jain (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PHOENIX-3976) Validate Index ASYNC job complete when building off a data table snapshot
Date Mon, 26 Jun 2017 22:07:00 GMT

     [ https://issues.apache.org/jira/browse/PHOENIX-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Samarth Jain updated PHOENIX-3976:
----------------------------------
    Description: [~akshita.malhotra] had this good idea of validating whether an async index
build job has completed successfully by comparing the PhoenixJobCounters.INPUT_RECORDS with
the number of expected rows. This would be especially helpful when we are building the index
using a data table snapshot. Since the data table snapshot won't be taking any writes, it
should be correct and hopefully relatively easy (possibly chain of map reduce jobs with first
job being a row count job run against the data table restored using snapshot?)  to verify
that the number of rows in the data table snapshot is equal to the PhoenixJobCounters.INPUT_RECORDS
counter.  (was: [~akshita.malhotra] had this good idea of validating whether an async index
build job has completed successfully by comparing the PhoenixJobCounters.INPUT_RECORDS with
the number of expected rows. This would be especially helpful when we are building the index
using a data table snapshot. Since the data table snapshot won't be taking any writes, it
should be correct and hopefully relatively easy to verify that the number of rows in the data
table snapshot is equal to the PhoenixJobCounters.INPUT_RECORDS counter.)

> Validate Index ASYNC job complete when building off a data table snapshot
> -------------------------------------------------------------------------
>
>                 Key: PHOENIX-3976
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3976
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Samarth Jain
>            Assignee: Akshita Malhotra
>
> [~akshita.malhotra] had this good idea of validating whether an async index build job
has completed successfully by comparing the PhoenixJobCounters.INPUT_RECORDS with the number
of expected rows. This would be especially helpful when we are building the index using a
data table snapshot. Since the data table snapshot won't be taking any writes, it should be
correct and hopefully relatively easy (possibly chain of map reduce jobs with first job being
a row count job run against the data table restored using snapshot?)  to verify that the number
of rows in the data table snapshot is equal to the PhoenixJobCounters.INPUT_RECORDS counter.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message