phoenix-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-4009) Run UPDATE STATISTICS command by using MR integration on snapshots
Date Thu, 31 Jan 2019 00:04:00 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756705#comment-16756705
] 

Hudson commented on PHOENIX-4009:
---------------------------------

FAILURE: Integrated in Jenkins build PreCommit-PHOENIX-Build #2286 (See [https://builds.apache.org/job/PreCommit-PHOENIX-Build/2286/])
PHOENIX-4009 Run UPDATE STATISTICS command by using MR integration on (karanmehta93: rev bcbcfd817436921de6c69af4cb9a10ce1adc51ac)
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsCollectorFactory.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixMapReduceUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryServices.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/SnapshotScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsScanner.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/NonColumnEncodedImmutableTxStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/TxStatsCollectorIT.java
* (edit) phoenix-core/pom.xml
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/NamespaceEnabledStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixRecordReader.java
* (edit) pom.xml
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedImmutableTxStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/NoOpStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ServerUtil.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtilTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/util/PhoenixConfigurationUtil.java
* (edit) phoenix-pig/src/main/java/org/apache/phoenix/pig/util/PhoenixPigSchemaUtil.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/BaseStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/NoOpStatisticsCollector.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatsCollectionDisabledOnServerException.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsWriter.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/NamespaceDisabledStatsCollectorIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/NonTxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/TableSnapshotResultIterator.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/schema/stats/StatsCollectorIT.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/NonColumnEncodedImmutableNonTxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsCollector.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/UpdateStatisticsTool.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixInputFormat.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/GuidePostsCache.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/SysTableNamespaceMappedStatsCollectorIT.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedImmutableNonTxStatsCollectorIT.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedMutableTxStatsCollectorIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ParallelStatsDisabledIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/SpillableGroupByIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/DefaultStatisticsCollector.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/stats/StatisticsUtil.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedMutableNonTxStatsCollectorIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/exception/SQLExceptionCode.java


> Run UPDATE STATISTICS command by using MR integration on snapshots
> ------------------------------------------------------------------
>
>                 Key: PHOENIX-4009
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4009
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Samarth Jain
>            Assignee: Karan Mehta
>            Priority: Major
>              Labels: stats, statsCollection
>         Attachments: PHOENIX-4009.4.x-HBase-1.4.001.patch, PHOENIX-4009.4.x-HBase-1.4.002.patch,
PHOENIX-4009.4.x-HBase-1.4.003.addendum.patch, PHOENIX-4009.4.x-HBase-1.4.004.addendum.patch,
PHOENIX-4009.master.001.patch, PHOENIX-4009.master.002.patch, PHOENIX-4009.master.003.patch,
PHOENIX-4009.master.004.patch
>
>          Time Spent: 16h
>  Remaining Estimate: 0h
>
> Now that we have the capability to run queries against table snapshots through our map
reduce integration, we can utilize this capability for stats collection too. This would make
our stats collection more resilient, resource aware and less resource intensive. The bulk
of the plumbing is already in place. We would need to make sure that the integration doesn't
barf when the query is an UPDATE STATISTICS command.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message