hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14496) Enable Calcite rewriting with materialized views
Date Fri, 09 Dec 2016 20:36:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736292#comment-15736292
] 

Hive QA commented on HIVE-14496:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12842593/HIVE-14496.04.patch

{color:green}SUCCESS:{color} +1 due to 18 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 121 failed/errored test(s), 10784 tests executed
*Failed tests:*
{noformat}
TestHBaseImport - did not produce a TEST-*.xml file (likely timed out) (batchId=193)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] (batchId=44)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=36)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view_partitioned] (batchId=34)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[cteViews] (batchId=70)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[materialized_view_create_rewrite] (batchId=2)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample2] (batchId=5)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample4] (batchId=15)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample6] (batchId=61)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample7] (batchId=60)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[sample9] (batchId=38)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[transform_ppr2] (batchId=134)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[cbo_rp_unionDistinct_2]
(batchId=142)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_orc_acid_part_update]
(batchId=149)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[stats_based_fetch_decision]
(batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_views] (batchId=139)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[unionDistinct_2] (batchId=139)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[unionDistinct_2] (batchId=91)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggrStatsCacheIntegration.alterInvalidation
(batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggrStatsCacheIntegration.altersInvalidation
(batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggrStatsCacheIntegration.hit (batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggrStatsCacheIntegration.invalidation (batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggrStatsCacheIntegration.someWithStats (batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsCache.allWithStats (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsCache.noneWithStats (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsCache.nonexistentPartitions
(batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsCache.someNonexistentPartitions
(batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsCacheWithBitVector.allPartitions
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.MiddleOfPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.TwoEndsAndMiddleOfPartitionsHaveBitVectorStatusDouble
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.TwoEndsAndMiddleOfPartitionsHaveBitVectorStatusLong
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.TwoEndsOfPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.allPartitionsHaveBitVectorStatusDecimal
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.allPartitionsHaveBitVectorStatusDouble
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.allPartitionsHaveBitVectorStatusLong
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.allPartitionsHaveBitVectorStatusString
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsExtrapolation.noPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.MiddleOfPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.TwoEndsAndMiddleOfPartitionsHaveBitVectorStatusDecimal
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.TwoEndsAndMiddleOfPartitionsHaveBitVectorStatusDouble
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.TwoEndsAndMiddleOfPartitionsHaveBitVectorStatusLong
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.TwoEndsOfPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.allPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseAggregateStatsNDVUniformDist.noPartitionsHaveBitVectorStatus
(batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreMetrics.testMetaDataCounts (batchId=199)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.alterRename (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.alterRenamePartitioned (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.describeNonpartitionedTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.insertIntoPartitionTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.insertIntoTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.partitionedTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseMetastoreSql.table (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseSchemaTool.oneMondoTest (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.addMultiColForeignKey (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.addMultiColPrimaryKey (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.addMultiForeignKeys (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.addSecondForeignKeys (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.alterIndex (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.alterPartition (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.alterTable (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.binaryPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.binaryTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.booleanPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.booleanTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.createIndex (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.createPartition (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.createTable (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.createTableWithForeignKey (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.createTableWithPrimaryKey (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.decimalPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.decimalTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.doublePartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.doublePrimaryKey (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.doubleTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.dropIndex (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.dropPartition (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.dropTable (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.getPartitions (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.listGetDropPartitionNames (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.longPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.longTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.skewInfo (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.stringPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStore.stringTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.decimalPartitionStatistics
(batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.decimalTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.doublePartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.doubleTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.longPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.longTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.stringPartitionStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreBitVector.stringTableStatistics (batchId=186)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.alterTable (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.booleanTableStatistics (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.createPartition (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.createTable (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.dropPartition (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.dropTable (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.getPartitions (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreCached.listGetDropPartitionNames (batchId=187)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.addPartitions (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.alterPartitions (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.alterTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.createPartition (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.createTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.dropPartition (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.dropTable (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.getAllDbs (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.getAllTables (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.getDbsRegex (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.getPartitions (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.getPartitionsByFilter (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.grantRevokeTablePrivileges
(batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.listPartitions (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.listPartitionsWithPs (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.listTableGrants (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.partitionStatistics (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestHBaseStoreIntegration.tableStatistics (batchId=193)
org.apache.hadoop.hive.metastore.hbase.TestStorageDescriptorSharing.createManyPartitions (batchId=193)
org.apache.hive.beeline.TestSchemaTool.testValidateLocations (batchId=209)
org.apache.hive.beeline.TestSchemaTool.testValidateNullValues (batchId=209)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2526/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2526/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2526/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 121 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12842593 - PreCommit-HIVE-Build

> Enable Calcite rewriting with materialized views
> ------------------------------------------------
>
>                 Key: HIVE-14496
>                 URL: https://issues.apache.org/jira/browse/HIVE-14496
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Materialized views
>    Affects Versions: 2.2.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>         Attachments: HIVE-14496.01.patch, HIVE-14496.02.patch, HIVE-14496.03.patch, HIVE-14496.04.patch,
HIVE-14496.patch
>
>
> Calcite already supports query rewriting using materialized views. We will use it to
support this feature in Hive.
> In order to do that, we need to register the existing materialized views with Calcite
view service and enable the materialized views rewriting rules. 
> We should include a HiveConf flag to completely disable query rewriting using materialized
views if necessary.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message