hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17422) Skip non-native/temporary tables for all major table/partition related scenarios
Date Sun, 17 Sep 2017 22:06:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169438#comment-16169438
] 

Hive QA commented on HIVE-17422:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12887565/HIVE-17422.4.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 12 failed/errored test(s), 11041 tests executed
*Failed tests:*
{noformat}
TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=39)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_hash] (batchId=28)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[unionDistinct_1] (batchId=143)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[drop_table_failure2] (batchId=89)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=234)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] (batchId=234)
org.apache.hadoop.hive.ql.TestAcidOnTez.testCtasTezUnion (batchId=215)
org.apache.hadoop.hive.ql.TestAcidOnTez.testNonStandardConversion01 (batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testHttpRetryOnServerIdleTimeout (batchId=227)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6854/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6854/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6854/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 12 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12887565 - PreCommit-HIVE-Build

> Skip non-native/temporary tables for all major table/partition related scenarios
> --------------------------------------------------------------------------------
>
>                 Key: HIVE-17422
>                 URL: https://issues.apache.org/jira/browse/HIVE-17422
>             Project: Hive
>          Issue Type: Improvement
>          Components: repl
>            Reporter: Tao Li
>            Assignee: Tao Li
>         Attachments: HIVE-17422.1.patch, HIVE-17422.2.patch, HIVE-17422.3.patch, HIVE-17422.4.patch
>
>
> Currently during incremental dump, the non-native/temporary table info is partially dumped
in metadata file and will be ignored later by the repl load. We can optimize it by moving
the check (whether the table should be exported or not) earlier so that we don't save any
info to dump file for such types of tables. CreateTableHandler already has this optimization,
so we just need to apply similar logic to other scenarios.
> The change is to apply the EximUtil.shouldExportTable check to all scenarios (e.g. alter
table) that calls into the common dump method. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message