Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Sun, 17 Sep 2017 22:06:00 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13099066.1504213622000.132555.1505685960095@Atlassian.JIRA>
In-Reply-To: <JIRA.13099066.1504213622000@Atlassian.JIRA>
References: <JIRA.13099066.1504213622000@Atlassian.JIRA> <JIRA.13099066.1504213622105@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HIVE-17422) Skip non-native/temporary tables
 for all major table/partition related scenarios
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sun, 17 Sep 2017 22:06:08 -0000


    [ https://issues.apache.org/jira/browse/HIVE-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169438#comment-16169438 ] 

Hive QA commented on HIVE-17422:
--------------------------------


Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12887565/HIVE-17422.4.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 12 failed/errored test(s), 11041 tests executed
*Failed tests:*
{noformat}
TestAccumuloCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
TestDummy - did not produce a TEST-*.xml file (likely timed out) (batchId=230)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[create_view] (batchId=39)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[udf_mask_hash] (batchId=28)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[unionDistinct_1] (batchId=143)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[union_fast_stats] (batchId=156)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[drop_table_failure2] (batchId=89)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=234)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] (batchId=234)
org.apache.hadoop.hive.ql.TestAcidOnTez.testCtasTezUnion (batchId=215)
org.apache.hadoop.hive.ql.TestAcidOnTez.testNonStandardConversion01 (batchId=215)
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testHttpRetryOnServerIdleTimeout (batchId=227)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6854/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6854/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6854/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 12 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12887565 - PreCommit-HIVE-Build

> Skip non-native/temporary tables for all major table/partition related scenarios
> --------------------------------------------------------------------------------
>
>                 Key: HIVE-17422
>                 URL: https://issues.apache.org/jira/browse/HIVE-17422
>             Project: Hive
>          Issue Type: Improvement
>          Components: repl
>            Reporter: Tao Li
>            Assignee: Tao Li
>         Attachments: HIVE-17422.1.patch, HIVE-17422.2.patch, HIVE-17422.3.patch, HIVE-17422.4.patch
>
>
> Currently during incremental dump, the non-native/temporary table info is partially dumped in metadata file and will be ignored later by the repl load. We can optimize it by moving the check (whether the table should be exported or not) earlier so that we don't save any info to dump file for such types of tables. CreateTableHandler already has this optimization, so we just need to apply similar logic to other scenarios.
> The change is to apply the EximUtil.shouldExportTable check to all scenarios (e.g. alter table) that calls into the common dump method. 


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)