Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Fri, 11 Aug 2017 03:49:00 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13087032.1499984999000.7290.1502423340689@Atlassian.JIRA>
In-Reply-To: <JIRA.13087032.1499984999000@Atlassian.JIRA>
References: <JIRA.13087032.1499984999000@Atlassian.JIRA> <JIRA.13087032.1499984999600@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HIVE-17089) make acid 2.0 the default
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 11 Aug 2017 03:49:08 -0000


    [ https://issues.apache.org/jira/browse/HIVE-17089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122792#comment-16122792 ] 

Hive QA commented on HIVE-17089:
--------------------------------


Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12881368/HIVE-17089.10.patch

{color:green}SUCCESS:{color} +1 due to 13 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 18 failed/errored test(s), 10966 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestBeeLineDriver.testCliDriver[materialized_view_create_rewrite] (batchId=240)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_merge_move] (batchId=243)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_merge_only] (batchId=243)
org.apache.hadoop.hive.cli.TestBlobstoreCliDriver.testCliDriver[insert_overwrite_dynamic_partitions_move_only] (batchId=243)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[columnstats_part_coltype] (batchId=159)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning_mapjoin_only] (batchId=170)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_vectorized_dynamic_partition_pruning] (batchId=169)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainanalyze_2] (batchId=100)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=235)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] (batchId=235)
org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testACIDReaderFooterSerializeWithDeltas (batchId=264)
org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testACIDReaderNoFooterSerializeWithDeltas (batchId=264)
org.apache.hadoop.hive.ql.io.orc.TestInputOutputFormat.testACIDSplitStrategy (batchId=264)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionRegistrationWithCustomSchema (batchId=180)
org.apache.hive.hcatalog.api.TestHCatClient.testPartitionSpecRegistrationWithCustomSchema (batchId=180)
org.apache.hive.hcatalog.api.TestHCatClient.testTableSchemaPropagation (batchId=180)
org.apache.hive.jdbc.TestJdbcWithMiniHS2.testHttpRetryOnServerIdleTimeout (batchId=228)
org.apache.hive.service.cli.operation.TestOperationLoggingAPIWithMr.testFetchResultsOfLogWithVerboseMode (batchId=223)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/6347/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/6347/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-6347/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 18 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12881368 - PreCommit-HIVE-Build

> make acid 2.0 the default
> -------------------------
>
>                 Key: HIVE-17089
>                 URL: https://issues.apache.org/jira/browse/HIVE-17089
>             Project: Hive
>          Issue Type: New Feature
>          Components: Transactions
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>         Attachments: HIVE-17089.01.patch, HIVE-17089.03.patch, HIVE-17089.05.patch, HIVE-17089.06.patch, HIVE-17089.07.patch, HIVE-17089.10.patch, HIVE-17089.10.patch
>
>
> acid 2.0 is introduced in HIVE-14035.  It replaces Update events with a combination of Delete + Insert events.  This now makes U=D+I the default (and only) supported acid table type in Hive 3.0.  
> The expectation for upgrade is that Major compaction has to be run on all acid tables in the existing Hive cluster and that no new writes to these table take place since the start of compaction (Need to add a mechanism to put a table in read-only mode - this way it can still be read while it's being compacted).  Then upgrade to Hive 3.0 can take place.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)