Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Thu, 12 Jan 2017 08:27:52 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13002985.1473182950000.517.1484209672017@Atlassian.JIRA>
In-Reply-To: <JIRA.13002985.1473182950000@Atlassian.JIRA>
References: <JIRA.13002985.1473182950000@Atlassian.JIRA> <JIRA.13002985.1473182950367@arcas>
Subject: [jira] [Commented] (HIVE-14707) ACID: Insert shuffle sort-merges on
 blank KEY
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 12 Jan 2017 08:27:54 -0000


    [ https://issues.apache.org/jira/browse/HIVE-14707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820466#comment-15820466 ] 

Hive QA commented on HIVE-14707:
--------------------------------


Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12847110/HIVE-14707.19.patch

{color:green}SUCCESS:{color} +1 due to 4 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 10943 tests executed
*Failed tests:*
{noformat}
TestDerbyConnector - did not produce a TEST-*.xml file (likely timed out) (batchId=234)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[offset_limit_ppd_optimizer] (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_part] (batchId=148)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_exists] (batchId=145)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_in] (batchId=149)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_multi] (batchId=140)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[subquery_notin] (batchId=150)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_char_simple] (batchId=146)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_varchar_simple] (batchId=151)
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver[explainuser_3] (batchId=92)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] (batchId=221)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query69] (batchId=221)
org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveAuthorizerCheckInvocation.org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveAuthorizerCheckInvocation (batchId=208)
org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveAuthorizerShowFilters.org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveAuthorizerShowFilters (batchId=208)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/2903/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/2903/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-2903/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 14 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12847110 - PreCommit-HIVE-Build

> ACID: Insert shuffle sort-merges on blank KEY
> ---------------------------------------------
>
>                 Key: HIVE-14707
>                 URL: https://issues.apache.org/jira/browse/HIVE-14707
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>    Affects Versions: 2.2.0
>            Reporter: Gopal V
>            Assignee: Eugene Koifman
>         Attachments: HIVE-14707.01.patch, HIVE-14707.02.patch, HIVE-14707.03.patch, HIVE-14707.04.patch, HIVE-14707.05.patch, HIVE-14707.06.patch, HIVE-14707.08.patch, HIVE-14707.09.patch, HIVE-14707.10.patch, HIVE-14707.11.patch, HIVE-14707.13.patch, HIVE-14707.14.patch, HIVE-14707.16.patch, HIVE-14707.17.patch, HIVE-14707.18.patch, HIVE-14707.19.patch, HIVE-14707.19.patch
>
>
> The ACID insert codepath uses a sorted shuffle, while they key used for shuffle is always 0 bytes long.
> {code}
> hive (sales_acid)> explain insert into sales values(1, 2, '3400-0000-0000-009', 1, null);
> STAGE PLANS:
>   Stage: Stage-1
>     Tez
>       DagId: gopal_20160906172626_80261c4c-79cc-4e02-87fe-3133be404e55:2
>       Edges:
>         Reducer 2 <- Map 1 (SIMPLE_EDGE)
> ...
>       Vertices:
>         Map 1 
>             Map Operator Tree:
>                 TableScan
>                   alias: values__tmp__table__2
>                   Statistics: Num rows: 1 Data size: 28 Basic stats: COMPLETE Column stats: NONE
>                   Select Operator
>                     expressions: tmp_values_col1 (type: string), tmp_values_col2 (type: string), tmp_values_col3 (type: string), tmp_values_col4 (type: string), tmp_values_col5 (type: string)
>                     outputColumnNames: _col0, _col1, _col2, _col3, _col4
>                     Statistics: Num rows: 1 Data size: 28 Basic stats: COMPLETE Column stats: NONE
>                     Reduce Output Operator
>                       sort order: 
>                       Map-reduce partition columns: UDFToLong(_col1) (type: bigint)
>                       Statistics: Num rows: 1 Data size: 28 Basic stats: COMPLETE Column stats: NONE
>                       value expressions: _col0 (type: string), _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string)
>             Execution mode: vectorized, llap
>             LLAP IO: no inputs
> {code}
> Note the missing "+" / "-" in the Sort Order fields.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)