hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7530) Go thru the common code to find references to HIVE_EXECUCTION_ENGINE to make sure conditions works with Spark
Date Mon, 18 Aug 2014 23:15:19 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101499#comment-14101499
] 

Hive QA commented on HIVE-7530:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12662579/HIVE-7530-spark.patch

{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 5917 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
{noformat}

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/59/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/59/console
Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-59/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12662579

> Go thru the common code to find references to HIVE_EXECUCTION_ENGINE to make sure conditions
works with Spark
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-7530
>                 URL: https://issues.apache.org/jira/browse/HIVE-7530
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Xuefu Zhang
>            Assignee: Na Yang
>         Attachments: HIVE-7530-spark.patch
>
>
> In common code, such as Utilities.java, I found a lot of references to this conf variable
and special handling to a specific engine such as following:
> {code}
>           if (!HiveConf.getVar(job, ConfVars.HIVE_EXECUTION_ENGINE).equals("tez")
>               && isEmptyPath(job, path, ctx)) {
>             path = createDummyFileForEmptyPartition(path, job, work,
>                  hiveScratchDir, alias, sequenceNumber++);
>           }
> {code}
> We need to make sure the condition still holds after a new execution engine such as "spark"
is introduced.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message