Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Wed, 16 Apr 2014 11:04:15 +0000 (UTC)
From: "Hive QA (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12708537.1397576322969.124101.1397646255768@arcas>
In-Reply-To: <JIRA.12708537.1397576322969@arcas>
References: <JIRA.12708537.1397576322969@arcas>
Subject: [jira] [Commented] (HIVE-6913) Hive unable to find the hashtable
 file during complex multi-staged map join
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13970669#comment-13970669 ] 

Hive QA commented on HIVE-6913:
-------------------------------


{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12640286/HIVE-6913.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 5401 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_auto_sortmerge_join_16
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_infer_bucket_sort_map_operators
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
{noformat}

Test results: http://bigtop01.cloudera.org:8080/job/precommit-hive/6/testReport
Console output: http://bigtop01.cloudera.org:8080/job/precommit-hive/6/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12640286

> Hive unable to find the hashtable file during complex multi-staged map join
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-6913
>                 URL: https://issues.apache.org/jira/browse/HIVE-6913
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Brock Noland
>            Assignee: Brock Noland
>         Attachments: HIVE-6913.patch
>
>
> If a query has multiple mapjoins and one of the tables to be mapjoined is empty, the query can result in a "no such file or directory" when looking for the hashtable.
> This is because when we generate a dummy hash table, we do not close the TableScan (TS) operator for that table. Additionally, HashTableSinkOperator (HTSO) outputs it's hash tables in the closeOp method. However, when close is called on HTSO we check to ensure that all parents are closed: https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java#L333
> which is not true on this case, because the TS operator for the empty table was never closed.


--
This message was sent by Atlassian JIRA
(v6.2#6252)