Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Mon, 22 Dec 2014 19:18:14 +0000 (UTC)
From: "Szehon Ho (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12763051.1419041569000.86099.1419275894698@Atlassian.JIRA>
In-Reply-To: <JIRA.12763051.1419041569000@Atlassian.JIRA>
References: <JIRA.12763051.1419041569000@Atlassian.JIRA>
 <JIRA.12763051.1419041569998@arcas>
Subject: [jira] [Commented] (HIVE-9181) Fix SkewJoinOptimizer related Java 8
 ordering differences
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14256065#comment-14256065 ] 

Szehon Ho commented on HIVE-9181:
---------------------------------

+1 Looks good to me, thanks for the tough work. 

> Fix SkewJoinOptimizer related Java 8 ordering differences
> ---------------------------------------------------------
>
>                 Key: HIVE-9181
>                 URL: https://issues.apache.org/jira/browse/HIVE-9181
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Tests
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>         Attachments: HIVE-9181.1.patch, HIVE-9181.patch, HIVE-9181.patch
>
>
> (1) {{SkewJoinOptimizer}} adds items to {{ParseContext.topOps}} is different order in Java 8 vs Java 7. This leads to differences in EXPLAIN output related to {{MapWork}}.
> (2) Dbproperties order for a "desc database" query is non-deterministic at the HiveMetastore end between Java 8 and Java 7 (because Thrift maps are un-ordered). 
> {code}
> create database test_db with dbproperties ('key1' = 'value1', 'key2' = 'value2');
> desc database extended test_db;
> {code}
> At client side, we serialize the dbproperties map returned from HMS as string and write it to a temp file. The {{FetchTask}} then reads the temp file and returns the string back to the user. In test environment, for consistent ordering, we should sort the map before it is serialized to the temp file.  
>  


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)