hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9331) get rid of pre-optimized-hashtable memory optimizations
Date Fri, 16 Jan 2015 08:33:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14279978#comment-14279978
] 

Lefty Leverenz commented on HIVE-9331:
--------------------------------------

Doc note:  This removes configuration parameters *hive.mapjoin.optimized.keys* and *hive.mapjoin.lazy.hashtable*
from HiveConf.java, so the wiki needs to be updated.  Their removal from the default list
for *hive.security.authorization.sqlstd.confwhitelist* is automatic as of HIVE-8534 and doesn't
need a wiki update.

* [Configuration Properties -- hive.mapjoin.optimized.keys | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.mapjoin.optimized.keys]
* [Configuration Properties -- hive.mapjoin.lazy.hashtable | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.mapjoin.lazy.hashtable]
* [_doc sample for removal_ | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.stats.map.parallelism]
* [Configuration Properties -- hive.security.authorization.sqlstd.confwhitelist | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.security.authorization.sqlstd.confwhitelist]

A release note would be nice too.

> get rid of pre-optimized-hashtable memory optimizations
> -------------------------------------------------------
>
>                 Key: HIVE-9331
>                 URL: https://issues.apache.org/jira/browse/HIVE-9331
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.15.0
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>              Labels: TODOC15
>             Fix For: 0.15.0
>
>         Attachments: HIVE-9331.01.patch, HIVE-9331.01.patch, HIVE-9331.02.patch, HIVE-9331.patch,
HIVE-9331.patch
>
>
> These were added in 13 because optimized hashtable couldn't make it in; they reduced
memory usage by some amount (10-25%), and informed the design of the optimized hashtable,
but now extra settings and code branches are just confusing and may have their own bugs. Might
as well remove them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message