hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mohit Sabharwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13057) Remove duplicate copies of TableDesc property values in PartitionDesc
Date Wed, 17 Feb 2016 00:07:18 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149543#comment-15149543
] 

Mohit Sabharwal commented on HIVE-13057:
----------------------------------------

Test failures are unrelated. (Also occur in unrelated runs like: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6976/#showFailuresLink)

> Remove duplicate copies of TableDesc property values in PartitionDesc
> ---------------------------------------------------------------------
>
>                 Key: HIVE-13057
>                 URL: https://issues.apache.org/jira/browse/HIVE-13057
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>         Attachments: HIVE-13057.patch
>
>
> For a partitioned table, each PartitionDesc has a copy of corresponding TableDesc.
> While TableDesc is mutable and hence cannot be interned, it's property values can be.
> For a simple select on a table with 100K partitions, this cut total number of String
instances by ~65%.
> Most replicated strings were location, serde, input/output format, column, types, table
name, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message