hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Sabharwal <mo...@cloudera.com>
Subject Review Request 43553: HIVE-13057: Remove duplicate copies of TableDesc property values in PartitionDesc
Date Wed, 17 Feb 2016 00:08:07 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43553/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-13057
    https://issues.apache.org/jira/browse/HIVE-13057


Repository: hive-git


Description
-------

For a partitioned table, each PartitionDesc has a copy of corresponding TableDesc.

While TableDesc is mutable and hence cannot be interned, it's property values can be.

For a simple select on a table with 100K partitions, this cut total number of String instances
by ~65%.

Most replicated strings were location, serde, input/output format, column, types, table name,
etc.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java b032349b7faf7026928bea90a6ded29eeb2a502c


Diff: https://reviews.apache.org/r/43553/diff/


Testing
-------


Thanks,

Mohit Sabharwal


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message