hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HIVE-502) Optimize RCFile's performance by removeing all synchronized modifiers
Date Fri, 22 May 2009 06:48:46 GMT

     [ https://issues.apache.org/jira/browse/HIVE-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Zheng Shao resolved HIVE-502.

       Resolution: Fixed
    Fix Version/s: 0.4.0
     Release Note: HIVE-502. Optimize RCFile's performance by removeing all synchronized modifiers.
(Yongqiang He via zshao)
     Hadoop Flags: [Reviewed]

Committed. Thanks Yongqiang.

Note that this transaction only changes 5 files - none of which is used by Hive by default.
M      CHANGES.txt
A      ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveInputOutputBuffer.java
A      ql/src/java/org/apache/hadoop/hive/ql/io/HiveDataInputBuffer.java
A      ql/src/java/org/apache/hadoop/hive/ql/io/HiveDataOutputBuffer.java
M      ql/src/java/org/apache/hadoop/hive/ql/io/RCFile.java

> Optimize RCFile's performance by removeing all synchronized modifiers
> ---------------------------------------------------------------------
>                 Key: HIVE-502
>                 URL: https://issues.apache.org/jira/browse/HIVE-502
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>             Fix For: 0.4.0
>         Attachments: hive-502-2009-05-21.patch, hive-502-2009-05-22.patch
> Tests by Zheng and me both show that removing all synchronized modifiers can improve
RCFile's performance by  about 15+%.
> This will make RCFile's reader and writer not thread safe any longer. This will be ok,since
hive always does its work in single thread.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message