hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13789) Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
Date Mon, 23 May 2016 07:40:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rui Li updated HIVE-13789:
--------------------------
       Resolution: Fixed
    Fix Version/s: 2.1.0
           Status: Resolved  (was: Patch Available)

Committed to master. Thanks Xuefu for the review.

> Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-13789
>                 URL: https://issues.apache.org/jira/browse/HIVE-13789
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>             Fix For: 2.1.0
>
>         Attachments: HIVE-13789.1.patch
>
>
> We check configuration to decide whether to escape certain characters each time write/read
a record for custom scripts.
> In our benchmark this becomes a hot spot method. And fixing it improves the execution
of the custom script by 7% (3TB TPCx-BB dataset).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message