hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13789) Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
Date Thu, 19 May 2016 07:23:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rui Li updated HIVE-13789:
--------------------------
    Status: Patch Available  (was: Open)

> Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-13789
>                 URL: https://issues.apache.org/jira/browse/HIVE-13789
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>         Attachments: HIVE-13789.1.patch
>
>
> We check configuration to decide whether to escape certain characters each time write/read
a record for custom scripts.
> In our benchmark this becomes a hot spot method. And fixing it improves the execution
of the custom script by 7% (3TB TPCx-BB dataset).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message