hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rui Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-13789) Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
Date Thu, 19 May 2016 07:17:12 GMT
Rui Li created HIVE-13789:
-----------------------------

             Summary: Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
                 Key: HIVE-13789
                 URL: https://issues.apache.org/jira/browse/HIVE-13789
             Project: Hive
          Issue Type: Improvement
            Reporter: Rui Li
            Assignee: Rui Li
            Priority: Minor


We check configuration to decide whether to escape certain characters each time write/read
a record for custom scripts.
In our benchmark this becomes a hot spot method. And fixing it improves the execution of the
custom script by 7% (3TB TPCx-BB dataset).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message