hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)
Date Wed, 17 Sep 2014 11:18:34 GMT
Rajesh Balamohan created HIVE-8158:
--------------------------------------

             Summary: Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator
codepath)
                 Key: HIVE-8158
                 URL: https://issues.apache.org/jira/browse/HIVE-8158
             Project: Hive
          Issue Type: Bug
            Reporter: Rajesh Balamohan
            Assignee: Rajesh Balamohan


VectorReduceSinkOperator --> ProcessOp --> makeValueWriatable --> VectorExpressionWriterFactory
--> writeValue(byte[], int, int) /setValue.

It appears that this goes through an additional layer of Text.encode/decode causing CPU pressure
(profiler output attached).

SettableStringObjectInspector / WritableStringObjectInspector has "set(Object o, Text value)"
method. It would be beneficial to use set(Object, Text) directly to save CPU cycles.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message