carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-861) Improvements in query processing.
Date Wed, 05 Apr 2017 07:29:41 GMT
Ravindra Pesala created CARBONDATA-861:
------------------------------------------

             Summary: Improvements in query processing.
                 Key: CARBONDATA-861
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-861
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala
            Priority: Minor


Following are the list of can improvements done

Remove multiple creation of array and copy of it in Dimension and measure chunk readers.
Simplify logic of finding offsets of nodictionary keys in the class SafeVariableLengthDimensionDataChunkStore.
Avoid byte array creation and copy for nodictionary columns in case of vectorized reader.
Instead directly sending the length and offset to vector.
Remove unnecessary decoder plan additions to oprtimized plan. It can optimize the codegen
flow.
Update CompareTest to take table blocksize and kept as 32 Mb in order to make use of small
sorting when doing take ordered in spark.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message