carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghunandan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CARBONDATA-1179) Improve the Object Size calculation for Objects added to LRU cache
Date Thu, 15 Jun 2017 07:36:00 GMT
Raghunandan created CARBONDATA-1179:
---------------------------------------

             Summary: Improve the Object Size calculation for Objects added to LRU cache
                 Key: CARBONDATA-1179
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1179
             Project: CarbonData
          Issue Type: Bug
            Reporter: Raghunandan
            Priority: Minor


Java Object model has a bigger overhead when loading the objects into memory.
The current way of estimating the object size by looking at the file size is not correct and
gives wrong results.Moreover due to this calculation, we are storing more than the configured
size for LRU cache.

Improve the ObjectSize calculation by using the spark SizeEstimator utility



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message