hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader
Date Fri, 11 Aug 2017 23:31:00 GMT
Prasanth Jayachandran created HIVE-17304:
--------------------------------------------

             Summary: ThreadMXBean based memory allocation monitory for hash table loader
                 Key: HIVE-17304
                 URL: https://issues.apache.org/jira/browse/HIVE-17304
             Project: Hive
          Issue Type: Bug
    Affects Versions: 3.0.0
            Reporter: Prasanth Jayachandran
            Assignee: Prasanth Jayachandran


Hash table memory monitoring is based on java data model which can be unreliable because of
various reasons (wrong object size estimation, adding new variables to any class without accounting
its size for memory monitoring, etc.). We can use allocation size per thread that is provided
by ThreadMXBean and fallback to DataModel in case if JDK doesn't support thread based allocations.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message