kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard Calaba (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-1857) Show available memory on UI - in System Tab (and other runtime statistics)
Date Thu, 07 Jul 2016 15:49:11 GMT
Richard Calaba created KYLIN-1857:
-------------------------------------

             Summary: Show available memory on UI - in System Tab (and other runtime statistics)
                 Key: KYLIN-1857
                 URL: https://issues.apache.org/jira/browse/KYLIN-1857
             Project: Kylin
          Issue Type: Improvement
    Affects Versions: v1.5.2, v1.5.2.1
            Reporter: Richard Calaba
            Priority: Minor


I have run into situation that Kylin dies (exception in log says heap out of memory) if I
try to run 3 parallel cubes with high-cardinality dimensions. It is reproduceable scenario.
I have set max snapshot size to 2GB and -Xmx to 16GB. 

If I run the cube build one-by-one -> Kylin doesn't die. 

As we have have no idea about memory requirements before we start building the cube(s) then
for now it would be beneficial at least to monitor basic Kylin VM statistics, i.e.:

 -- current memory occupied by snaphots
 -- total memory allocation & total free memory 
 -- how many (and which) temporary (intermediate) objects (in hive/hbase/filesystem) are created
... 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message