kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu Shaohui (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-3994) StorageCleanupJob may delete cube id data of new built segment because of cube cache in CubeManager
Date Tue, 07 May 2019 05:26:00 GMT
Liu Shaohui created KYLIN-3994:
----------------------------------

             Summary: StorageCleanupJob may delete cube id data of new built segment because
of cube cache in CubeManager
                 Key: KYLIN-3994
                 URL: https://issues.apache.org/jira/browse/KYLIN-3994
             Project: Kylin
          Issue Type: Bug
    Affects Versions: v2.5.2
            Reporter: Liu Shaohui


In our production cluster, we found that the cube id data of a new-built segment is deleted
by the StorageCleanupJob.

After checking the code of cleanUnusedHdfsFiles in StorageCleanupJob, we found that there
is  a bug here:  CubeManager read all cube meta in initiation and cache it for later

listAllCubes operations, the metadata will be out of data after listing the hdfs working dir.

So the working directory of  a finished job may be deleted  unexpectedly.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message