hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-11994) SHOW COMPACTIONS should include history and meta info
Date Wed, 30 Sep 2015 00:34:04 GMT
Eugene Koifman created HIVE-11994:
-------------------------------------

             Summary: SHOW COMPACTIONS should include history and meta info
                 Key: HIVE-11994
                 URL: https://issues.apache.org/jira/browse/HIVE-11994
             Project: Hive
          Issue Type: Improvement
          Components: Metastore, Transactions
    Affects Versions: 1.0.0
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman


Currently output of SHOW COMPACTIONS only has current information.
it would very useful if it could retain the data for a configurable period of time after the
Cleaner handles the entry.  Perhaps the entry can go into 'h' state for 'historical'.

Such historical data can be used to drive alert generating logic.
We can add a column with a JSON doc which can include various stats about the job: number
of delta files, size in MB, time taken.  Also can be useful to collect job properties from
Hadoop, such as RAM used for example.  
All of this can enhance the type/quality of alerts.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message