hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Updated] (HIVE-11994) SHOW COMPACTIONS should include meta info about the job
Date Fri, 26 Aug 2016 02:09:20 GMT


Eugene Koifman updated HIVE-11994:
    Assignee:     (was: Eugene Koifman)

> SHOW COMPACTIONS should include meta info about the job
> -------------------------------------------------------
>                 Key: HIVE-11994
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore, Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
> Currently output of SHOW COMPACTIONS only has current information.
> it would very useful if it could retain the data for a configurable period of time after
the Cleaner handles the entry.  Perhaps the entry can go into 'h' state for 'historical'.
> Such historical data can be used to drive alert generating logic.
> We can add a column with a JSON doc which can include various stats about the job: number
of delta files, size in MB, time taken.  Also can be useful to collect job properties from
Hadoop, such as RAM used for example.  
> All of this can enhance the type/quality of alerts.

This message was sent by Atlassian JIRA

View raw message