hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-3083) Major compaction check should use new timestamp meta information in HFiles (rather than dfs timestamp) along with TTL to allow major even if single file
Date Mon, 08 Nov 2010 17:53:10 GMT

     [ https://issues.apache.org/jira/browse/HBASE-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Gray updated HBASE-3083:
---------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed.  Thanks for review stack.

> Major compaction check should use new timestamp meta information in HFiles (rather than
dfs timestamp) along with TTL to allow major even if single file
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-3083
>                 URL: https://issues.apache.org/jira/browse/HBASE-3083
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>             Fix For: 0.90.0
>
>         Attachments: HBASE-3083.patch
>
>
> Periodic major compactions have a separate set of checks prior to submitting the compaction
request.
> Currently, if there is a single file, and it is the result of a major compaction, then
it is skipped.  However, there is a check that will still allow it if the timestamp of the
file is older than the TTL of that Store.
> This is not ideal because the timestamp of the file is the latest timestamp in the file
rather than the oldest.  Meta information was introduced to HFiles that stores the max/min
timestamp of KVs in the file.  We should use the min timestamp from that meta info rather
than the file stamp itself.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message