accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2381) AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
Date Thu, 27 Feb 2014 18:17:24 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914821#comment-13914821
] 

Keith Turner commented on ACCUMULO-2381:
----------------------------------------

For the case of finding and listing unused files, delete entries in the metadata table should
be considered.  The current utility does not do this.  For the case of adding unreferenced
files back, there may be cases where you would want to ignore delete entries.

> AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
> ----------------------------------------------------------------------------
>
>                 Key: ACCUMULO-2381
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2381
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.6.0
>            Reporter: Eric Newton
>            Priority: Minor
>
> The usefulness of the AddFilesWithMissingEntries utility is questionable.
> #) it's very dangerous: it updates the metadata table of online tablets without checking
or warning users
> #) there's no use case for wanting to re-incorporate abandoned metadata files for the
metadata table
> #) the primary use case for this utility is to find abandoned files
> #) the list of files must fit in RAM, which probably requires changing jvm options on
large systems
> #) the quality and stability of accumulo has improved to the point where having these
sorts of crazy fix-it utilities is more trouble than they are worth
> #) as noted in ACCUMULO-2077, it does not work on multi-volume systems
> It would be nice to look for abandoned files, and it might even be worth doing in the
GC on a continuous basis. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message