accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Tubbs (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2381) AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
Date Fri, 28 Mar 2014 17:55:19 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951136#comment-13951136
] 

Christopher Tubbs commented on ACCUMULO-2381:
---------------------------------------------

I'm not necessarily advocating for keeping this around, but I will say that it recently made
a colleague happy (on 1.4) to have this utility around to help recover from an HDFS corruption,
so it has at least some utility. However, I agree that it's a bit dangerous in its current
state, especially that it does not prompt or inform the user as it goes.

> AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
> ----------------------------------------------------------------------------
>
>                 Key: ACCUMULO-2381
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2381
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.6.0
>            Reporter: Eric Newton
>            Priority: Minor
>
> The usefulness of the AddFilesWithMissingEntries utility is questionable.
> #) it's very dangerous: it updates the metadata table of online tablets without checking
or warning users
> #) there's no use case for wanting to re-incorporate abandoned metadata files for the
metadata table
> #) the primary use case for this utility is to find abandoned files
> #) the list of files must fit in RAM, which probably requires changing jvm options on
large systems
> #) the quality and stability of accumulo has improved to the point where having these
sorts of crazy fix-it utilities is more trouble than they are worth
> #) as noted in ACCUMULO-2077, it does not work on multi-volume systems
> It would be nice to look for abandoned files, and it might even be worth doing in the
GC on a continuous basis. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message