accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Tubbs (JIRA)" <>
Subject [jira] [Commented] (ACCUMULO-2381) AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
Date Fri, 28 Mar 2014 17:55:19 GMT


Christopher Tubbs commented on ACCUMULO-2381:

I'm not necessarily advocating for keeping this around, but I will say that it recently made
a colleague happy (on 1.4) to have this utility around to help recover from an HDFS corruption,
so it has at least some utility. However, I agree that it's a bit dangerous in its current
state, especially that it does not prompt or inform the user as it goes.

> AddFilesWithMissingEntries needs to just find abandoned files, or be deleted
> ----------------------------------------------------------------------------
>                 Key: ACCUMULO-2381
>                 URL:
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.6.0
>            Reporter: Eric Newton
>            Priority: Minor
> The usefulness of the AddFilesWithMissingEntries utility is questionable.
> #) it's very dangerous: it updates the metadata table of online tablets without checking
or warning users
> #) there's no use case for wanting to re-incorporate abandoned metadata files for the
metadata table
> #) the primary use case for this utility is to find abandoned files
> #) the list of files must fit in RAM, which probably requires changing jvm options on
large systems
> #) the quality and stability of accumulo has improved to the point where having these
sorts of crazy fix-it utilities is more trouble than they are worth
> #) as noted in ACCUMULO-2077, it does not work on multi-volume systems
> It would be nice to look for abandoned files, and it might even be worth doing in the
GC on a continuous basis. 

This message was sent by Atlassian JIRA

View raw message