Mailing-List: contact chukwa-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-dev@hadoop.apache.org
Message-ID: <27068903.54811280354176623.JavaMail.jira@thor>
Date: Wed, 28 Jul 2010 17:56:16 -0400 (EDT)
From: "Kirk True (JIRA)" <jira@apache.org>
To: chukwa-dev@hadoop.apache.org
Subject: [jira] Created: (CHUKWA-504) Implement ability to delete file in
 FileAdaptor after successfully uploaded
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Implement ability to delete file in FileAdaptor after successfully uploaded
---------------------------------------------------------------------------

                 Key: CHUKWA-504
                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
             Project: Chukwa
          Issue Type: New Feature
          Components: data collection
    Affects Versions: 0.4.0
            Reporter: Kirk True
            Priority: Minor
         Attachments: FileAdaptor.patch

My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.

Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.

Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.