hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2892) providing temp space management for applications
Date Tue, 26 Feb 2008 20:18:51 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572638#action_12572638

Olga Natkovich commented on HADOOP-2892:

In my project, Pig, some queries cause a chain of M-R jobs to be ran with only the final results
being meaningful. It would be nice if we could write those intermediate results into the location
that is managed by hadoop and is automatically removed upon the chain completion.

This is just one of the examples. In general, an application might need to generate temp data
for a variety of reasons and providing a way to automatically reclaim the space when the data
is no longer needed is good for users as well as the system.

> providing temp space management for applications
> ------------------------------------------------
>                 Key: HADOOP-2892
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2892
>             Project: Hadoop Core
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
> It would be greate if hadoop can provide temp space for applications to use. This would
be useful for any applications that chain M-R jobs, perform checkpoint and need to store some
application specific temp results. DeleteOnExit for files and directories would be ideal.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message