hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gaurav Jain (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1115) [zebra] temp files are not cleaned.
Date Tue, 16 Feb 2010 18:29:28 GMT

     [ https://issues.apache.org/jira/browse/PIG-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Gaurav Jain updated PIG-1115:

    Attachment: PIG-1115.patch

Patch for the fix.

We rely on application to call BTOF.close() for successful jobs as in Hadoop 0.21 OutputCommitter
we can not differetiate b/w failed and successful jobs. Hadoop patch for this issue is available
in Hadoop 0.22

For the same reasons, we rely on applications to clean any unwanted files/dirs for FAILED
JOBS as they are doing currently.

Once the Hadoop patch/release is available, we can port the above inside zebra libraries.

> [zebra] temp files are not cleaned.
> -----------------------------------
>                 Key: PIG-1115
>                 URL: https://issues.apache.org/jira/browse/PIG-1115
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Hong Tang
>            Assignee: Gaurav Jain
>         Attachments: PIG-1115.patch
> Temp files created by zebra during table creation are not cleaned where there is any
task failure, which results in waste of disk space.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message