hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amir Youssefi (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-166) Disk Full
Date Fri, 21 Mar 2008 21:07:25 GMT
Disk Full

                 Key: PIG-166
                 URL: https://issues.apache.org/jira/browse/PIG-166
             Project: Pig
          Issue Type: Bug
            Reporter: Amir Youssefi

Occasionally spilling fills up (all) hard drive(s) on a Data Node and crashes Task Tracker
(and other processes) on that node. We need to have a safety net and fail the task before
crashing happens (and more). 

In Pig + Hadoop setting, Task Trackers get Black Listed. And Pig console gets stock at a percentage
without returning nodes to cluster. I talked to Hadoop team to explore Max Percentage idea.
Nodes running into this problem get into permanent problems and manual cleaning by administrator
is necessary. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message