hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amir Youssefi (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-166) Disk Full
Date Fri, 21 Mar 2008 21:07:25 GMT
Disk Full
---------

                 Key: PIG-166
                 URL: https://issues.apache.org/jira/browse/PIG-166
             Project: Pig
          Issue Type: Bug
            Reporter: Amir Youssefi


Occasionally spilling fills up (all) hard drive(s) on a Data Node and crashes Task Tracker
(and other processes) on that node. We need to have a safety net and fail the task before
crashing happens (and more). 

In Pig + Hadoop setting, Task Trackers get Black Listed. And Pig console gets stock at a percentage
without returning nodes to cluster. I talked to Hadoop team to explore Max Percentage idea.
Nodes running into this problem get into permanent problems and manual cleaning by administrator
is necessary. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message