hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1719) Wrong map-output estimates by ResourceEstimator because of overflow errors in 'long' calculations
Date Thu, 22 Apr 2010 06:14:52 GMT
Wrong map-output estimates by ResourceEstimator because of overflow errors in 'long' calculations
-------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1719
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1719
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Vinod K V


On a cluster with disks nearly full, while running a simple sort job on a 10TBdata with ~100
maps, ResourceEstimator is not getting triggered even after 10%maps are completed. Instead,
maps keep on getting scheduled till the disks became full and then eventually when the disk
size becomes zero, the ResourceEstimator finally comes back alive saying it can find only
zero bytes instead of the estimated '9642' bytes. The estimate should have be close to 10GB.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message