hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Runping Qi (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-2048) DISTCP mapper should report progress more often
Date Fri, 12 Oct 2007 23:35:50 GMT
DISTCP mapper should report progress more often
-----------------------------------------------

                 Key: HADOOP-2048
                 URL: https://issues.apache.org/jira/browse/HADOOP-2048
             Project: Hadoop
          Issue Type: Bug
            Reporter: Runping Qi



When I ran DISTCP to copy files from one dfs to another, I noticed that some mappers got killed
due to failing to report status for 606 seconds. 
I noticed that the mappers try to make a progress report for every 32MB copied. A better way
to ensure progress is to use a time interval since last report.




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message