hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4087) [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases
Date Fri, 30 Mar 2012 10:40:27 GMT
[Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases
----------------------------------------------------------------------------

                 Key: MAPREDUCE-4087
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4087
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Ravi Gummadi
            Assignee: Ravi Gummadi


In map() method of GenerateDistCacheData job of Gridmix, val.setSize() is done every time
based on the bytes to be written to a distributed cache file. When we try to write data to
next distributed cache file in the same map task, the size of random data generated in each
iteration can become small based on the particular case. This can make this dist cache data
generation slow.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message