hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-30) setting io.sort.factor does not have effect?
Date Sat, 31 Dec 2011 09:10:31 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Harsh J resolved MAPREDUCE-30.
------------------------------

    Resolution: Invalid

The sort factor works as intended. This was probably fixed a while ago.
                
> setting io.sort.factor does not have effect?
> --------------------------------------------
>
>                 Key: MAPREDUCE-30
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-30
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Runping Qi
>
> I have a m/r job with 84000 mappers.
> I set io.sort.factor to 200.
> The reducers still generates 800+ merged files, not  400+ I expected.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message