hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3493) Add the default mapreduce.shuffle.port property to mapred-default.xml
Date Wed, 30 May 2012 11:42:23 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285590#comment-13285590
] 

Hudson commented on MAPREDUCE-3493:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #1061 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1061/])
    MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml.
Contributed by Madhukara Phatak. (harsh) (Revision 1343804)

     Result = SUCCESS
harsh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1343804
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml

                
> Add the default mapreduce.shuffle.port property to mapred-default.xml
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3493
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3493
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.0.0-alpha
>            Reporter: Ahmed Radwan
>            Priority: Minor
>              Labels: newbie
>             Fix For: 2.0.1-alpha
>
>         Attachments: MAPREDUCE-3493-1.patch, MAPREDUCE-3493-2.patch, MAPREDUCE-3493-3.patch,
MAPREDUCE-3493.patch, MAPREDUCE-3943-4.patch, MAPREDUCE-3943-4.patch
>
>
> I faced this issue when trying to run multiple Hadoop MR2 instances on the same node.
The default value for this property is hardcoded in the ShuffleHandler.java class so it results
in port conflicts. The issue is resolved if you set the property value in your conf files.
But the absence of this property from *-default.xml files is confusing. So It'll be cleaner
to move this property to mapred-default.xml, so its default value can be easily identified
and changed if needed. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message