hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6763) Shuffle server listen queue is too small
Date Fri, 19 Aug 2016 23:00:25 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15428997#comment-15428997
] 

Hudson commented on MAPREDUCE-6763:
-----------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10312 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/10312/])
MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via (varunsaxena: rev
723facfa408f469891e67084bdafa18841a0cf64)
* (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
* (edit) hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java


> Shuffle server listen queue is too small
> ----------------------------------------
>
>                 Key: MAPREDUCE-6763
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6763
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>             Fix For: 2.8.0, 2.7.4
>
>         Attachments: MAPREDUCE-6763.001.patch
>
>
> ShuffleHandler doesn't specify a listen queue length for the server port, so it ends
up getting the default listen queue length of 50.  This is too small to handle bursts of shuffle
traffic on large clusters.  It's also inconsistent with the default Hadoop uses for RPC servers
(default=128).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org


Mime
View raw message