hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11226) ipc.Client has to use setTrafficClass() with IPTOS_LOWDELAY|IPTOS_RELIABILITY
Date Mon, 23 Feb 2015 06:47:12 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333052#comment-14333052

Gopal V commented on HADOOP-11226:

Sure, I will update the patch in a couple of days with a config option. 

To correct Colin, this patch was built for 10GigE (ixgbe drivers). I tested this with both
H-TCP and Cubic congestion control (2.6 and 3.1 kernels).

The RFCs listed in the patch apply only toTCP/IP not Infiniband RDMA (unless JDK7+ translates
the hints via SDP, which is something I'd love to be tested by the community).

> ipc.Client has to use setTrafficClass() with IPTOS_LOWDELAY|IPTOS_RELIABILITY
> -----------------------------------------------------------------------------
>                 Key: HADOOP-11226
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11226
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: ipc
>    Affects Versions: 2.6.0
>            Reporter: Gopal V
>            Assignee: Gopal V
>              Labels: Infiniband
>         Attachments: HADOOP-11226.1.patch, HADOOP-11226.2.patch
> During heavy shuffle, packet loss for IPC packets was observed from a machine.
> Avoid packet-loss and speed up transfer by using 0x14 QOS bits for the packets.

This message was sent by Atlassian JIRA

View raw message