hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
Date Tue, 18 Mar 2014 23:24:46 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939955#comment-13939955
] 

Rajesh Balamohan commented on MAPREDUCE-5787:
---------------------------------------------

>>
Is setting CONTENT_LENGTH important? Even so, for doing it, we are reading the index-record
two times - once here and once while sending the output. This will have performance impact.
>>
Yes, CONTENT_LENGTH is needed in the client side for keep alive.  A placeholder is needed
to avoid computing the index-record 2 times.  I will refactor and post the patch asap.

> Modify ShuffleHandler to support Keep-Alive
> -------------------------------------------
>
>                 Key: MAPREDUCE-5787
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787
>             Project: Hadoop Map/Reduce
>          Issue Type: Sub-task
>          Components: nodemanager
>    Affects Versions: 2.4.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Critical
>              Labels: ShuffleKeepalive
>         Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch,
MAPREDUCE-5787-2.4.0.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message