hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian Kunz (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1788) Increase the buffer size of pipes from 1k to 128k
Date Mon, 15 Oct 2007 16:05:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534878
] 

Christian Kunz commented on HADOOP-1788:
----------------------------------------

to 1: silly mistake: thank you for pointing it out
to 2: first it seemed to me an overkill to send progress upstream every second (especially
because it is flushed) but unless it is coordinated with the configurable 'mapred.task.timeout'
it might be not enough to send it just once per minute. Also it hardly makes a big difference
in performance. For now I will take it out.
to 3: I did not test it without the setsockopt, but I doubt it makes a difference -- I will
take it out.
to 4: as far as I know, 'hadoop.pipes.command.file' is only for debugging, so I did not bother
to do anything about it.

I upload a patch reflecting the changes due to 1-3.

> Increase the buffer size of pipes from 1k to 128k
> -------------------------------------------------
>
>                 Key: HADOOP-1788
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1788
>             Project: Hadoop
>          Issue Type: Bug
>          Components: pipes
>            Reporter: Owen O'Malley
>            Assignee: Amareshwari Sri Ramadasu
>         Attachments: patch-1788-1.txt, patch-1788-2.txt, patch-1788.txt
>
>
> Currently pipes applications use 1k writes to the socket and it should be larger to increase
throughput.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message