hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-1965) Handle map output buffers better
Date Tue, 25 Dec 2007 06:45:43 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amar Kamat updated HADOOP-1965:
-------------------------------

    Status: Patch Available  (was: Open)

Changes :
1) Fixed the indentation 
2) Changed the synchronization variables so that they are less complicated and readable
3) Added a test for testing the *Thread-Safe* property of collect

> Handle map output buffers better
> --------------------------------
>
>                 Key: HADOOP-1965
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1965
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.16.0
>            Reporter: Devaraj Das
>            Assignee: Amar Kamat
>             Fix For: 0.16.0
>
>         Attachments: 1965_single_proc_150mb_gziped.jpeg, 1965_single_proc_150mb_gziped.pdf,
1965_single_proc_150mb_gziped_breakup.png, HADOOP-1965-1.patch, HADOOP-1965-Benchmark.patch,
HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch, HADOOP-1965-Benchmark.patch,
HADOOP-2419.patch, HADOOP-2419.patch, HADOOP-2419.patch
>
>
> Today, the map task stops calling the map method while sort/spill is using the (single
instance of) map output buffer. One improvement that can be done to improve performance of
the map task is to have another buffer for writing the map outputs to, while sort/spill is
using the first buffer.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message