hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3638) Cache the iFile index files in memory to reduce seeks during map output serving
Date Tue, 21 Oct 2008 22:22:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Chansler updated HADOOP-3638:
------------------------------------

    Release Note:   (was: Implements the caching of the IFile index files in memory, both
at the map side (merging spill files) and at the task tracker (serving map outputs to the
reducers). The cache at the task tracker is bounded by the configurable entry "mapred.tasktracker.indexcache.mb".
The LRC (Least Recently Created) Algorithm is used to maintain the cache in bounds.)

> Cache the iFile index files in memory to reduce seeks during map output serving
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-3638
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3638
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Devaraj Das
>            Assignee: Jothi Padmanabhan
>             Fix For: 0.19.0
>
>         Attachments: hadoop-3638-v1.patch, hadoop-3638-v10.patch, hadoop-3638-v2.patch,
hadoop-3638-v3.patch, hadoop-3638-v4.patch, hadoop-3638-v5.patch, hadoop-3638-v6.patch, hadoop-3638-v7.patch,
hadoop-3638-v8.patch, hadoop-3638-v9.patch
>
>
> The iFile index files can be cached in memory to reduce seeks during map output serving.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message