hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jothi Padmanabhan (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3638) Cache the iFile index files in memory to reduce seeks during map output serving
Date Thu, 25 Sep 2008 03:55:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jothi Padmanabhan updated HADOOP-3638:
--------------------------------------

    Release Note: Implements the caching of the IFile index files in memory, both at the map
side (merging spill files) and at the task tracker (serving map outputs to the reducers).
The cache at the task tracker is bounded by the configurable entry "mapred.tasktracker.indexcache.mb".
The LRC (Least Recently Created) Algorithm is used to maintain the cache in bounds.

> Cache the iFile index files in memory to reduce seeks during map output serving
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-3638
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3638
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Devaraj Das
>            Assignee: Jothi Padmanabhan
>             Fix For: 0.19.0
>
>         Attachments: hadoop-3638-v1.patch, hadoop-3638-v10.patch, hadoop-3638-v2.patch,
hadoop-3638-v3.patch, hadoop-3638-v4.patch, hadoop-3638-v5.patch, hadoop-3638-v6.patch, hadoop-3638-v7.patch,
hadoop-3638-v8.patch, hadoop-3638-v9.patch
>
>
> The iFile index files can be cached in memory to reduce seeks during map output serving.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message