hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (HADOOP-7754) Expose file descriptors from Hadoop-wrapped local FileSystems
Date Thu, 11 Oct 2012 17:45:48 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Arun C Murthy closed HADOOP-7754.

> Expose file descriptors from Hadoop-wrapped local FileSystems
> -------------------------------------------------------------
>                 Key: HADOOP-7754
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7754
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: native, performance
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 1.2.0, 2.0.2-alpha
>         Attachments: hadoop-7754-0.23.0-hasfd.txt, HADOOP-7754_branch-1_rev2.patch, HADOOP-7754_branch-1_rev3.patch,
HADOOP-7754_branch-1_rev4.patch, HADOOP-7754_trunk.patch, HADOOP-7754_trunk_rev2.patch, HADOOP-7754_trunk_rev2.patch,
HADOOP-7754_trunk_rev3.patch, HADOOP-7754_trunk_rev4.patch, HADOOP-7754_trunk_rev4.patch,
HADOOP-7754_trunk_rev4.patch, hasfd.txt, test-patch-hadoop-7754.txt
> In HADOOP-7714, we determined that using fadvise inside of the MapReduce shuffle can
yield very good performance improvements. But many parts of the shuffle are FileSystem-agnostic
and thus operate on FSDataInputStreams and RawLocalFileSystems. This JIRA is to figure out
how to allow RawLocalFileSystem to expose its FileDescriptor object without unnecessarily
polluting the public APIs.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message