hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmed Radwan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7754) Expose file descriptors from Hadoop-wrapped local FileSystems
Date Wed, 15 Aug 2012 00:19:38 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434688#comment-13434688

Ahmed Radwan commented on HADOOP-7754:

Thanks Tucu, I have already uploaded the trunk patch earlier and it was picked by the precommit
job, see the jenkins report above (https://issues.apache.org/jira/browse/HADOOP-7754?focusedCommentId=13433769&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13433769).

The precommit result was showing the test failures from HADOOP-8699 (i.e, not related to this
ticket). I am re-uploading it again, but since HADOOP-8699 is not pushed, so likely the same
tests will fail again.
> Expose file descriptors from Hadoop-wrapped local FileSystems
> -------------------------------------------------------------
>                 Key: HADOOP-7754
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7754
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: native, performance
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>         Attachments: hadoop-7754-0.23.0-hasfd.txt, HADOOP-7754_branch-1_rev2.patch, HADOOP-7754_branch-1_rev3.patch,
HADOOP-7754_branch-1_rev4.patch, HADOOP-7754_trunk.patch, HADOOP-7754_trunk_rev2.patch, HADOOP-7754_trunk_rev2.patch,
HADOOP-7754_trunk_rev3.patch, HADOOP-7754_trunk_rev4.patch, HADOOP-7754_trunk_rev4.patch,
hasfd.txt, test-patch-hadoop-7754.txt
> In HADOOP-7714, we determined that using fadvise inside of the MapReduce shuffle can
yield very good performance improvements. But many parts of the shuffle are FileSystem-agnostic
and thus operate on FSDataInputStreams and RawLocalFileSystems. This JIRA is to figure out
how to allow RawLocalFileSystem to expose its FileDescriptor object without unnecessarily
polluting the public APIs.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message