hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Booth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-1323) Pool/share file channels for HDFS read
Date Fri, 17 Jun 2011 13:27:50 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051066#comment-13051066
] 

Jay Booth commented on HDFS-1323:
---------------------------------

I could take a crack at it next week/weekend.  Will get my build set up and report back in
a week or two.

> Pool/share file channels for HDFS read
> --------------------------------------
>
>                 Key: HDFS-1323
>                 URL: https://issues.apache.org/jira/browse/HDFS-1323
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node
>            Reporter: Jay Booth
>         Attachments: hdfs-1323-20100730.patch, hdfs-1323-trunk.txt
>
>
> Currently, all reads in HDFS require opening and closing the underlying block/meta filechannels.
 We could pool these filechannels and save some system calls and other work.  Since HDFS read
requests can be satisfied by positioned reads and transferTos, we can even share these filechannels
between concurrently executing requests.
> The attached patch was benchmarked as part of work on HDFS-918 and exhibited a 10% performance
increase for small random reads.
> This does not affect client logic and involves minimal change to server logic.  Patch
is based on branch 20-append. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message