Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 469C5986B for ; Fri, 21 Oct 2011 06:11:03 +0000 (UTC) Received: (qmail 9528 invoked by uid 500); 21 Oct 2011 06:11:00 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 9239 invoked by uid 500); 21 Oct 2011 06:10:59 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 9184 invoked by uid 99); 21 Oct 2011 06:10:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2011 06:10:57 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2011 06:10:54 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id DE05030C793 for ; Fri, 21 Oct 2011 06:08:34 +0000 (UTC) Date: Fri, 21 Oct 2011 06:08:34 +0000 (UTC) From: "Todd Lipcon (Updated) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <761667540.852.1319177314910.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-1323) Pool/share file channels for HDFS read MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1323: ------------------------------ Component/s: performance > Pool/share file channels for HDFS read > -------------------------------------- > > Key: HDFS-1323 > URL: https://issues.apache.org/jira/browse/HDFS-1323 > Project: Hadoop HDFS > Issue Type: Improvement > Components: data-node, performance > Reporter: Jay Booth > Attachments: hdfs-1323-20100730.patch, hdfs-1323-trunk.txt > > > Currently, all reads in HDFS require opening and closing the underlying block/meta filechannels. We could pool these filechannels and save some system calls and other work. Since HDFS read requests can be satisfied by positioned reads and transferTos, we can even share these filechannels between concurrently executing requests. > The attached patch was benchmarked as part of work on HDFS-918 and exhibited a 10% performance increase for small random reads. > This does not affect client logic and involves minimal change to server logic. Patch is based on branch 20-append. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira