Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 95021 invoked from network); 11 Mar 2010 19:31:25 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 11 Mar 2010 19:31:25 -0000 Received: (qmail 9223 invoked by uid 500); 11 Mar 2010 19:30:51 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 9197 invoked by uid 500); 11 Mar 2010 19:30:51 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 9189 invoked by uid 99); 11 Mar 2010 19:30:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Mar 2010 19:30:51 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Mar 2010 19:30:49 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 04917234C4BF for ; Thu, 11 Mar 2010 19:30:29 +0000 (UTC) Message-ID: <1240405505.210401268335829017.JavaMail.jira@brutus.apache.org> Date: Thu, 11 Mar 2010 19:30:29 +0000 (UTC) From: "Jay Booth (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Commented: (HDFS-1034) Enhance datanode to read data and checksum file in parallel In-Reply-To: <1244236374.208931268332467271.JavaMail.jira@brutus.apache.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844186#action_12844186 ] Jay Booth commented on HDFS-1034: --------------------------------- Wouldn't this preclude the use of transferTo for transfer from the main block file? The packet header and sums need to be sent before transferTo is invoked, otherwise things would all be jumbled up together. > Enhance datanode to read data and checksum file in parallel > ----------------------------------------------------------- > > Key: HDFS-1034 > URL: https://issues.apache.org/jira/browse/HDFS-1034 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: dhruba borthakur > Assignee: dhruba borthakur > > In the current HDFS implementation, a read of a block issued to the datanode results in a disk access to the checksum file followed by a disk access to the checksum file. It would be nice to be able to do these two IOs in parallel to reduce read latency. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.