From core-dev-return-32166-apmail-hadoop-core-dev-archive=hadoop.apache.org@hadoop.apache.org Tue Mar 04 13:11:54 2008 Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 14984 invoked from network); 4 Mar 2008 13:11:53 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 4 Mar 2008 13:11:53 -0000 Received: (qmail 82670 invoked by uid 500); 4 Mar 2008 13:11:45 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 82649 invoked by uid 500); 4 Mar 2008 13:11:45 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 82634 invoked by uid 99); 4 Mar 2008 13:11:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Mar 2008 05:11:45 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Mar 2008 13:11:18 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 08A90234C096 for ; Tue, 4 Mar 2008 05:10:41 -0800 (PST) Message-ID: <978129200.1204636241034.JavaMail.jira@brutus> Date: Tue, 4 Mar 2008 05:10:41 -0800 (PST) From: "Hudson (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Commented: (HADOOP-2758) Reduce memory copies when data is read from DFS In-Reply-To: <29870993.1201814709005.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12574975#action_12574975 ] Hudson commented on HADOOP-2758: -------------------------------- Integrated in Hadoop-trunk #419 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/419/]) > Reduce memory copies when data is read from DFS > ----------------------------------------------- > > Key: HADOOP-2758 > URL: https://issues.apache.org/jira/browse/HADOOP-2758 > Project: Hadoop Core > Issue Type: Improvement > Components: dfs > Reporter: Raghu Angadi > Assignee: Raghu Angadi > Fix For: 0.17.0 > > Attachments: HADOOP-2758.patch, HADOOP-2758.patch, HADOOP-2758.patch, HADOOP-2758.patch, HADOOP-2758.patch, HADOOP-2758.patch > > > Currently datanode and client part of DFS perform multiple copies of data on the 'read path' (i.e. path from storage on datanode to user buffer on the client). This jira reduces these copies by enhancing data read protocol and implementation of read on both datanode and the client. I will describe the changes in next comment. > Requirement is that this fix should reduce CPU used and should not cause regression in any benchmarks. It might not improve the benchmarks since most benchmarks are not cpu bound. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.