Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-dev@hadoop.apache.org
Message-ID: <29870993.1201814709005.JavaMail.jira@brutus>
Date: Thu, 31 Jan 2008 13:25:09 -0800 (PST)
From: "Raghu Angadi (JIRA)" <jira@apache.org>
To: core-dev@hadoop.apache.org
Subject: [jira] Created: (HADOOP-2758) Reduce memory copies when data is
 read from DFS
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Reduce memory copies when data is read from DFS
-----------------------------------------------

                 Key: HADOOP-2758
                 URL: https://issues.apache.org/jira/browse/HADOOP-2758
             Project: Hadoop Core
          Issue Type: Improvement
          Components: dfs
            Reporter: Raghu Angadi
            Assignee: Raghu Angadi
             Fix For: 0.17.0


Currently datanode and client part of DFS perform multiple copies of data on the 'read path' (i.e. path from storage on datanode to user buffer on the client). This jira reduces these copies by enhancing data read protocol and implementation of read on both datanode and the client. I will describe the changes in next comment.

Requirement is that this fix should reduce CPU used and should not cause regression in any benchmarks. It might not improve the benchmarks since most benchmarks are not cpu bound.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.