Return-Path: Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: (qmail 57703 invoked from network); 5 Nov 2009 00:37:55 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 5 Nov 2009 00:37:55 -0000 Received: (qmail 30067 invoked by uid 500); 5 Nov 2009 00:37:55 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 29984 invoked by uid 500); 5 Nov 2009 00:37:55 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 29973 invoked by uid 99); 5 Nov 2009 00:37:55 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2009 00:37:55 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Nov 2009 00:37:52 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 66AEA234C04C for ; Wed, 4 Nov 2009 16:37:32 -0800 (PST) Message-ID: <1215221143.1257381452406.JavaMail.jira@brutus> Date: Thu, 5 Nov 2009 00:37:32 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: common-issues@hadoop.apache.org Subject: [jira] Updated: (HADOOP-3205) Read multiple chunks directly from FSInputChecker subclass into user buffers MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HADOOP-3205: -------------------------------- Status: Patch Available (was: Open) > Read multiple chunks directly from FSInputChecker subclass into user buffers > ---------------------------------------------------------------------------- > > Key: HADOOP-3205 > URL: https://issues.apache.org/jira/browse/HADOOP-3205 > Project: Hadoop Common > Issue Type: Bug > Components: fs > Reporter: Raghu Angadi > Assignee: Todd Lipcon > Attachments: hadoop-3205.txt > > > Implementations of FSInputChecker and FSOutputSummer like DFS do not have access to full user buffer. At any time DFS can access only up to 512 bytes even though user usually reads with a much larger buffer (often controlled by io.file.buffer.size). This requires implementations to double buffer data if an implementation wants to read or write larger chunks of data from underlying storage. > We could separate changes for FSInputChecker and FSOutputSummer into two separate jiras. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.