Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E040AC841 for ; Tue, 5 Jun 2012 16:40:23 +0000 (UTC) Received: (qmail 34186 invoked by uid 500); 5 Jun 2012 16:40:23 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 34157 invoked by uid 500); 5 Jun 2012 16:40:23 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 34149 invoked by uid 99); 5 Jun 2012 16:40:23 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Jun 2012 16:40:23 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id 8957A141663 for ; Tue, 5 Jun 2012 16:40:23 +0000 (UTC) Date: Tue, 5 Jun 2012 16:40:23 +0000 (UTC) From: "Lars Hofhansl (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1032458367.40052.1338914423565.JavaMail.jiratomcat@issues-vm> In-Reply-To: <467212993.9892.1301003525785.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-1783) Ability for HDFS client to write replicas in parallel MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-1783: -------------------------------- Attachment: HDFS-1783-trunk-v4.patch * added Stack's suggestions (thanks Stack): * added subclasses of TestReplication and TestDatanodeDeath, that run all tests with parallel writes enabled * found a problem with error handling (with TestDatanodeDeathWithParallelWrites), fixed it * renamed s[] to sockets[] > Ability for HDFS client to write replicas in parallel > ----------------------------------------------------- > > Key: HDFS-1783 > URL: https://issues.apache.org/jira/browse/HDFS-1783 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs client > Reporter: dhruba borthakur > Assignee: Lars Hofhansl > Attachments: HDFS-1783-trunk-v2.patch, HDFS-1783-trunk-v3.patch, HDFS-1783-trunk-v4.patch, HDFS-1783-trunk.patch > > > The current implementation of HDFS pipelines the writes to the three replicas. This introduces some latency for realtime latency sensitive applications. An alternate implementation that allows the client to write all replicas in parallel gives much better response times to these applications. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira