Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 54CB2200B71 for ; Wed, 31 Aug 2016 23:26:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 52F65160AB5; Wed, 31 Aug 2016 21:26:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9A123160AA7 for ; Wed, 31 Aug 2016 23:26:21 +0200 (CEST) Received: (qmail 83989 invoked by uid 500); 31 Aug 2016 21:26:20 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 83959 invoked by uid 99); 31 Aug 2016 21:26:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 Aug 2016 21:26:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 98D902C1B7D for ; Wed, 31 Aug 2016 21:26:20 +0000 (UTC) Date: Wed, 31 Aug 2016 21:26:20 +0000 (UTC) From: "Virajith Jalaparti (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-9809) Abstract implementation-specific details from the datanode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 31 Aug 2016 21:26:22 -0000 [ https://issues.apache.org/jira/browse/HDFS-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9809: ------------------------------------- Attachment: DFSIO_benchmark_HDFS-9809.docx The doc attached shows the results of running DFSIO benchmark with trunk and HDFS-9809 applied on trunk (with the patches from HDFS-10636, HDFS-10637, and HDFS-10638 applied in that order). The results show that there is no statistically significant difference in the performance of the two builds (value +/- std deviations overlap). > Abstract implementation-specific details from the datanode > ---------------------------------------------------------- > > Key: HDFS-9809 > URL: https://issues.apache.org/jira/browse/HDFS-9809 > Project: Hadoop HDFS > Issue Type: Task > Components: datanode, fs > Reporter: Virajith Jalaparti > Assignee: Virajith Jalaparti > Attachments: DFSIO_benchmark_HDFS-9809.docx, HDFS-9809.001.patch, HDFS-9809.002.patch, HDFS-9809.003.patch, HDFS-9809.004.patch > > > Multiple parts of the Datanode (FsVolumeSpi, ReplicaInfo, FSVolumeImpl etc.) implicitly assume that blocks are stored in java.io.File(s) and that volumes are divided into directories. We propose to abstract these details, which would help in supporting other storages. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org