Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 372C5200CF0 for ; Mon, 7 Aug 2017 05:12:06 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 359E3163EF7; Mon, 7 Aug 2017 03:12:06 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7AAA9163EF5 for ; Mon, 7 Aug 2017 05:12:05 +0200 (CEST) Received: (qmail 60222 invoked by uid 500); 7 Aug 2017 03:12:03 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 60104 invoked by uid 99); 7 Aug 2017 03:12:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Aug 2017 03:12:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 8D329C004A for ; Mon, 7 Aug 2017 03:12:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id nFI_5DZBGlbt for ; Mon, 7 Aug 2017 03:12:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 358595FAC9 for ; Mon, 7 Aug 2017 03:12:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 79EC5E0A31 for ; Mon, 7 Aug 2017 03:12:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 219682415E for ; Mon, 7 Aug 2017 03:12:00 +0000 (UTC) Date: Mon, 7 Aug 2017 03:12:00 +0000 (UTC) From: "Xiao Chen (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-12172) Reduce EZ lookup overhead MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 07 Aug 2017 03:12:06 -0000 [ https://issues.apache.org/jira/browse/HDFS-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16116028#comment-16116028 ] Xiao Chen commented on HDFS-12172: ---------------------------------- The failed tests and findbug warnings are not related to this jira. Hi [~daryn], Do you have cycles to review the slightly modified version of your patch? (Hope you don't mind me updating it. :) ) > Reduce EZ lookup overhead > ------------------------- > > Key: HDFS-12172 > URL: https://issues.apache.org/jira/browse/HDFS-12172 > Project: Hadoop HDFS > Issue Type: Improvement > Affects Versions: 2.7.0 > Reporter: Daryn Sharp > Assignee: Daryn Sharp > Attachments: HDFS-12172.01.patch, HDFS-12172.patch > > > A number of inefficiencies exist in EZ lookups. These are amplified by frequent operations like list status. Once one encryption zone exists, all operations take the performance penalty. > Ex. Operations should not perform redundant lookups. EZ path reconstruction should be lazy since it's not required in the common case. Renames do not need to reallocate new IIPs to check parent dirs for EZ. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org