Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D53EF200CCB for ; Thu, 20 Jul 2017 20:26:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D394E16BBAC; Thu, 20 Jul 2017 18:26:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2863616BB95 for ; Thu, 20 Jul 2017 20:26:04 +0200 (CEST) Received: (qmail 82041 invoked by uid 500); 20 Jul 2017 18:26:02 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 81936 invoked by uid 99); 20 Jul 2017 18:26:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Jul 2017 18:26:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 61E861A1C51 for ; Thu, 20 Jul 2017 18:26:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id MG0JUvvMh3F8 for ; Thu, 20 Jul 2017 18:26:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 1F70F60D38 for ; Thu, 20 Jul 2017 18:26:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 5F12BE08F5 for ; Thu, 20 Jul 2017 18:26:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 155A921EC9 for ; Thu, 20 Jul 2017 18:26:00 +0000 (UTC) Date: Thu, 20 Jul 2017 18:26:00 +0000 (UTC) From: "Daryn Sharp (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HDFS-12172) Reduce EZ lookup overhead MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 20 Jul 2017 18:26:05 -0000 Daryn Sharp created HDFS-12172: ---------------------------------- Summary: Reduce EZ lookup overhead Key: HDFS-12172 URL: https://issues.apache.org/jira/browse/HDFS-12172 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 2.7.0 Reporter: Daryn Sharp Assignee: Daryn Sharp A number of inefficiencies exist in EZ lookups. These are amplified by frequent operations like list status. Once one encryption zone exists, all operations take the performance penalty. Ex. Operations should not perform redundant lookups. EZ path reconstruction should be lazy since it's not required in the common case. Renames do not need to reallocate new IIPs to check parent dirs for EZ. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org