Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2834E200CC9 for ; Mon, 3 Jul 2017 05:01:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2726D160BFE; Mon, 3 Jul 2017 03:01:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6BE0B160BEE for ; Mon, 3 Jul 2017 05:01:03 +0200 (CEST) Received: (qmail 80486 invoked by uid 500); 3 Jul 2017 03:01:02 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 80475 invoked by uid 99); 3 Jul 2017 03:01:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Jul 2017 03:01:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id E1E0A1A7B19 for ; Mon, 3 Jul 2017 03:01:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id OMuYAbHwv3Mf for ; Mon, 3 Jul 2017 03:01:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id ECBC660DA1 for ; Mon, 3 Jul 2017 03:01:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 612DBE0D3C for ; Mon, 3 Jul 2017 03:01:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 141AB245DA for ; Mon, 3 Jul 2017 03:01:00 +0000 (UTC) Date: Mon, 3 Jul 2017 03:01:00 +0000 (UTC) From: "luhuichun (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-11975) Provide a system-default EC policy MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 03 Jul 2017 03:01:04 -0000 [ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16071874#comment-16071874 ] luhuichun commented on HDFS-11975: ---------------------------------- [~eddyxu][~Sammi][~drankye] Update the patch, the failed unit test is solved. For the issue of system-default EC policy, I set a two configuration in DFSConfigKeys.java. One for user setting, the other is hard code default value "RS-6-3-64k". The NameNodeRpcServer do the judgement according to the configuration and user CLI. Thanks for reviewing. > Provide a system-default EC policy > ---------------------------------- > > Key: HDFS-11975 > URL: https://issues.apache.org/jira/browse/HDFS-11975 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: erasure-coding > Affects Versions: 3.0.0-alpha3 > Reporter: Lei (Eddy) Xu > Assignee: luhuichun > Attachments: HDFS-11975-001.patch, HDFS-11975-002.patch, HDFS-11975-003.patch > > > From the usability point of view, it'd be nice to be able to specify a system-wide EC policy, i.e., in {{hdfs-site.xml}}. For most of users / admin / downstream projects, it is not necessary to know the tradeoffs of the EC policy, considering that it requires the knowledge of EC, the actual physical topology of the clusters, and many other factors (i.e., network, cluster size and etc). > -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org