Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E61E9200C45 for ; Tue, 14 Mar 2017 01:32:46 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id E4ACF160B5D; Tue, 14 Mar 2017 00:32:46 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 39AE5160B85 for ; Tue, 14 Mar 2017 01:32:46 +0100 (CET) Received: (qmail 32944 invoked by uid 500); 14 Mar 2017 00:32:45 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 32897 invoked by uid 99); 14 Mar 2017 00:32:45 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Mar 2017 00:32:45 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E1058182765 for ; Tue, 14 Mar 2017 00:32:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.451 X-Spam-Level: * X-Spam-Status: No, score=1.451 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_NEUTRAL=0.652] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id aKWPGGgMkjd3 for ; Tue, 14 Mar 2017 00:32:44 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 893875F47E for ; Tue, 14 Mar 2017 00:32:43 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 87B30E05C1 for ; Tue, 14 Mar 2017 00:32:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id EBEFD243AE for ; Tue, 14 Mar 2017 00:32:41 +0000 (UTC) Date: Tue, 14 Mar 2017 00:32:41 +0000 (UTC) From: "Arpit Agarwal (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 14 Mar 2017 00:32:47 -0000 [ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11482: --------------------------------- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) Thanks [~vagarychen]. I've committed this to trunk. Thanks [~linyiqun] for the code reviews. > Add storage type demand to into DFSNetworkTopology#chooseRandom > --------------------------------------------------------------- > > Key: HDFS-11482 > URL: https://issues.apache.org/jira/browse/HDFS-11482 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: namenode > Reporter: Chen Liang > Assignee: Chen Liang > Fix For: 3.0.0-alpha3 > > Attachments: HDFS-11482.001.patch, HDFS-11482.002.patch, HDFS-11482.003.patch, HDFS-11482.004.patch, HDFS-11482.005.patch, HDFS-11482.006.patch, HDFS-11482.007.patch, HDFS-11482.008.patch, HDFS-11482.009.patch, HDFS-11482.010.patch > > > HDFS-11450 adds storage type info into network topology, with on this info we may change chooseRandom to take storage type requirement as parameter, only checking subtrees required storage type available. This way we avoid blindly picking up nodes that are not applicable. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org