Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AD72A200CAD for ; Wed, 28 Jun 2017 21:54:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id ABE96160BD9; Wed, 28 Jun 2017 19:54:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CCAA4160BFA for ; Wed, 28 Jun 2017 21:54:03 +0200 (CEST) Received: (qmail 14086 invoked by uid 500); 28 Jun 2017 19:54:03 -0000 Mailing-List: contact issues-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list issues@ambari.apache.org Received: (qmail 14000 invoked by uid 99); 28 Jun 2017 19:54:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2017 19:54:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9ABE0C0914 for ; Wed, 28 Jun 2017 19:54:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id qxMqqmCelWZL for ; Wed, 28 Jun 2017 19:54:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id D70905F5B8 for ; Wed, 28 Jun 2017 19:54:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 611DBE0637 for ; Wed, 28 Jun 2017 19:54:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1F12224161 for ; Wed, 28 Jun 2017 19:54:00 +0000 (UTC) Date: Wed, 28 Jun 2017 19:54:00 +0000 (UTC) From: "Jayush Luniya (JIRA)" To: issues@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (AMBARI-21370) Support VIPs instead of Host Names MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 28 Jun 2017 19:54:04 -0000 [ https://issues.apache.org/jira/browse/AMBARI-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067126#comment-16067126 ] Jayush Luniya edited comment on AMBARI-21370 at 6/28/17 7:53 PM: ----------------------------------------------------------------- The solution is as follows with the assumption that the masters that use VIPs are on dedicated hosts. # Set public host name as the VIP host name on each individual hosts. # *Quicklinks*: When public host name is configured, quicklinks already update the links to the public host name. # *JMX Metrics*: Use hostname and public hostname as fallback for JMX queries so that the JMX metrics are reported correctly as well as Active/Standby status is reported correctly. # *HDFS Service Definition*: Use host name as well as public host name to determine the NN id of the current host so that {{http://:50070}} as well as {{http://:50070}} both work. # *Alerts*: Pass public host name in alert definitions.json, update base alert to use both host name and public host name for picking appropriate HA config property. # *Port Alert*: While testing discovered that for ZKFC the interface used is same as that of NN, there is no config property for ZKFC to set the host name (http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hadoop/hadoop-hdfs/2.7.1/org/apache/hadoop/hdfs/tools/NNHAServiceTarget.java#123). To handle such cases, we need to fix port alert to handle the case when the uri doesn't include the host name then we should try both host name and public host name as fallback because if NN is listening to VIP interface instead of actual host interface, then ZKFC will also listen on the VIP interface and not on the actual host interface. *Current Limitation:* # We can configure public host name only at the host level, so in the case where NN and HBASE_MASTER are on the same host and each use different VIPs (nn1-vip-host-name, hbase1-vip-host-name), we cannot set up the cluster to handle it. # In the long term we should allow public host name to be configurable at host component instance level instead of host level. We will then be able to configure a host with components with different VIPs. was (Author: jluniya): The solution is as follows with the assumption that the masters that use VIPs are on dedicated hosts. # Set public host name as the VIP host name on each individual hosts. # *Quicklinks*: When public host name is configured, quicklinks already update the links to the public host name. # *JMX Metrics*: Use hostname and public hostname as fallback for JMX queries so that the JMX metrics are reported correctly as well as Active/Standby status is reported correctly. # *HDFS Service Definition*: Use host name as well as public host name to determine the NN id of the current host so that http://:50070 as well as http://:50070 both work. # *Alerts*: Pass public host name in alert definitions.json, update base alert to use both host name and public host name for picking appropriate HA config property. # *Port Alert*: While testing discovered that for ZKFC the interface used is same as that of NN, there is no config property for ZKFC to set the host name (http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hadoop/hadoop-hdfs/2.7.1/org/apache/hadoop/hdfs/tools/NNHAServiceTarget.java#123). To handle such cases, we need to fix port alert to handle the case when the uri doesn't include the host name then we should try both host name and public host name as fallback because if NN is listening to VIP interface instead of actual host interface, then ZKFC will also listen on the VIP interface and not on the actual host interface. *Current Limitation:* # We can configure public host name only at the host level, so in the case where NN and HBASE_MASTER are on the same host and each use different VIPs (nn1-vip-host-name, hbase1-vip-host-name), we cannot set up the cluster to handle it. # In the long term we should allow public host name to be configurable at host component instance level instead of host level. We will then be able to configure a host with components with different VIPs. > Support VIPs instead of Host Names > ---------------------------------- > > Key: AMBARI-21370 > URL: https://issues.apache.org/jira/browse/AMBARI-21370 > Project: Ambari > Issue Type: Bug > Components: alerts, ambari-agent, ambari-server, metrics, stacks > Affects Versions: 2.5.0 > Reporter: Jayush Luniya > Assignee: Jayush Luniya > Priority: Critical > Fix For: 2.5.2 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)