Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 42215200BCE for ; Fri, 2 Dec 2016 12:13:39 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 40D3A160B24; Fri, 2 Dec 2016 11:13:39 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 89547160B16 for ; Fri, 2 Dec 2016 12:13:38 +0100 (CET) Received: (qmail 61672 invoked by uid 500); 2 Dec 2016 11:13:37 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 61662 invoked by uid 99); 2 Dec 2016 11:13:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Dec 2016 11:13:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 33D601803A3 for ; Fri, 2 Dec 2016 11:13:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.019 X-Spam-Level: X-Spam-Status: No, score=-7.019 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Phv5IUg6DzVQ for ; Fri, 2 Dec 2016 11:13:35 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 8AF285FDA2 for ; Fri, 2 Dec 2016 11:12:51 +0000 (UTC) Received: (qmail 58839 invoked by uid 99); 2 Dec 2016 11:12:45 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Dec 2016 11:12:45 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 7A3C8E04BB; Fri, 2 Dec 2016 11:12:45 +0000 (UTC) From: mxm To: issues@flink.incubator.apache.org Reply-To: issues@flink.incubator.apache.org References: In-Reply-To: Subject: [GitHub] flink issue #2917: [FLINK-2821] use custom Akka build to listen on all inter... Content-Type: text/plain Message-Id: <20161202111245.7A3C8E04BB@git1-us-west.apache.org> Date: Fri, 2 Dec 2016 11:12:45 +0000 (UTC) archived-at: Fri, 02 Dec 2016 11:13:39 -0000 Github user mxm commented on the issue: https://github.com/apache/flink/pull/2917 Thanks for checking out the code! >If different parts of the code or the JDK do a subtle change of behavior (i.e. resolve the InetAddress), then some nodes may have a hostname in the URL, others an address. Fair point. Let's remove InetAddress and use a String instead. >If two machines have a slightly different network configuration (especially concerning preferences to represent/encode IPv6 addresses) and the users set the IP address as the JobManager host, then they might create different Akka URLs and the machines cannot talk to each other again. A problem of the old method was that hostnames might resolve differently depending on the container context. So that method was not reliable either. Using IP addresses will work with the new method. They just have to be consistent on all node configurations. I don't think that is a problem because a configuration is usually created once and then copied over to all nodes. >I am a bit unsure how to proceed from here. Is there any way we can keep using IP addresses in the Akka URLs? Or does that just inherently not make sense with "dynamic hostnames" as they are used in container environments? For this PR to address the core problems of FLINK-2821, we have to avoid resolving the hostname because the IP address would represent the internal container address which may be unreachable from the outside; even if it were resolvable, Akka would drop the messages because of its exact URL match policy. Using the hostname which now acts as a purely logical address ultimately is a more reliable way across different network environments. We just have to make sure we document the new requirement that the JobManager address (JOB_MANAGER_IPC_ADDRESS) is consistent across all Flink cluster nodes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---