Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 82767200BCB for ; Thu, 24 Nov 2016 18:22:56 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 7DA2E160B1E; Thu, 24 Nov 2016 17:22:56 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C9081160AFB for ; Thu, 24 Nov 2016 18:22:55 +0100 (CET) Received: (qmail 6052 invoked by uid 500); 24 Nov 2016 17:22:54 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 6039 invoked by uid 99); 24 Nov 2016 17:22:54 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Nov 2016 17:22:54 +0000 Received: from mail-vk0-f47.google.com (mail-vk0-f47.google.com [209.85.213.47]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 991221A036E for ; Thu, 24 Nov 2016 17:22:54 +0000 (UTC) Received: by mail-vk0-f47.google.com with SMTP id x186so30129992vkd.1 for ; Thu, 24 Nov 2016 09:22:54 -0800 (PST) X-Gm-Message-State: AKaTC02wvM2n765l7jaAMsy5AmHvg2ZLOwM7Ml1wQuXclCFaUke8zOrFc7F/p8cICn8d+GcJYcvmiShh7To81g/b X-Received: by 10.31.223.68 with SMTP id w65mr1436085vkg.124.1480008173680; Thu, 24 Nov 2016 09:22:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.159.33.129 with HTTP; Thu, 24 Nov 2016 09:22:33 -0800 (PST) In-Reply-To: <1478874132510-14496.post@n3.nabble.com> References: <28A8A654-46A4-454E-A553-099A60341EAA@maprtech.com> <1478874132510-14496.post@n3.nabble.com> From: Maximilian Michels Date: Thu, 24 Nov 2016 18:22:33 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Flink using Yarn on MapR To: dev@flink.apache.org Cc: Naveen Tirupattur Content-Type: text/plain; charset=UTF-8 archived-at: Thu, 24 Nov 2016 17:22:56 -0000 Hi Naveen, The new Kerberos authentication code in Flink assumes that we're running against vanilla Hadoop. The unmodified Hadoop's behavior is to skip a secure login if security is not configured. This is different for the MapR Hadoop version. Thus, we need to make sure we don't perform any login action if security is not configured. I'm in the process of restructuring the security code. I've submitted a first PR which fixes the problem reported by you: https://github.com/apache/flink/pull/2864 Thanks, Max On Fri, Nov 11, 2016 at 3:22 PM, vijikarthi wrote: > Flink security context gets initialized during the application start phase. > As part of the initialization, the UserGroupInformation (UGI) instance is > bootstrapped using the Hadoop configuration files (read: HADOOP_CONF_DIR or > YARN_CONF_DIR environment variable is set). If the hadoop configuration > (core-site) enables security, then the UGI context uses JAAS module to > load/login through Kerberos. Looks like in this case, the Hadoop > configurations that got loaded somehow has the security enabled and UGI is > trying to obtain the identity using keytab cache. > > > > -- > View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Flink-using-Yarn-on-MapR-tp14484p14496.html > Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.