From user-zh-return-965-archive-asf-public=cust-asf.ponee.io@flink.apache.org Tue Aug 27 09:23:02 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id B2591180654 for ; Tue, 27 Aug 2019 11:23:01 +0200 (CEST) Received: (qmail 83953 invoked by uid 500); 27 Aug 2019 09:23:01 -0000 Mailing-List: contact user-zh-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user-zh@flink.apache.org Delivered-To: mailing list user-zh@flink.apache.org Received: (qmail 83941 invoked by uid 99); 27 Aug 2019 09:23:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Aug 2019 09:23:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 28450C04BB for ; Tue, 27 Aug 2019 09:23:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.425 X-Spam-Level: *** X-Spam-Status: No, score=3.425 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HK_RANDOM_ENVFROM=0.626, HK_RANDOM_FROM=0.999, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id nOhkKbNhpV91 for ; Tue, 27 Aug 2019 09:22:58 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.167.65; helo=mail-lf1-f65.google.com; envelope-from=zjffdu@gmail.com; receiver= Received: from mail-lf1-f65.google.com (mail-lf1-f65.google.com [209.85.167.65]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id D60D6BDEAC for ; Tue, 27 Aug 2019 09:22:57 +0000 (UTC) Received: by mail-lf1-f65.google.com with SMTP id o11so5259311lfb.12 for ; Tue, 27 Aug 2019 02:22:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=igsjPRkjhKo5iiyBc3/wAWnA1uXSY7BiAhM3slvFnYo=; b=l9wUsiy+O8oBxAs8pH1y7bwAtKzkJu3K6hjGoQ//7HGZBYtOO5DdvaDLIMF1GhEImK gvesg5BWmsgK5pyy1s4SBi+0pt02ouJJxXWOkSjldfHtugp7oG0jLhWg50Zpu1HHxWWA 2AiRRm4McKvieUAw+C+D+uLCZGUNi9FSoxKz82zYSya7GhLK+7vd3lMeOJhr1O/9Nig1 Xnp5EDzhNAK3V+rQbdSqLC/+jrlwWRf1cQkl7JMecyF5R6p4JA0/S+vyzeD9wMHACvFM l4E2l+vV5qnxgxAyHonzouuPcaAmm035C/q1/jk+/MbhaPIX+oNJO1hbRhONYWRyaXd1 KkpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=igsjPRkjhKo5iiyBc3/wAWnA1uXSY7BiAhM3slvFnYo=; b=dIMe/q5EHCmQHH11650mj97XHXFJy6w7vclU96G3Su/C+0gG59IMIAeUrv4CwqZwKk uEp+Pi4nVNYp4xqgUxY2hc6+LNSOSYmzv0bwpue0gRHrWzDh6u+ERhU7jX2XoSjAUe8h Gd28qG5Y6kBHBhBXPY7CWLMr1s4h8RdqOsWUOsbonNN6zl2AiQK4bJIsEFdIJwXhq+Pi N+zJUemZQcdEg1dbtA6y0UvS1iuseE/KQlOJ9iPENI3LZiv1GTsNJxrjXKEs75r8/Gxw 0oQK9bdGKz3cvek2Zz1nKihRzieDO1kKzOXDUOWUTdczcpL7Eum73XQCly4iY/5ufBIa mWfg== X-Gm-Message-State: APjAAAXWJ8VQnGB/rjV8HZQiA0w1bFB0R4YvfSBabVRQ9Ar+5Cm2lAbL oMKKWtr8RN9UyDAIlP1WKw5RmD/s0rOMQniJPD+wA5pHw9K5cg== X-Google-Smtp-Source: APXvYqwEDZGFyLxQBQjthudxiMkdqtXv5ZrLQeWhtIduAoh4vssC17pVamB/CIqqHGGE0bmCCJf6JC94+Z1OeJLbn8c= X-Received: by 2002:a05:6512:78:: with SMTP id i24mr13374827lfo.55.1566897776395; Tue, 27 Aug 2019 02:22:56 -0700 (PDT) MIME-Version: 1.0 References: <549f81a8.10b74.16cce07c48e.Coremail.yws0328@126.com> In-Reply-To: <549f81a8.10b74.16cce07c48e.Coremail.yws0328@126.com> From: Jeff Zhang Date: Tue, 27 Aug 2019 17:22:44 +0800 Message-ID: Subject: =?UTF-8?B?UmU6IGZsaW5rMS43LjLlpoLkvZXov5vooYxoZGZz55qEa2VyYmVyb3PorqTor4E=?= To: user-zh@flink.apache.org Content-Type: multipart/alternative; boundary="0000000000005c8950059115d156" --0000000000005c8950059115d156 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable See https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/config.html= #kerberos-based-security =E6=9D=A8=E6=96=87=E7=94=9F-java=E5=BC=80=E5=8F=91 =E4=BA= =8E2019=E5=B9=B48=E6=9C=8827=E6=97=A5=E5=91=A8=E4=BA=8C =E4=B8=8B=E5=8D=883= :30=E5=86=99=E9=81=93=EF=BC=9A > > > public static void main(String[] args) throws Exception { > final ParameterTool parameterTool =3D ParameterTool > > .fromPropertiesFile(BizlogStreamWithEventTimeCleaner.class.getResourceAsS= tream(PROPERTIES_FILE_NAME)) > > .mergeWith(ParameterTool.fromArgs(args)); > String resultTable =3D parameterTool.get(BIZLOG_RESULT_TABLENAME)= ; > //=E8=AE=BE=E7=BD=AE=E7=AA=97=E5=8F=A3=E5=A4=A7=E5=B0=8F > Time windowSize =3D > Time.milliseconds(parameterTool.getLong(BIZLOG_WINDOW_SIZE)); > //=E8=AE=BE=E7=BD=AE=E6=95=B0=E6=8D=AE=E6=9C=80=E5=A4=A7=E4=B9=B1= =E5=BA=8F=E6=97=B6=E9=97=B4 > Time maxOutOfOrder =3D > Time.milliseconds(parameterTool.getLong(BIZLOG_WINDOW_MAXOUTOFORDE)); > hdfsAuthenticate(parameterTool); > ... > } > private static void hdfsAuthenticate(ParameterTool parameterTool) > throws IOException { > String kerberosConfFile =3D > BizlogStreamWithEventTimeCleaner.class.getClassLoader().getResource("krb5= .conf").getPath(); > > System.setProperty("java.security.krb5.conf", kerberosConfFile); > Configuration conf =3D new Configuration(); > conf.set(HADOOP_SECURITY_AUTHENTICATION, "kerberos"); > //=E5=8A=A0=E8=BD=BDhadoop=E9=85=8D=E7=BD=AE=E6=96=87=E4=BB=B6 > String principal =3D parameterTool.get("kerberos.princpal"); > String keytabName =3D parameterTool.get("keytab.name"); > String keytabPath =3D > BizlogStreamWithEventTimeCleaner.class.getClassLoader().getResource(keyta= bName).getPath(); > > UserGroupInformation.setConfiguration(conf); > UserGroupInformation.loginUserFromKeytab(principal, keytabPath); > } > > > =E4=BB=A3=E7=A0=81=E5=A6=82=E4=B8=8A=EF=BC=8C=E5=9C=A8idea=E4=B8=AD=E7=9B= =B4=E6=8E=A5=E8=BF=90=E8=A1=8C=E5=8F=AF=E4=BB=A5=E8=AE=A4=E8=AF=81=E9=80=9A= =E8=BF=87=EF=BC=8C=E4=BD=86=E6=98=AF=E6=89=93=E6=88=90jar=E5=8C=85=E6=8F=90= =E4=BA=A4=E5=88=B0=E9=9B=86=E7=BE=A4=E5=90=8E=E6=8A=A5=E9=94=99=E5=A6=82=E4= =B8=8B=EF=BC=9A > Caused by: java.io.IOException: Login failure for biuri/ > bj142.-in.domain@BTEST.COM from keytab > file:/data/realtime-flink.jar!/kerberos.keytab: > javax.security.auth.login.LoginException: Unable to obtain password from > user > =E8=BF=99=E4=B8=AA=E6=98=AF=E4=BB=80=E4=B9=88=E5=8E=9F=E5=9B=A0=EF=BC=9F= =E6=88=96=E8=80=85=E5=BA=94=E8=AF=A5=E5=A6=82=E4=BD=95=E8=BF=9B=E8=A1=8C=E6= =AD=A3=E7=A1=AE=E7=9A=84=E9=9B=86=E7=BE=A4=E8=AE=A4=E8=AF=81=EF=BC=9F > > > > --=20 Best Regards Jeff Zhang --0000000000005c8950059115d156--