From yarn-issues-return-140656-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Tue Mar 27 10:06:04 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 056DA18064E for ; Tue, 27 Mar 2018 10:06:03 +0200 (CEST) Received: (qmail 50781 invoked by uid 500); 27 Mar 2018 08:06:02 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 50768 invoked by uid 99); 27 Mar 2018 08:06:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Mar 2018 08:06:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 18EB6C0161 for ; Tue, 27 Mar 2018 08:06:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.31 X-Spam-Level: X-Spam-Status: No, score=-110.31 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100, WEIRD_PORT=0.001] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id wm4cdDQCCvto for ; Tue, 27 Mar 2018 08:06:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id BCDE35FB92 for ; Tue, 27 Mar 2018 08:06:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 3FCC4E0114 for ; Tue, 27 Mar 2018 08:06:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 0B65721506 for ; Tue, 27 Mar 2018 08:06:00 +0000 (UTC) Date: Tue, 27 Mar 2018 08:06:00 +0000 (UTC) From: "Alexandre Linte (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-7618) YARN REST APi - can't launch yarn job on Kerberised Cluster MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-7618?page=3Dcom.atlassian.= jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D16415= 187#comment-16415187 ]=20 Alexandre Linte commented on YARN-7618: --------------------------------------- No news about that ? BR. > YARN REST APi - can't launch yarn job on Kerberised Cluster > ----------------------------------------------------------- > > Key: YARN-7618 > URL: https://issues.apache.org/jira/browse/YARN-7618 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 2.7.4 > Environment: Hadoop 2.7.4 - Kerberized cluster > Reporter: Alexandre Linte > Priority: Critical > > Hello, > I'm currently trying to launch a yarn job through an Hadoop kerberized cl= uster following documentation ( https://hadoop.apache.org/docs/r2.7.4/hadoo= p-yarn/hadoop-yarn-site/ResourceManagerRest.html ) > I'm doing these operation with an active kerberos keytab. > I begin to create my new-application=20 > {code:title=3Dcurl new-app|borderStyle=3Dsolid} > curl --negotiate -u : -XPOST http://uabigrm01.node.com:8088/ws/v1/cluster= /apps/new-application > response : > {"application-id":"application_1507815642943_271826","maximum-resource-ca= pability":{"memory":32768,"vCores":24}} > {code} > After that I submit my application :=20 > {code:title=3Dcurl submit|borderStyle=3Dsolid} > curl --negotiate -u : -XPOST -H "Content-Type: application/json" --data @= "submit.json" http://uabigrm01.node.com:8088/ws/v1/cluster/apps > {code} > Content of submit.json file : > {code:title=3Dsubmit.json|borderStyle=3Dsolid} > { > "application-id": "application_1507815642943_271826", > "application-name": "yarn-api-test-new", > "queue": "myqueue", > "am-container-spec": { > "commands": { > "command": "{{HADOOP_HOME}}/bin/yarn jar /opt/application/Had= oop/current/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar word= count /user/mwxk0647/WORK/dataset-input /user/mwxk0647/WORK/dataset-output-= test-yarn" > }, > "environment": { > "entry": [{ > "key": "CLASSPATH", > "value":"{{CLASSPATH}}./*{{HADOOP_CONF_DIR}}{{HADOOP_COMMON_HOME}}/share/hadoop/common/*{{HADOOP_COMMON_HOME}}/s= hare/hadoop/common/lib/*{{HADOOP_HDFS_HOME}}/share/hadoop/hdfs/*{= {HADOOP_HDFS_HOME}}/share/hadoop/hdfs/lib/*{{HADOOP_YARN_HOME}}/share/= hadoop/yarn/*{{HADOOP_YARN_HOME}}/share/hadoop/yarn/lib/*./log4j.= properties" > }] > } > }, > "unmanaged-AM": false, > "max-app-attempts": 2, > "resource": { > "memory": 1024, > "vCores": 1 > }, > "application-type": "MAPREDUCE", > "keep-containers-across-application-attempts": false > } > {code} > I can see job on scheduler, he is submit but He failed due to a Kerberos = authentication error... > {code:title=3Dtracelogs|borderStyle=3Dsolid} > User: =09mwxk0647 > Name: =09yarn-api-test > Application Type: =09MAPREDUCE > Application Tags: =09 > YarnApplicationState: =09FAILED > Queue: =09myqueue > FinalStatus Reported by AM: =09FAILED > Started: =09Wed Dec 06 14:45:56 +0100 2017 > Elapsed: =0910sec > Tracking URL: =09History > Diagnostics: =09 > Application application_1507815642943_424552 failed 2 times due to AM Con= tainer for appattempt_1507815642943_424552_000002 exited with exitCode: 255 > For more detailed output, check application tracking page:http://uabigrm0= 1.node.com:8188/applicationhistory/app/application_1507815642943_424552Then= , click on links to logs of each attempt. > Diagnostics: Exception from container-launch. > Container id: container_1507815642943_424552_02_000001 > Exit code: 255 > Exception message: java.io.IOException: Failed on local exception: java.i= o.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caus= ed by GSSException: No valid credentials provided (Mechanism level: Failed = to find any Kerberos tgt)]; Host Details : local host is: "uabigdata69.node= .com/10.77.64.69"; destination host is: "uabigname02.node.com":8020;=20 > {code} > So kerberos is OK for submit app, but not for launch job. > For the moment I make application works making manually my kinit on the d= atanode : > {code:borderStyle=3Dsolid} > =E2=80=9Ccommand=E2=80=9D: "echo | kinit mwxk0647 && {{HADOO= P_HOME}}/bin/yarn jar...=20 > {code} > But It's really ugly... And on scheduler, it display a first job which fa= il as before, but it launch the wordcount job, which is very strange.. > How can i make YARN REST API work properly on a Kerberized Environment ? > Best Regards. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org