From yarn-issues-return-177576-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Mon Feb 17 13:27:04 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 29FF7180674 for ; Mon, 17 Feb 2020 14:27:04 +0100 (CET) Received: (qmail 69865 invoked by uid 500); 17 Feb 2020 13:27:03 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 69853 invoked by uid 99); 17 Feb 2020 13:27:03 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Feb 2020 13:27:03 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id CC531E0F34 for ; Mon, 17 Feb 2020 13:27:02 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 6FB75780C22 for ; Mon, 17 Feb 2020 13:27:00 +0000 (UTC) Date: Mon, 17 Feb 2020 13:27:00 +0000 (UTC) From: "Adam Antal (Jira)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (YARN-10130) Do not allow output dir to be the same as input dir MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-10130?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10130: ------------------------------ Attachment: YARN-10130.002.patch > Do not allow output dir to be the same as input dir > --------------------------------------------------- > > Key: YARN-10130 > URL: https://issues.apache.org/jira/browse/YARN-10130 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Szilard Nemeth > Assignee: Adam Antal > Priority: Major > Attachments: YARN-10130.001.patch, YARN-10130.002.patch > > > If the input dir where fair-scheduler.xml / yarn-site.xml sits is the sam= e as the output dir (defined by the -o switch), the fs2cs tool overwrites t= he source config files, i.e. yarn-site.xml. > Reproduce this is easy, just run fs2cs tool with this command:=C2=A0 > {code:java} > /bin/yarn fs2cs --cluster-resource memory-mb=3D18044928,vcores=3D16 --no-= terminal-rule-check -y yarn-site.xml -f fair-scheduler.xml -o . > {code} > The following (or similar) is emitted by the tool: > {code:java} > WARNING: YARN_OPTS has been replaced by HADOOP_OPTS. Using value of YARN_= OPTS.WARNING: YARN_OPTS has been replaced by HADOOP_OPTS. Using value of YA= RN_OPTS.20/02/10 12:51:42 INFO converter.FSConfigToCSConfigConverter: Outpu= t directory for yarn-site.xml and capacity-scheduler.xml is: .20/02/10 12:5= 1:42 INFO converter.FSConfigToCSConfigConverter: Conversion rules file is n= ot defined, using default conversion config!20/02/10 12:51:42 ERROR conf.Co= nfiguration: error parsing conf yarn-site.xmlcom.ctc.wstx.exc.WstxEOFExcept= ion: Unexpected EOF in prolog at [row,col,system-id]: [1,0,"yarn-site.xml"]= at com.ctc.wstx.sr.StreamScanner.throwUnexpectedEOF(StreamScanner.java:687= ) at com.ctc.wstx.sr.BasicStreamReader.handleEOF(BasicStreamReader.java:222= 0) at com.ctc.wstx.sr.BasicStreamReader.nextFromProlog(BasicStreamReader.ja= va:2126) at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1= 181) at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration= .java:3343) at org.apache.hadoop.conf.Configuration$Parser.parse(Configurat= ion.java:3137) at org.apache.hadoop.conf.Configuration.loadResource(Configu= ration.java:3030) at org.apache.hadoop.conf.Configuration.loadResources(Con= figuration.java:2996) at org.apache.hadoop.conf.Configuration.getProps(Conf= iguration.java:2871) at org.apache.hadoop.conf.Configuration.set(Configurat= ion.java:1389) at org.apache.hadoop.conf.Configuration.set(Configuration.ja= va:1361) at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.j= ava:1702) at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.c= onverter.FSConfigToCSConfigConverter.createConfiguration(FSConfigToCSConfig= Converter.java:166) at org.apache.hadoop.yarn.server.resourcemanager.schedu= ler.fair.converter.FSConfigToCSConfigConverter.convert(FSConfigToCSConfigCo= nverter.java:98) at org.apache.hadoop.yarn.server.resourcemanager.scheduler= .fair.converter.FSConfigToCSConfigArgumentHandler.parseAndConvert(FSConfigT= oCSConfigArgumentHandler.java:137) at org.apache.hadoop.yarn.server.resourc= emanager.scheduler.fair.converter.FSConfigToCSConfigConverterMain.main(FSCo= nfigToCSConfigConverterMain.java:40)20/02/10 12:51:42 ERROR converter.FSCon= figToCSConfigConverterMain: Error while starting FS configuration conversio= n! > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org