Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 387DF200BF3 for ; Thu, 22 Dec 2016 02:43:02 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 371A6160B3A; Thu, 22 Dec 2016 01:43:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7FCC0160B26 for ; Thu, 22 Dec 2016 02:43:01 +0100 (CET) Received: (qmail 36477 invoked by uid 500); 22 Dec 2016 01:43:00 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 36468 invoked by uid 99); 22 Dec 2016 01:43:00 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Dec 2016 01:43:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 23270CDB34 for ; Thu, 22 Dec 2016 01:43:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -7.019 X-Spam-Level: X-Spam-Status: No, score=-7.019 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id atlE54bhTxP4 for ; Thu, 22 Dec 2016 01:42:59 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 029B55F298 for ; Thu, 22 Dec 2016 01:42:58 +0000 (UTC) Received: (qmail 36388 invoked by uid 99); 22 Dec 2016 01:42:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Dec 2016 01:42:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 6B0722C1F54 for ; Thu, 22 Dec 2016 01:42:58 +0000 (UTC) Date: Thu, 22 Dec 2016 01:42:58 +0000 (UTC) From: "Pramod Immaneni (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-1203) Exception when running apex runner in non embedded mode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 22 Dec 2016 01:43:02 -0000 [ https://issues.apache.org/jira/browse/BEAM-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768718#comment-15768718 ] Pramod Immaneni commented on BEAM-1203: --------------------------------------- I would like to look at it. > Exception when running apex runner in non embedded mode > ------------------------------------------------------- > > Key: BEAM-1203 > URL: https://issues.apache.org/jira/browse/BEAM-1203 > Project: Beam > Issue Type: Bug > Components: runner-apex > Affects Versions: 0.5.0-incubating > Reporter: Pramod Immaneni > > Tried to run the word count example application using apex runner on yarn with the command below (the command refers to local files so app when running will not be able to access these files but that is a different issue). There is an exception and the application does not get launched. > mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/home/pramod/Development/test/kinglear.txt --output=/home/pramod/Development/test/wordcounts.txt --runner=ApexRunner --embeddedExecution=false" -Papex-runner > java.nio.file.FileAlreadyExistsException: META-INF/ > at com.sun.nio.zipfs.ZipFileSystem.createDirectory(ZipFileSystem.java:422) > at com.sun.nio.zipfs.ZipPath.createDirectory(ZipPath.java:634) > at com.sun.nio.zipfs.ZipFileSystemProvider.createDirectory(ZipFileSystemProvider.java:201) > at java.nio.file.Files.createDirectory(Files.java:630) > at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:266) > at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:252) > at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:192) > at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:199) > at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:69) > at java.nio.file.Files.walkFileTree(Files.java:2602) > at java.nio.file.Files.walkFileTree(Files.java:2635) > at org.apache.beam.runners.apex.ApexYarnLauncher.createJar(ApexYarnLauncher.java:252) > at org.apache.beam.runners.apex.ApexYarnLauncher.launchApp(ApexYarnLauncher.java:90) > at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:149) > at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:63) > at org.apache.beam.sdk.Pipeline.run(Pipeline.java:176) > at org.apache.beam.examples.WordCount.main(WordCount.java:184) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.4#6332)