Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.incubator.apache.org
Date: Tue, 13 Dec 2016 00:46:58 +0000 (UTC)
From: "Davor Bonaci (JIRA)" <jira@apache.org>
To: commits@beam.incubator.apache.org
Message-ID: <JIRA.13027638.1481589875000.504528.1481590018388@Atlassian.JIRA>
In-Reply-To: <JIRA.13027638.1481589875000@Atlassian.JIRA>
References: <JIRA.13027638.1481589875000@Atlassian.JIRA> <JIRA.13027638.1481589875090@arcas>
Subject: [jira] [Commented] (BEAM-1141) Beam Quickstart doesn't work on
 DataflowRunner
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 13 Dec 2016 00:48:17 -0000


    [ https://issues.apache.org/jira/browse/BEAM-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743694#comment-15743694 ] 

Davor Bonaci commented on BEAM-1141:
------------------------------------

Need to add a profile for the Dataflow runner, as all other runners are doing.

> Beam Quickstart doesn't work on DataflowRunner
> ----------------------------------------------
>
>                 Key: BEAM-1141
>                 URL: https://issues.apache.org/jira/browse/BEAM-1141
>             Project: Beam
>          Issue Type: Bug
>          Components: website
>            Reporter: Jason Kuster
>            Assignee: Davor Bonaci
>
> Repro steps:
> In new dir, run current archetype:generate command:
> {code}
> mvn archetype:generate \
>       -DarchetypeRepository=https://repository.apache.org/content/groups/snapshots \
>       -DarchetypeGroupId=org.apache.beam \
>       -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
>       -DarchetypeVersion=LATEST \
>       -DgroupId=org.example \
>       -DartifactId=word-count-beam \
>       -Dversion="0.1" \
>       -Dpackage=org.apache.beam.examples \
>       -DinteractiveMode=false
> {code}
> Then run the sample command for DataflowRunner:
> {code}
> mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
> 	 -Dexec.args="--runner=DataflowRunner --gcpTempLocation=gs://<your-gcs-bucket>/tmp \
> 	              --inputFile=gs://apache-beam-samples/shakespeare/* --output=gs://<your-gcs-bucket>/counts"
> {code}
> Expected outcome: WordCount runs on Dataflow
> Actual outcome:
> {code}
> [INFO] --- exec-maven-plugin:1.4.0:java (default-cli) @ word-count-beam ---
> [WARNING]
> java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner]
> 	at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1610)
> 	at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:105)
> 	at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:290)
> 	at org.apache.beam.examples.WordCount.main(WordCount.java:174)
> 	... 6 more
> Caused by: java.lang.ClassNotFoundException: DataflowRunner
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> 	at java.lang.Class.forName0(Native Method)
> 	at java.lang.Class.forName(Class.java:264)
> 	at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1596)
> 	... 9 more
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 17.916 s
> [INFO] Finished at: 2016-12-12T16:38:55-08:00
> [INFO] Final Memory: 29M/266M
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. null: InvocationTargetException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner] -> [Help 1]
> {code}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)