airflow-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AIRFLOW-1089) Add Spark application arguments to SparkSubmitOperator
Date Tue, 25 Apr 2017 09:29:04 GMT

    [ https://issues.apache.org/jira/browse/AIRFLOW-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982629#comment-15982629
] 

ASF subversion and git services commented on AIRFLOW-1089:
----------------------------------------------------------

Commit e5b9147894b0d47bf36f1c2570d765b16c1c2506 in incubator-airflow's branch refs/heads/master
from [~camshrun]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=e5b9147 ]

[AIRFLOW-1089] Add Spark application arguments

Allows arguments to be passed to the Spark
application being
submitted. For example:

- spark-submit --class foo.Bar foobar.jar arg1
arg2
- spark-submit app.py arg1 arg2

Closes #2229 from camshrun/sparkSubmitAppArgs


> Add Spark application arguments to SparkSubmitOperator
> ------------------------------------------------------
>
>                 Key: AIRFLOW-1089
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1089
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>    Affects Versions: Airflow 1.8
>            Reporter: Stephan Werges
>
> Pass Spark application arguments to SparkSubmitOperator.  For example:
> spark-submit -class com.Foo.Bar foobar.jar arg1 arg2



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message