spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-13081) Allow set pythonExec of driver and executor through configuration
Date Tue, 17 May 2016 09:49:13 GMT

    [ https://issues.apache.org/jira/browse/SPARK-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286317#comment-15286317
] 

Apache Spark commented on SPARK-13081:
--------------------------------------

User 'zjffdu' has created a pull request for this issue:
https://github.com/apache/spark/pull/13146

> Allow set pythonExec of driver and executor through configuration
> -----------------------------------------------------------------
>
>                 Key: SPARK-13081
>                 URL: https://issues.apache.org/jira/browse/SPARK-13081
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark, Spark Submit
>            Reporter: Jeff Zhang
>            Priority: Minor
>
> Currently user has to export environment variable PYSPARK_DRIVER_PYTHON and PYSPAR_PYTHON
to set the pythonExec of driver and executor. It is fine with interactive mode using bin/pyspark,
but it is not so convenient if user want to use pyspark in batch mode by using bin/spark-submit.
It would be better to allow user set pythonExec through "--conf"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message