systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Niketan Pansare (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SYSTEMML-1092) Integrate python test cases into junit test case
Date Wed, 04 Apr 2018 16:44:00 GMT

    [ https://issues.apache.org/jira/browse/SYSTEMML-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425815#comment-16425815
] 

Niketan Pansare edited comment on SYSTEMML-1092 at 4/4/18 4:43 PM:
-------------------------------------------------------------------

Subtasks for this JIRAs are:
 # Investigate whether it is possible to package pyspark dependencies into our maven test
suite without spark installation.
 # If not, then come-up with simplest spark installation:
 ## Download spark and set SPARK_HOME
 ## Add pyspark as pip dependency
 # Enable tests [https://github.com/apache/systemml/blob/master/src/test/java/org/apache/sysml/test/integration/functions/python/PythonTestRunner.java#L41]

For reference, I believe PySpark test suite is kicked using the shell script: [https://github.com/apache/spark/blob/master/dev/run-tests-jenkins]


was (Author: niketanpansare):
Before closing this issue, one needs to investigate whether it is possible to package pyspark
dependencies into our maven test suite. If not, the following solution needs to be discussed
in the mailing list before adding SPARK_HOME requirement

- The Python tests are currently disabled as it requires the environment variable SPARK_HOME
to be set: https://github.com/apache/systemml/blob/master/src/test/java/org/apache/sysml/test/integration/functions/python/PythonTestRunner.java#L41
- For reference, I believe PySpark test suite is kicked using the shell script: https://github.com/apache/spark/blob/master/dev/run-tests-jenkins

> Integrate python test cases into junit test case
> ------------------------------------------------
>
>                 Key: SYSTEMML-1092
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1092
>             Project: SystemML
>          Issue Type: Task
>            Reporter: Niketan Pansare
>            Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message