spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph K. Bradley (JIRA)" <>
Subject [jira] [Commented] (SPARK-12347) Write script to run all MLlib examples for testing
Date Thu, 03 Mar 2016 23:18:18 GMT


Joseph K. Bradley commented on SPARK-12347:

1. As in the JIRA description, there would need to be some list of special examples requiring

2. If an example requires an input file, it should be one of the provided input datasets which
comes with Spark, so I think it's OK to hard-code the names.

> Write script to run all MLlib examples for testing
> --------------------------------------------------
>                 Key: SPARK-12347
>                 URL:
>             Project: Spark
>          Issue Type: Test
>          Components: ML, MLlib, PySpark, SparkR, Tests
>            Reporter: Joseph K. Bradley
> It would facilitate testing to have a script which runs all MLlib examples for all languages.
> Design sketch to ensure all examples are run:
> * Generate a list of examples to run programmatically (not from a fixed list).
> * Use a list of special examples to handle examples which require command line arguments.
> * Make sure data, etc. used are small to keep the tests quick.
> This could be broken into subtasks for each language, though it would be nice to provide
a single script.
> Not sure where the script should live; perhaps in {{bin/}}?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message