spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From MLnick <...@git.apache.org>
Subject [GitHub] spark pull request #16774: [SPARK-19357][ML] Adding parallel model evaluatio...
Date Tue, 05 Sep 2017 08:58:10 GMT
Github user MLnick commented on a diff in the pull request:

    https://github.com/apache/spark/pull/16774#discussion_r136930082
  
    --- Diff: mllib/src/test/scala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala ---
    @@ -120,6 +120,33 @@ class CrossValidatorSuite
         }
       }
     
    +  test("cross validation with parallel evaluation") {
    +    val lr = new LogisticRegression
    +    val lrParamMaps = new ParamGridBuilder()
    +      .addGrid(lr.regParam, Array(0.001, 1000.0))
    +      .addGrid(lr.maxIter, Array(0, 3))
    +      .build()
    +    val eval = new BinaryClassificationEvaluator
    +    val cv = new CrossValidator()
    +      .setEstimator(lr)
    +      .setEstimatorParamMaps(lrParamMaps)
    +      .setEvaluator(eval)
    +      .setNumFolds(2)
    +      .setParallelism(1)
    +    val cvSerialModel = cv.fit(dataset)
    +    cv.setParallelism(2)
    --- End diff --
    
    @BryanCutler may be worth posting the result to the JIRA for posterity.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message