spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Chambers (JIRA)" <>
Subject [jira] [Created] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs
Date Thu, 23 Feb 2017 18:27:44 GMT
Bill Chambers created SPARK-19714:

             Summary: Bucketizer Bug Regarding Handling Unbucketed Inputs
                 Key: SPARK-19714
             Project: Spark
          Issue Type: Bug
          Components: ML, MLlib
    Affects Versions: 2.1.0
            Reporter: Bill Chambers

contDF = spark.range(500).selectExpr("cast(id as double) as id")

val splits = Array(5.0, 10.0, 250.0, 500.0)

val bucketer = new Bucketizer()


You would expect that this would handle the invalid buckets. However it fails
Caused by: org.apache.spark.SparkException: Feature value 0.0 out of Bucketizer bounds [5.0,
500.0].  Check your features, or loosen the lower/upper bound constraints.
It seems strange that handleInvalud doesn't actually handleInvalid inputs.

Thoughts anyone?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message