spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-8525) Bug in Streaming k-means documentation
Date Sat, 04 Jul 2015 07:28:07 GMT

     [ https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen updated SPARK-8525:
-----------------------------
    Fix Version/s:     (was: 1.4.2)
                       (was: 1.2.3)
                       (was: 1.3.2)
                       (was: 1.1.2)
                   1.4.1

> Bug in Streaming k-means documentation
> --------------------------------------
>
>                 Key: SPARK-8525
>                 URL: https://issues.apache.org/jira/browse/SPARK-8525
>             Project: Spark
>          Issue Type: Bug
>          Components: Documentation, MLlib
>    Affects Versions: 1.1.1, 1.2.2, 1.3.1, 1.4.1
>            Reporter: Oleksiy Dyagilev
>            Assignee: Oleksiy Dyagilev
>            Priority: Minor
>             Fix For: 1.4.1, 1.5.0
>
>
> The expected input format is wrong in Streaming K-means documentation.
> https://spark.apache.org/docs/latest/mllib-clustering.html#streaming-k-means
> It might be a bug in implementation though, not sure.
> There shouldn't be any spaces in test data points. I.e. instead of 
> (y, [x1, x2, x3]) it should be
> (y,[x1,x2,x3])
> The exception thrown 
> org.apache.spark.SparkException: Cannot parse a double from:  
> 	at org.apache.spark.mllib.util.NumericParser$.parseDouble(NumericParser.scala:118)
> 	at org.apache.spark.mllib.util.NumericParser$.parseTuple(NumericParser.scala:103)
> 	at org.apache.spark.mllib.util.NumericParser$.parse(NumericParser.scala:41)
> 	at org.apache.spark.mllib.regression.LabeledPoint$.parse(LabeledPoint.scala:49)
> Also I would improve documentation saying explicitly that expected data types for both
'x' and 'y' is Double. At the moment it's not obvious especially for 'y'. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message