spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang-Chi Hsieh (JIRA)" <>
Subject [jira] [Commented] (SPARK-23455) Default Params in ML should be saved separately
Date Wed, 16 May 2018 02:48:00 GMT


Liang-Chi Hsieh commented on SPARK-23455:

According to [~josephkb]'s comment at [,]
R should be ok.

> Default Params in ML should be saved separately
> -----------------------------------------------
>                 Key: SPARK-23455
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>    Affects Versions: 2.4.0
>            Reporter: Liang-Chi Hsieh
>            Assignee: Liang-Chi Hsieh
>            Priority: Major
>             Fix For: 2.4.0
> We save ML's user-supplied params and default params as one entity in JSON. During loading
the saved models, we set all the loaded params into created ML model instances as user-supplied
> It causes some problems, e.g., if we strictly disallow some params to be set at the same
time, a default param can fail the param check because it is treated as user-supplied param
after loading.
> The loaded default params should not be set as user-supplied params. We should save ML
default params separately in JSON.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message