systemml-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Janardhan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SYSTEMML-1973) Optimization of parameters, Hyperparameters, and testing.
Date Fri, 16 Feb 2018 03:50:00 GMT

     [ https://issues.apache.org/jira/browse/SYSTEMML-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Janardhan updated SYSTEMML-1973:
--------------------------------
    Description: 
This Epic tracks the algorithm optimization related improvements, and their testing.

*Phase 1:* Addition of support for bayesian optimization.

This procedure constructs a probabilistic model for f(x), and then exploits this model to
make decisions about where in input space to next evaluate the function, while integrating
out uncertainity. The essential philosophy is to use all of the information available from
previous evaluations of f(x).

 

When performing Bayesian Optimization, 

**1. one must select a prior over functions that will express assumptions about the function
being optimized. – *We choose Gaussian Process Prior*

2. need an acquisition function, which is used to construct a utility function from the model
posterior, allowing us to determine the next point to evaluate.

 

*Phase 2:* Addition of Model selection & cross validation support at Engine level or API
side.

Once the bayesian optimization is supported, the module is integrated into our API as described
in SYSTEMML-1962 . By wrapping the dml functions in the optimization algorithms and invoking
them either by java or python scripts.

 

*Phase 3:* Addition of Optimization test functions.

Testing of the training is done with the help of the well known benchmark functions, SYSTEMML-1974 ,
which can be imported or can be invoked with the help of python scripts or just by importing
the function into the dml script at hand.

  was:
This Epic tracks the algorithm optimization related improvements, and their testing.

*Phase 1:* Addition of support for bayesian optimization.

 


 *Phase 2:* Addition of Model selection & cross validation support at Engine level or
API side.

Once the bayesian optimization is supported, the module is integrated into our API,

 

*Phase 3:* Addition of Optimization test functions.


> Optimization of parameters, Hyperparameters, and testing.
> ---------------------------------------------------------
>
>                 Key: SYSTEMML-1973
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1973
>             Project: SystemML
>          Issue Type: Epic
>          Components: Algorithms, APIs, Documentation, Test
>            Reporter: Janardhan
>            Assignee: Janardhan
>            Priority: Major
>
> This Epic tracks the algorithm optimization related improvements, and their testing.
> *Phase 1:* Addition of support for bayesian optimization.
> This procedure constructs a probabilistic model for f(x), and then exploits this model
to make decisions about where in input space to next evaluate the function, while integrating
out uncertainity. The essential philosophy is to use all of the information available from
previous evaluations of f(x).
>  
> When performing Bayesian Optimization, 
> **1. one must select a prior over functions that will express assumptions about the function
being optimized. – *We choose Gaussian Process Prior*
> 2. need an acquisition function, which is used to construct a utility function from the
model posterior, allowing us to determine the next point to evaluate.
>  
> *Phase 2:* Addition of Model selection & cross validation support at Engine level
or API side.
> Once the bayesian optimization is supported, the module is integrated into our API as
described in SYSTEMML-1962 . By wrapping the dml functions in the optimization algorithms
and invoking them either by java or python scripts.
>  
> *Phase 3:* Addition of Optimization test functions.
> Testing of the training is done with the help of the well known benchmark functions,
SYSTEMML-1974 , which can be imported or can be invoked with the help of python scripts or
just by importing the function into the dml script at hand.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message