lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joel Bernstein (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-12197) Implement sampling for logistic regression classifier
Date Fri, 06 Apr 2018 15:59:00 GMT

     [ https://issues.apache.org/jira/browse/SOLR-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Joel Bernstein updated SOLR-12197:
----------------------------------
    Description: 
Currently the *train* Streaming Expression trains a logistic regression model by iterating
over the entire distributed training set on each training iteration. Each training iteration
involves building a matrix on each shard with the number of rows equal to the size of the
training set contained on the shard. The number of columns will be the number of features.
This scenario can create very large matrices when working with large training sets and feature
sets.

This ticket will add a *sample* parameter which will limit the size of the training set on
each iteration to a random sample of the training set. This will allow for much larger training
sets.

  was:
Currently the *train* Streaming Expression trains a logistic regression model by iterating
over the entire distributed training set on each pass. Each iteration involves building a
matrix on each shard with the number of rows equal to the size of the training set contained
on the shard. The number of columns will be the number of features. This scenario can create
very large matrices when working with large training sets and feature sets.

This ticket will add a *sample* parameter which will limit the size of the training set on
each iteration to a random sample of the training set. This will allow for much larger training
sets.


> Implement sampling for logistic regression classifier
> -----------------------------------------------------
>
>                 Key: SOLR-12197
>                 URL: https://issues.apache.org/jira/browse/SOLR-12197
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: streaming expressions
>            Reporter: Joel Bernstein
>            Assignee: Joel Bernstein
>            Priority: Major
>             Fix For: 7.4
>
>
> Currently the *train* Streaming Expression trains a logistic regression model by iterating
over the entire distributed training set on each training iteration. Each training iteration
involves building a matrix on each shard with the number of rows equal to the size of the
training set contained on the shard. The number of columns will be the number of features.
This scenario can create very large matrices when working with large training sets and feature
sets.
> This ticket will add a *sample* parameter which will limit the size of the training
set on each iteration to a random sample of the training set. This will allow for much larger
training sets.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message