flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1901) Create sample operator for Dataset
Date Fri, 21 Aug 2015 15:23:45 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706861#comment-14706861

ASF GitHub Bot commented on FLINK-1901:

Github user sachingoel0101 commented on the pull request:

    Hey @ChengXiangLi , I just observed a failure on a test case: https://travis-ci.org/sachingoel0101/flink/jobs/76649177
    Here is the relevant statement:
    RandomSamplerTest.testPoissonSamplerFraction:116->verifySamplerFraction:249 expected
fraction: 0.010000, result fraction: 0.009000

> Create sample operator for Dataset
> ----------------------------------
>                 Key: FLINK-1901
>                 URL: https://issues.apache.org/jira/browse/FLINK-1901
>             Project: Flink
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Theodore Vasiloudis
>            Assignee: Chengxiang Li
> In order to be able to implement Stochastic Gradient Descent and a number of other machine
learning algorithms we need to have a way to take a random sample from a Dataset.
> We need to be able to sample with or without replacement from the Dataset, choose the
relative or exact size of the sample, set a seed for reproducibility, and support sampling
within iterations.

This message was sent by Atlassian JIRA

View raw message