crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian Tzolov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-178) Add library functions for performing distributed reservoir sampling
Date Sun, 10 Mar 2013 01:29:12 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13598127#comment-13598127
] 

Christian Tzolov commented on CRUNCH-178:
-----------------------------------------

Just out of curiosity, the patch seems to implement the A-ES algorithm, useful for WRS-N-W
and WRS-R sampling (according to the article). Is the WRS-N-P case less common? (just curious)

Also would the 'jumps' optimisation be worth implementing in the context of Hadoop M/R? 

                
> Add library functions for performing distributed reservoir sampling
> -------------------------------------------------------------------
>
>                 Key: CRUNCH-178
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-178
>             Project: Crunch
>          Issue Type: Improvement
>          Components: MapReduce Patterns
>            Reporter: Josh Wills
>         Attachments: CRUNCH-178.patch
>
>
> For a project I've been working on, I wrote up some Crunch functions for performing reservoir
sampling and weighted reservoir sampling that I think would be useful enough to put in lib.*
Here's the paper that I used as a reference for the implementations I wrote:
> http://arxiv.org/pdf/1012.0256.pdf

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message