Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A4372D531 for ; Thu, 7 Mar 2013 07:24:14 +0000 (UTC) Received: (qmail 31121 invoked by uid 500); 7 Mar 2013 07:24:14 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 31083 invoked by uid 500); 7 Mar 2013 07:24:13 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 31056 invoked by uid 500); 7 Mar 2013 07:24:13 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 31052 invoked by uid 99); 7 Mar 2013 07:24:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Mar 2013 07:24:12 +0000 Date: Thu, 7 Mar 2013 07:24:12 +0000 (UTC) From: "Matthias Friedrich (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CRUNCH-178) Add library functions for performing distributed reservoir sampling MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CRUNCH-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595635#comment-13595635 ] Matthias Friedrich commented on CRUNCH-178: ------------------------------------------- No objections, just a question: With this class, we'll have two separate classes for sampling that are named differently ("Sample" vs. "Sampling"). What about making this part of the existing Sample class and maybe move implementation details out to a package-private class? Or even start a new "sample" package if we expect more work in this area? > Add library functions for performing distributed reservoir sampling > ------------------------------------------------------------------- > > Key: CRUNCH-178 > URL: https://issues.apache.org/jira/browse/CRUNCH-178 > Project: Crunch > Issue Type: Improvement > Components: MapReduce Patterns > Reporter: Josh Wills > Attachments: CRUNCH-178.patch > > > For a project I've been working on, I wrote up some Crunch functions for performing reservoir sampling and weighted reservoir sampling that I think would be useful enough to put in lib.* Here's the paper that I used as a reference for the implementations I wrote: > http://arxiv.org/pdf/1012.0256.pdf -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira