Mailing-List: contact mahout-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mahout-dev@lucene.apache.org
Message-ID: <833688337.1260210558085.JavaMail.jira@brutus>
Date: Mon, 7 Dec 2009 18:29:18 +0000 (UTC)
From: "Sean Owen (JIRA)" <jira@apache.org>
To: mahout-dev@lucene.apache.org
Subject: [jira] Commented: (MAHOUT-212) Need random sampler for use in
 reducers
In-Reply-To: <1825818266.1260163458097.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAHOUT-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787033#action_12787033 ] 

Sean Owen commented on MAHOUT-212:
----------------------------------

Yeah test injection was the idea behind using RandomUtils, since it will return a generator that uses the same seed every time when set in test mode. The unit tests do (should) set it globally as such, to make sure the results are deterministic. Yes the returned generator is a MersenneTwisterRNG which just extends Random.

Yes anything for testing should probably be package-private.

(I'd also suggest making the instance fields private here? not sure there's a big case for extension, at least, one that isn't perhaps better answered with explicit getters)

I dont' care about the test naming convention.

Once this is in place I'll put my similar Iterator next to it.

> Need random sampler for use in reducers
> ---------------------------------------
>
>                 Key: MAHOUT-212
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-212
>             Project: Mahout
>          Issue Type: Bug
>          Components: Utils
>    Affects Versions: 0.2
>            Reporter: Ted Dunning
>            Assignee: Sean Owen
>             Fix For: 0.3
>
>         Attachments: MAHOUT-212.patch
>
>
> For a variety of mining algorithms, it helps to have a uniform way to only process a sub-set of the records in a reducer.
> As such, I have written a simple generic sampler that filters an Iterator returning a fair sample of at most a specified size.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.