hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2233) General example for modeling m/r load in Java
Date Mon, 17 Dec 2007 19:20:43 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Douglas updated HADOOP-2233:

    Attachment: 2233-4.patch

Moved GenericMRLoadGenerator from o.a.h.examples in examples to o.a.h.mapred in test (removing
the dependency on RandomWriter). Also changed generating map output from BytesWritable to
Text using the same strategy RandomTextWriter employs for more realistic compression from

> General example for modeling m/r load in Java
> ---------------------------------------------
>                 Key: HADOOP-2233
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2233
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: test
>            Reporter: Chris Douglas
>            Assignee: Chris Douglas
>            Priority: Minor
>             Fix For: 0.16.0
>         Attachments: 2233-0.patch, 2233-1.patch, 2233-2.patch, 2233-3.patch, 2233-4.patch
> This matches the hadoop.sort.(map|reduce).keep.percent interface in HADOOP-2127 and includes
an "indirect" sort matching some user apps (when locality information is unavailable). It
mostly, merely merges parts of the RandomWriter and Sort examples to effect sample loads in

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message