hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-2408) Make Gridmix emulate usage of data compression
Date Fri, 27 May 2011 06:26:47 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Amar Kamat updated MAPREDUCE-2408:

       Resolution: Fixed
    Fix Version/s: 0.23.0
     Release Note: Emulates the MapReduce compression feature in Gridmix. By default, compression
emulation is turned on. Compression emulation can be disabled by setting 'gridmix.compression-emulation.enable'
to 'false'.  Use 'gridmix.compression-emulation.map-input.decompression-ratio', 'gridmix.compression-emulation.map-output.compression-ratio'
and 'gridmix.compression-emulation.reduce-output.compression-ratio' to configure the compression
ratios at map input, map output and reduce output side respectively. Currently, compression
ratios in the range [0.07, 0.68] are supported. Gridmix auto detects whether map-input, map
output and reduce output should emulate compression based on original job's compression related
configuration parameters.
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

I just committed this to trunk. Thanks Ravi for the review!

> Make Gridmix emulate usage of data compression
> ----------------------------------------------
>                 Key: MAPREDUCE-2408
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2408
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/gridmix
>            Reporter: Ravi Gummadi
>            Assignee: Amar Kamat
>             Fix For: 0.23.0
>         Attachments: MR-2408-gridmix-compression-emulation-v1.1.patch
> Currently Gridmix emulates disk IO load only. This JIRA is to make Gridmix emulate load
due to data compression as defined by the job-trace.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message