hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2408) Make Gridmix emulate usage of data compression
Date Thu, 26 May 2011 17:46:47 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039821#comment-13039821
] 

Amar Kamat commented on MAPREDUCE-2408:
---------------------------------------

The goal of this jira is to emulate the compression characteristics of a MapReduce job. Emulating
compression characteristics involves the following 1. Generating compressible data. The compression
characteristics (e.g compression ratio) of the data (map input, map output and reduce output)
should be configurable. 2. Extract compression related properties from original job's configuration
and history files. Configure the simulated job to mimic the compression behavior using the
original job's configuration and history. 

> Make Gridmix emulate usage of data compression
> ----------------------------------------------
>
>                 Key: MAPREDUCE-2408
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2408
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/gridmix
>            Reporter: Ravi Gummadi
>            Assignee: Amar Kamat
>
> Currently Gridmix emulates disk IO load only. This JIRA is to make Gridmix emulate load
due to data compression as defined by the job-trace.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message