hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Gummadi (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3118) Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch
Date Thu, 29 Sep 2011 06:32:45 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13117043#comment-13117043
] 

Ravi Gummadi commented on MAPREDUCE-3118:
-----------------------------------------

System tests patches are not part of this for now. They will be added by Vinay (may be later).

Backporting patches (features and bugfixes) are from the following JIRAs:

MAPREDUCE-2596: [Gridmix] Summarize Gridmix runs.
MAPREDUCE-2107: [Gridmix] Total heap usage emulation in Gridmix.
MAPREDUCE-2106: [Gridmix] Cumulative CPU usage emulation in Gridmix.
MAPREDUCE-2543: [Gridmix] High-Ram feature emulation testcase.
MAPREDUCE-2408: [Gridmix] Compression emulation in Gridmix.
MAPREDUCE-2137: Provide mapping between jobs of trace file and the corresponding simulated
cluster's jobs in Gridmix.
MAPREDUCE-2407: Make GridMix emulate usage of distributed cache files in simulated jobs.
MAPREDUCE-2416: Remove the restriction of specifying group names in users-list file for Gridmix
in RoundRobinUserResolver mode.
MAPREDUCE-1931: Gridmix documentation.
MAPREDUCE-2417: Fix Gridmix in RoundRobinUserResolver mode to map testing/proxy users to unique
users in a trace.
MAPREDUCE-2095: Fix Gridmix to run from compressed traces.
MAPREDUCE-1989: Fix error message in gridmix when user resolver is set and no user list is
given.
MAPREDUCE-1979: Fix 'Output directory already exists' error in gridmix when gridmix.output.directory
is not defined.
MAPREDUCE-1975: Fix unnecessary InterruptedException log in gridmix.
\\
\\
\\
MAPREDUCE-2078: Fix TraceBuilder to generate traces when a globbed job history path is given.
MAPREDUCE-2153: Rumen should bring in job configuration properties into the trace file.
MAPREDUCE-2104: [Rumen] Add Cpu, Memory and Heap usages to TraceBuilder's output.
MAPREDUCE-1978: Rumen TraceBuilder should provide recursive input folder scanning.
MAPREDUCE-1918: Add documentation to Rumen.
MAPREDUCE-2000: Rumen is not able to extract counters for Job history logs from Hadoop 0.20.
MAPREDUCE-1982: Fix Rumen's TraceBuilder to extract job name from either of configuration
properties mapreduce.job.name and mapred.job.name.
MAPREDUCE-1925: Fix failing TestRumenJobTraces.
\\
\\
This backporting also needs minor changes to mapreduce task progress reporting because some
of these gridmix features rely on the task progress values.
                
> Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch
> -----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3118
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3118
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/gridmix, tools/rumen
>    Affects Versions: 0.20.206.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 0.20.206.0
>
>
> Backporting all the features and bugfixes that went into gridmix and rumen of trunk to
hadoop 0.20 security branch. This will enable using all these gridmix features and run gridmix/rumen
on the history logs of 0.20 security branch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message