hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinay Kumar Thota (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2138) Gridmix tests with different time interval mr traces (1min, 3min and 5min).
Date Mon, 18 Oct 2010 10:40:46 GMT
Gridmix tests with different time interval mr traces (1min, 3min and 5min).
---------------------------------------------------------------------------

                 Key: MAPREDUCE-2138
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2138
             Project: Hadoop Map/Reduce
          Issue Type: Task
          Components: test
            Reporter: Vinay Kumar Thota
            Assignee: Vinay Kumar Thota


1. Generate input data based on cluster size and create the synthetic jobs by using the 1
min folded MR trace and
submit the jobs with below arguments.

GRIDMIX_JOB_TYPE = LoadJob
GRIDMIX_USER_RESOLVER = SubmitterUserResolver
GRIDMIX_SUBMISSION_POLICY = STRESS
Input Size = 400 MB * No. of nodes in cluster.
TRACE_FILE = 1 min folded trace.
Verify each job status and summary(QueueName, UserName, StatTime, FinishTime, maps, reducers
and counters etc) after
completion of execution.

2. Generate input data based on cluster size and create the synthetic jobs by using the 3
min folded MR trace and
submit the jobs with below arguments.

GRIDMIX_JOB_TYPE = LoadJob
GRIDMIX_USER_RESOLVER = RoundRobinUserResolver
GRIDMIX_SUBMISSION_POLICY = Replay
Input Size = 200 MB * No. of nodes in cluster.
TRACE_FILE = 3 min folded trace.
PROXY_USERS = proxy users file path.
Verify each job status, submitted user and summary(QueueName, UserName, StatTime, FinishTime,
maps, reducers and
counters etc) after completion of execution.

3. Generate input data based on cluster size and create the synthetic jobs by using the 5
min folded MR trace and
submit the jobs with below arguments.

GRIDMIX_JOB_TYPE = SleepJob
GRIDMIX_USER_RESOLVER = EchoUserResolver
GRIDMIX_MIN_FILE = 100 MB
GRIDMIX_SUBMISSION_POLICY = Serial
Input Size = 300 MB * No. of nodes in cluster.
TRACE_FILE = 5 min folded trace.
Verify each job status, file size and summary(QueueName, UserName, StatTime, FinishTime, maps,
reducers and counters
etc) after completion of execution.



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message