hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From exception <except...@taomee.com>
Subject task slots problem
Date Tue, 25 Jan 2011 13:03:43 GMT
Hi,

My cluster contains 5 DataNodes, each with 8 map slots and 2 reduce slots. So there are up
to 40 slots in my cluster and 40 tasks can run in parallel.
But when running a particular job, I have noticed that 80 tasks running in parallel. The cluster
looks fine when running other jobs.
This particular job has no reducers. Dos this relate to the problem?

Kind

% Complete

Num Tasks

Pending

Running

Complete

Killed

Failed/Killed
Task Attempts<http://master:50030/jobfailures.jsp?jobid=job_201101201639_1384>

map<http://master:50030/jobtasks.jsp?jobid=job_201101201639_1384&type=map&pagenum=1>

54.61%





1117

427<http://master:50030/jobtasks.jsp?jobid=job_201101201639_1384&type=map&pagenum=1&state=pending>

80<http://master:50030/jobtasks.jsp?jobid=job_201101201639_1384&type=map&pagenum=1&state=running>

610<http://master:50030/jobtasks.jsp?jobid=job_201101201639_1384&type=map&pagenum=1&state=completed>

0

0 / 0

reduce<http://master:50030/jobtasks.jsp?jobid=job_201101201639_1384&type=reduce&pagenum=1>

0.00%



0

0

0

0

0

0 / 0



Thanks


Mime
View raw message