hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kaveh minooie <ka...@plutoz.com>
Subject updated to 1.2.1, map completed percentage keeps oscillating
Date Wed, 14 Aug 2013 01:03:47 GMT
Hi everyone I recently updated my cluster to 1.2.1 and now the 
percentage of compeleted map tasks while the job is running keeps changing:

13/08/13 16:53:01 INFO mapred.JobClient: Running job: job_201308131452_0007
13/08/13 16:53:02 INFO mapred.JobClient:  map 0% reduce 0%
13/08/13 16:53:19 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:53:22 INFO mapred.JobClient:  map 34% reduce 0%
13/08/13 16:53:25 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:53:49 INFO mapred.JobClient:  map 44% reduce 0%
13/08/13 16:53:52 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:54:02 INFO mapred.JobClient:  map 38% reduce 0%
13/08/13 16:54:05 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:54:14 INFO mapred.JobClient:  map 44% reduce 0%
13/08/13 16:54:17 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:54:26 INFO mapred.JobClient:  map 24% reduce 0%
13/08/13 16:54:29 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:54:53 INFO mapred.JobClient:  map 24% reduce 0%
13/08/13 16:54:56 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:55:05 INFO mapred.JobClient:  map 32% reduce 0%
13/08/13 16:55:08 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:55:17 INFO mapred.JobClient:  map 20% reduce 0%
13/08/13 16:55:20 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:55:32 INFO mapred.JobClient:  map 4% reduce 0%
13/08/13 16:55:35 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:55:47 INFO mapred.JobClient:  map 19% reduce 0%
13/08/13 16:55:50 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:56:02 INFO mapred.JobClient:  map 46% reduce 0%
13/08/13 16:56:06 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:56:36 INFO mapred.JobClient:  map 29% reduce 0%
13/08/13 16:56:39 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:57:07 INFO mapred.JobClient:  map 48% reduce 0%
13/08/13 16:57:10 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:58:16 INFO mapred.JobClient:  map 39% reduce 0%
13/08/13 16:58:20 INFO mapred.JobClient:  map 2% reduce 0%
13/08/13 16:58:23 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:58:32 INFO mapred.JobClient:  map 44% reduce 0%
13/08/13 16:58:35 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:58:50 INFO mapred.JobClient:  map 18% reduce 0%
13/08/13 16:58:53 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:59:08 INFO mapred.JobClient:  map 16% reduce 0%
13/08/13 16:59:11 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:59:42 INFO mapred.JobClient:  map 18% reduce 0%
13/08/13 16:59:45 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 16:59:54 INFO mapred.JobClient:  map 11% reduce 0%
13/08/13 16:59:57 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:00:09 INFO mapred.JobClient:  map 33% reduce 0%
13/08/13 17:00:12 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:00:24 INFO mapred.JobClient:  map 39% reduce 0%
13/08/13 17:00:27 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:00:51 INFO mapred.JobClient:  map 37% reduce 0%
13/08/13 17:00:54 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:01:12 INFO mapred.JobClient:  map 50% reduce 0%
13/08/13 17:01:15 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:01:39 INFO mapred.JobClient:  map 44% reduce 0%
13/08/13 17:01:42 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:01:54 INFO mapred.JobClient:  map 36% reduce 0%
13/08/13 17:01:57 INFO mapred.JobClient:  map 51% reduce 0%
13/08/13 17:02:24 INFO mapred.JobClient:  map 11% reduce 0%
13/08/13 17:02:27 INFO mapred.JobClient:  map 51% reduce 0%



this is the output of one job with one map task. there was no failure. 
the map task was not re-spawned. it just ran and finished on the node on 
which it was started, but this is the output. what gives?

-- 
Kaveh Minooie

Mime
View raw message