hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrzej Bialecki ...@getopt.org>
Subject Re: Lack of progress info in map tasks
Date Fri, 16 Mar 2007 00:23:21 GMT
Owen O'Malley wrote:
>
> On Mar 15, 2007, at 2:36 PM, Andrzej Bialecki wrote:
>
>> Does anyone have a suggestion about this problem? It's rather 
>> irritating - long-running tasks seem to be stuck at 0%, and only jump 
>> to 100% at the end of the task. This happens with 0.11.2 as well.
>
> Most of my maps happen so fast that it isn't that easy to watch 
> individual ones. The "progress" is based on the getPos() of the 
> RecordReader feeding the maps. How long do your maps run?

Several hours up to 1-2 days (Nutch fetcher).

-- 
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com



Mime
View raw message