hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinod Kumar Vavilapalli <vino...@apache.org>
Subject Re: Map Reduce Job is reported as complete on history server while on console it shows as only half way thru
Date Wed, 17 Sep 2014 17:34:20 GMT
Is it possible that the client JVM is somehow getting killed while the YARN
application finishes as usual on the cluster in the background?


On Wed, Sep 17, 2014 at 9:29 AM, S.L <simpleliving016@gmail.com> wrote:

>    Hi All,
> I am running a MRV1 job on Hadoop YARN 2.3.0 cluster , the problem is when
> I submit this job YARN the application that is running in YARN is marked as
> complete even as on console its reported as only 58% complete . I have
> confirmed that its also not printing the log statements that its supposed
> to print when the job is actually complete .
> Please see the output from the job submission console below. It just stops
> at 58% and job history server and YARN cluster UI reports that this job has
> already succeeded. Can someone let me know why this is happening ?
> 4/08/28 08:36:19 INFO mapreduce.Job:  map 54% reduce 0%
> 14/08/28 08:44:13 INFO mapreduce.Job:  map 55% reduce 0%
> 14/08/28 08:52:16 INFO mapreduce.Job:  map 56% reduce 0%
> 14/08/28 08:59:22 INFO mapreduce.Job:  map 57% reduce 0%
> 14/08/28 09:07:33 INFO mapreduce.Job:  map 58% reduce 0%
> Thanks.

NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

View raw message