hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Miles Osborne" <mi...@inf.ed.ac.uk>
Subject Re: getting hadoop job status/progress outside of hadoop
Date Tue, 17 Jun 2008 17:41:19 GMT
To get this from some other application rather than Hadoop, you  just need
to run this within a shell (I do this kind of thing within perl)

Miles

2008/6/17 Miles Osborne <miles@inf.ed.ac.uk>:

> try this:
>
> hadoop job  -Dmapred.job.tracker=hermitage:9001 -status
> job_200806160820_0430
>
> (and replace my job id with the one you want to track):
> >
> hadoop job  -Dmapred.job.tracker=hermitage:9001 -status
> job_200806160820_0430
>
> Job: job_200806160820_0430
> file: /data/tmp/hadoop/mapred/system/job_200806160820_0430/job.xml
> tracking URL:
> http://hermitage:50030/jobdetails.jsp?jobid=job_200806160820_0430
> map() completion: 1.0
> reduce() completion: 0.20370372
> >
>
> Miles
>
> 2008/6/17 Kayla Jay <kaylais30@yahoo.com>:
>
>
>>
>> Hi
>>
>> Is there a way to grab a hadoop job's status/progress outside of the job
>> and outside of hadoop?
>> I.e if I have another application running and  this application needs to
>> know that a job has ended or the status percentage while the job is running,
>> how can an external app like  this get status from the hadoop job or cluster
>> that the job is done and the progress while it's running?
>>
>> Is there a hook into the status via HTTP or any other interface?  How can
>> external apps get progress of the job running and notification when it's
>> done running?  I was thinking there might be a hook in since it reports it
>> via the JobTracker.
>>
>> Thanks.
>>
>>
>>
>>
>
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in Scotland,
> with registration number SC005336.




-- 
The University of Edinburgh is a charitable body, registered in Scotland,
with registration number SC005336.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message