hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jane Wayne <jane.wayne2...@gmail.com>
Subject Re: are the job and task tracker monitor webpages gone now in hadoop v2.3.0
Date Fri, 07 Mar 2014 06:25:15 GMT
ok, the reason why hadoop jobs were not showing up was because i did not
enable mapreduce to be run as a yarn application.


On Thu, Mar 6, 2014 at 11:45 PM, Jane Wayne <jane.wayne2978@gmail.com>wrote:

> when i go to the job history server
>
> http://hadoop-cluster:19888/jobhistory
>
> i see no map reduce job there. i ran 3 simple mr jobs successfully. i
> verified by the console output and hdfs output directory.
>
> all i see on the UI is: No data available in table.
>
> any ideas?
>
> unless there is a JobHistoryServer just for MapReduce.. where is that?
>
>
> On Thu, Mar 6, 2014 at 7:14 PM, Vinod Kumar Vavilapalli <
> vinodkv@apache.org> wrote:
>
>>
>> Yes. JobTracker and TaskTracker are gone from all the 2.x release lines.
>>
>> MapReduce is an application on top of YARN. That is per job - launches,
>> starts and finishes after it is done with its work. Once it is done, you
>> can go look at it in the MapReduce specific JobHistoryServer.
>>
>> +Vinod
>>
>> On Mar 6, 2014, at 1:11 PM, Jane Wayne <jane.wayne2978@gmail.com> wrote:
>>
>> > i recently made the switch from hadoop 0.20.x to hadoop 2.3.0 (yes, big
>> > leap). i was wondering if there is a way to view my jobs now via a web
>> UI?
>> > i used to be able to do this by accessing the following URL
>> >
>> > http://hadoop-cluster:50030/jobtracker.jsp
>> >
>> > however, there is no more job tracker monitoring page here.
>> >
>> > furthermore, i am confused about MapReduce as an application running on
>> top
>> > of YARN. so the documentation says MapReduce is just an application
>> running
>> > on YARN. if that is true, how come i do not see MapReduce as an
>> application
>> > on the ResourceManager web UI?
>> >
>> > http://hadoop-cluster:8088/cluster/apps
>> >
>> > is this because MapReduce is NOT a long-running app? meaning, a
>> MapReduce
>> > job will only show up as an app in YARN when it is running? (please bear
>> > with me, i'm still adjusting to this new design).
>> >
>> > any help/pointer is appreciated.
>>
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified
>> that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
>> immediately
>> and delete it from your system. Thank You.
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message