hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiaoyong Zhu <xiaoy...@microsoft.com>
Subject RE: Can WebHCat show non-MapReduce jobs?
Date Mon, 06 Apr 2015 23:48:55 GMT
Ping... not sure anybody has more ideas here...?

Xiaoyong

From: Xiaoyong Zhu [mailto:xiaoyzhu@microsoft.com]
Sent: Thursday, March 26, 2015 9:07 AM
To: user@hive.apache.org
Cc: ekoifman@hortonworks.com
Subject: RE: Can WebHCat show non-MapReduce jobs?

Thanks for the reply, Eugene. However, when I try to list the jobs via WebHCat (via /templeton/v1/jobs):

[{"id":"job_1427201295241_0001","detail":null},{"id":"job_1427201295241_0003","detail":null},{"id":"job_1427201295241_0005","detail":null}]
As you can see, there are three jobs there: 0001,0003 and 0005. However, I submitted three
Hive on Tez jobs.

However, in YARN UI, I can see 6 jobs, where 0002, 0004, 0006 (which do not exist in WebHCat)
are shown here.

[cid:image001.png@01D07107.4B48B3F0]
Maybe something is wrong with my configurations?

Xiaoyong

From: Eugene Koifman [mailto:ekoifman@hortonworks.com]
Sent: Thursday, March 26, 2015 12:52 AM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: Can WebHCat show non-MapReduce jobs?

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Jobs should produce all
jobs (assuming the calling user has permissions to see them).
templeton.Server.showJobList() has detailed JavaDoc

From: Xiaoyong Zhu <xiaoyzhu@microsoft.com<mailto:xiaoyzhu@microsoft.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>>
Date: Wednesday, March 25, 2015 at 5:35 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>>
Subject: Can WebHCat show non-MapReduce jobs?

It seems that WebHCat could only show the Map Reduce jobs - for example, if I submit a Hive
on Tez job via WebHCat, I can only get the TempletonControllerJob ID (which is a MAPREDUCE
job) but I cannot get the Tez job ID (which is launched by TempletonControllerJob).

Is this by design? Is there a way to return all type of jobs via WebHCat?

Xiaoyong


Mime
View raw message