hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ankur C. Goel" <gan...@yahoo-inc.com>
Subject Re: [pig-usergroup] Getting JobId from pig logs
Date Mon, 14 Dec 2009 05:27:23 GMT

Hi Olga,
             We have been observing this problem with latest (0.6.0 release) where pig is
unable to get the job-id of the current M/R job it spawns. There is reproducible test case
but the problem is frequent enough to cause worries. I'd like to get your opinion on opening
a new Pig JIRA for this or reopening PIG-948.  Please advise.


On 12/12/09 8:21 AM, "Ganesan Srinivasan" <ganesan@yahoo-inc.com> wrote:

Hi Ankur,

I tried the latest version (pig-, and I don't see job id.  I see a
message "Cannot get jobid for this job"...

2009-12-12 02:40:42,245 [Thread-10] WARN  org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2009-12-12 02:40:42,762 [Thread-10] INFO  org.apache.hadoop.zebra.pig.TableLoader - Total
input tables to process : 1
2009-12-12 02:40:43,242 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Cannot get jobid for this job
2009-12-12 02:40:49,263 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
2009-12-12 02:43:20,813 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 25% complete

Please let me know how can I get it.



From: Ankur C. Goel [mailto:gankur@yahoo-inc.com]
Sent: Wednesday, November 04, 2009 3:32 AM
To: pig-usergroup@yahoo-inc.com; Safique Mohamed
Subject: Re: [pig-usergroup] Getting JobId from pig logs

With the fix for https://issues.apache.org/jira/browse/PIG-948 being available in the latest
pig release, it should be available in the pig logs.
The latest pig release has been deployed to all the clusters except M45. To use the latest
release run with  -latest option.


On 11/4/09 4:51 PM, "Safique Mohamed" <safiquem@yahoo-inc.com> wrote:
Hi all,

Is there some way of getting the jobId from the pig logs; it would be useful to look into
the jobtracker history logs (using jobId) at a later stage.


With Regards,

Safique | YSM Panama - Minerva (IR DataPlatform).
[Yahoo! SDC India, Embassy Golf Links Business Park, Koramangala, Bangalore-560071].
Tel: +91-97390-62985.
Email: safiquem@yahoo-inc.com <mailto:safiquem@yahoo-inc.com>

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message