hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1474) Submittable interface, for the ability to execute and monitor jobs from a java class
Date Tue, 14 Oct 2008 16:21:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639473#action_12639473

Owen O'Malley commented on HADOOP-1474:

Yes, org.apache.hadoop.mapred.pipes.Submitter.jobSubmit will submit a pipes job without waiting
for it to finish. Can we close this jira as a duplicate?

> Submittable interface, for the ability to execute and monitor jobs from a java class
> ------------------------------------------------------------------------------------
>                 Key: HADOOP-1474
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1474
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Srikanth Kakani
> Hi,
> We wish to add the following interface:
> interface Submittable{
>            RunningJob submitJob(JobConf jc);
> }
> Currently there is no clean way to monitor a submitted job programatically, one way would
be to call main, and parse the output to figure out Jobid,  and then monitor it using a JobClient.
 Currently the only way RunJar can run a Class in a Jar file is using main.invoke(). 
> The purpose of this interface is to be able to programatically call the class that extends
this interface via another Class (similar to RunJar) and still be able to monitor it like
JobClient does.
> Essentially, all the functionality within a main class would be encapsulated within this
method such as implementing constraints between various user defined job.xml keys.
> The purpose of main would be reduced to parsing arguments, setting the JobConf and calling
this function.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message