hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amareshwari Sriramadasu <amar...@yahoo-inc.com>
Subject Re: How to use Hadoop API to submit job?
Date Fri, 20 Feb 2009 08:04:19 GMT
You should implement Tool interface and submit jobs.
For example see org.apache.hadoop.examples.WordCount

Wu Wei wrote:
> Hi,
> I used to submit Hadoop job with the utility RunJar.main() on hadoop 
> 0.18. On hadoop 0.19, because the commandLineConfig of JobClient was 
> null, I got a NullPointerException error when RunJar.main() calls 
> GenericOptionsParser to get libJars (0.18 didn't do this call). I also 
> tried the class JobShell to submit job, but it catches all exceptions 
> and sends to stderr so that I cann't handle the exceptions myself.
> I noticed that if I can call JobClient's setCommandLineConfig method, 
> everything goes easy. But this method has default package 
> accessibility, I cann't see the method out of package 
> org.apache.hadoop.mapred.
> Any advices on using Java APIs to submit job?
> Wei

View raw message