Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 10204 invoked from network); 22 Nov 2010 21:51:39 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 22 Nov 2010 21:51:39 -0000 Received: (qmail 20181 invoked by uid 500); 22 Nov 2010 21:52:10 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 20016 invoked by uid 500); 22 Nov 2010 21:52:10 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 20008 invoked by uid 99); 22 Nov 2010 21:52:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 21:52:10 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.97.132.47] (HELO homiemail-a62.g.dreamhost.com) (208.97.132.47) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Nov 2010 21:52:05 +0000 Received: from homiemail-a62.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a62.g.dreamhost.com (Postfix) with ESMTP id 838F1634073 for ; Mon, 22 Nov 2010 13:51:44 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=darose.net; h=message-id:date :from:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; q=dns; s=darose.net; b= ctkE6QvsWPBLwfyKDIkqLuYOYMTV14xITXMuUgHDDgJ2GpXLsihiftZ7qMDdaI6e vFk/gSWbhJTvpuwwLYZ6eUtajEqFJTChExYgJyu9175txf8oErXJF/UVuHgSE/CB aYs2oenRg4ge8tHhV/4ZL3nKDxI2Tj+dMjbH4VbiDAk= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=darose.net; h=message-id :date:from:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; s=darose.net; bh=uuLpXb FhpmBOeGVyoOyZVWsuhlI=; b=Y3ivzVzw03ighjgcVl85gTs20Ez4eSrmBB3D9F 40Ja1lsAWhNOR6OvSIMMRDPeOeBkkXS6xW3crd7NAgqyBqIR4JppTmJySrYgBpNZ vAe7aDVLF2bZZZXbBUWbdwcllXpxTPsemPzEXXuulnDguoydQTmRHmPxVs4vAjjg 5mAMQ= Received: from darsys12 (cpe-66-108-142-190.nyc.res.rr.com [66.108.142.190]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: darose@darose.net) by homiemail-a62.g.dreamhost.com (Postfix) with ESMTPSA id 6AB0F634064 for ; Mon, 22 Nov 2010 13:51:44 -0800 (PST) Received: from [10.1.0.2] by darsys12 with esmtp (Exim 4.72) (envelope-from ) id 1PKeIZ-0006jZ-1r for mapreduce-user@hadoop.apache.org; Mon, 22 Nov 2010 16:51:43 -0500 Message-ID: <4CEAE5F0.4040806@darose.net> Date: Mon, 22 Nov 2010 16:51:44 -0500 From: David Rosenstrauch User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.12) Gecko/20101028 Lanikai/3.1.6 MIME-Version: 1.0 To: mapreduce-user@hadoop.apache.org Subject: Re: Starting a Hadoop job programtically References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 11/22/2010 04:39 PM, praveen.peddi@nokia.com wrote: > Hi all, I am trying to figure how I can start a hadoop job > porgramatically from my Java application running in an app server. I > was able to run my map reduce job using hadoop command from hadoop > master machine but my goal is to run the same job from my java > program (running on a different machine than master). I googled and > could not find solution for this. All the examples I have seen so far > are using hadoop from command line to start a job. > > 1. Has anyone called Hadoop job invocation from a Java application? > 2. If so, could someone provide some sample code. 3. > > Thanks Praveen http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapreduce/Job.html#submit%28%29