Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D5AAEF227 for ; Sun, 14 Apr 2013 03:27:16 +0000 (UTC) Received: (qmail 35169 invoked by uid 500); 14 Apr 2013 03:27:11 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 34756 invoked by uid 500); 14 Apr 2013 03:27:11 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 34724 invoked by uid 99); 14 Apr 2013 03:27:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Apr 2013 03:27:09 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bjornjon@gmail.com designates 209.85.210.177 as permitted sender) Received: from [209.85.210.177] (HELO mail-ia0-f177.google.com) (209.85.210.177) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Apr 2013 03:27:03 +0000 Received: by mail-ia0-f177.google.com with SMTP id w33so3480117iag.36 for ; Sat, 13 Apr 2013 20:26:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=OmidptHO2zeRKWbK8AxB2Ge3bVT9tSEhILqH0zL1ipQ=; b=AocnHY4TfPXjrHmYE3VIJhUXvqjOQVAjzV8HERlbqdjZ0h0iBMFyWWu7KTmBaxfwc7 Owb5VsuHnTbBw83VZg6y2WvtWJ4NfupUVgH0DD+3DseIQ46X3r7aFaGLlwIbf1rukmrf YbUSyStiJrEhZvGs9GjrswYVeEzmh4yJAHE40zpQxJ+pb54Gr8QVhF9m7uN8ijOVq/0D nixukfEVU8GqADLKMQWPJwn3j96dqVAIqXef4PZ3GpX7F14rTuHgc/Km0Pb3MAHzsR/z xaqeJW+BItZYwCvI/IiH5rmv2x31QeF4FoRfe4H9auJgpr4N7aJOugQvYNyRH6SGouOs boaw== MIME-Version: 1.0 X-Received: by 10.50.73.230 with SMTP id o6mr2530397igv.91.1365910001873; Sat, 13 Apr 2013 20:26:41 -0700 (PDT) Received: by 10.64.92.71 with HTTP; Sat, 13 Apr 2013 20:26:41 -0700 (PDT) In-Reply-To: References: <000f01ce3884$297e61b0$7c7b2510$@email.t-com.hr> Date: Sat, 13 Apr 2013 20:26:41 -0700 Message-ID: Subject: Re: Few noob MR questions From: Bjorn Jonsson To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e013a252c74fc8c04da49b408 X-Virus-Checked: Checked by ClamAV on apache.org --089e013a252c74fc8c04da49b408 Content-Type: text/plain; charset=ISO-8859-1 Correct, you can use java -jar to submit a job...with the "driver" code in a plain static main method. I do it all the time. You can of course run a Job straight from your IDE Java code also. You can check out the .runJar() method in the Hadoop API Javadoc to see what the hadoop command does essentially I think. Cheers, Bj On Sat, Apr 13, 2013 at 3:59 PM, Jens Scheidtmann < jens.scheidtmann@gmail.com> wrote: > Dear Vjeran, > > your own jobs should implement the Tool Interface and ToolRunner. This > gives additional standard options on the command line. > > Also have a look at class ProgramDriver as used here: > https://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/ExampleDriver.java > > which further simplifies executing your MR jobs. > > Best regards, > > Jens > --089e013a252c74fc8c04da49b408 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Correct, you can use java -jar to submit a job...with the = "driver" code in a plain static main method. I do it all the time= . You can=A0of course run a Job straight from your IDE Java code also. You = can check out the .runJar() method in the Hadoop API Javadoc to see what th= e hadoop command does essentially I think.=A0

Cheers,
Bj


On Sat, Apr 13, 2013 at 3:59 = PM, Jens Scheidtmann <jens.scheidtmann@gmail.com> w= rote:
Dear Vjeran,=

your own jobs should implement the Tool Interface and ToolRun= ner. This gives additional standard options on the command line.

Also have a look at class ProgramDriver as used here: https://svn.apache.org/repos/asf/hadoop/co= mmon/trunk/hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java= /org/apache/hadoop/examples/ExampleDriver.java

which further simplifies executing your MR jobs.

Best regards,

Jens

--089e013a252c74fc8c04da49b408--