Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C7E2F100D1 for ; Mon, 15 Apr 2013 13:17:36 +0000 (UTC) Received: (qmail 83176 invoked by uid 500); 15 Apr 2013 13:17:31 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 83090 invoked by uid 500); 15 Apr 2013 13:17:31 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 83076 invoked by uid 99); 15 Apr 2013 13:17:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Apr 2013 13:17:31 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of amits@infolinks.com designates 207.126.144.117 as permitted sender) Received: from [207.126.144.117] (HELO eu1sys200aog104.obsmtp.com) (207.126.144.117) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 15 Apr 2013 13:17:25 +0000 Received: from mail-oa0-f72.google.com ([209.85.219.72]) (using TLSv1) by eu1sys200aob104.postini.com ([207.126.147.11]) with SMTP ID DSNKUWv90IpI/pBUyvihT5o+7XHvaUcl6531@postini.com; Mon, 15 Apr 2013 13:17:04 UTC Received: by mail-oa0-f72.google.com with SMTP id j6so30879234oag.7 for ; Mon, 15 Apr 2013 06:17:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:x-received:in-reply-to:references:date :message-id:subject:from:to:content-type:x-gm-message-state; bh=VDHjxUfTIMbl31ggC+XtMeOrMMRp0hcp6YEYlDm8e28=; b=NUK+BRuHpbOuUqoV+IELtoEFIA+X6uyubqt8c2/frl6CgGreW4rcINEwc0pECGR9UB gCmTmfoLqFY+DCqb7NTk/JzwsLDDmu1xtDq6QhYSF/PSd5WeScD1kGjP+CdRKMAUDaLF uYRWljE9NAGbVSzY7c1zNiVId+g38EFadPpIbtaDZfQjZYtviw8EyxfHSVdBHBflUlaA UhUYiwFJl4y3BpQ6F/Idow/qw30IROVhKgB8jPK3W8SA9Dtvtp1x7+Lv7rpa9XvS16aM 6Gr3xk2zWxIeC3iG+QzhrPlfBBHkSq6EPlC7/u0Ue2/MJuruAZRqZ6zEWyytfC6SpdsJ UAEg== X-Received: by 10.50.13.101 with SMTP id g5mr5293690igc.64.1366031823470; Mon, 15 Apr 2013 06:17:03 -0700 (PDT) MIME-Version: 1.0 X-Received: by 10.50.13.101 with SMTP id g5mr5293677igc.64.1366031823238; Mon, 15 Apr 2013 06:17:03 -0700 (PDT) Received: by 10.64.92.136 with HTTP; Mon, 15 Apr 2013 06:17:03 -0700 (PDT) Received: by 10.64.92.136 with HTTP; Mon, 15 Apr 2013 06:17:03 -0700 (PDT) In-Reply-To: References: Date: Mon, 15 Apr 2013 16:17:03 +0300 Message-ID: Subject: Re: Submitting mapreduce and nothing happens From: Amit Sela To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f23438193891b04da6611db X-Gm-Message-State: ALoCoQnN4lI6iaBeShUtCutPBXC2USXSHYSgiw2p1xnAnrmR7UEfyefP4vII3/McdxI2/yTusqVnpsY9XGFHTlq2d5zAjOkIGPHU2P7hvUp4Xz2jvYAHm3mCVRbLDWUCLms1GKaTCQvNG6/ekVrVEijKF2fxkzLa0G/cuwq5BaxjhRYSwFKPbg8= X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f23438193891b04da6611db Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable The client prints the two lines I posted and the cluster shows nothing. Not even incrementing the number of submitted jobs. On Apr 15, 2013 4:10 PM, "Harsh J" wrote: > When you say "nothing happens"; where exactly do you mean? The client > doesn't print anything, or the cluster doesn't run anything? > > On Mon, Apr 15, 2013 at 3:36 PM, Amit Sela wrote: > > Hi all, > > > > I'm trying to submit a mapreduce job remotely using job.submit() > > > > I get the following: > > > > [WARN ] org.apache.hadoop.mapred.JobClient =BB Use > GenericOptionsParser > > for parsing the arguments. Applications should implement Tool for the > same. > > [INFO ] org.apache.hadoop.mapred.JobClient =BB Cleaning up the > staging > > area hdfs://{namenode > > > address}:{port}{hadoop.tmp.dir}/mapred/staging/myusername/.staging/job_20= 1304150711_0022 > > > > and nothing happens... > > > > I set the the mapred.job.tracker and changed permissions for > hadoop.tmp.dir. > > I also set "hadoop.job.ugi" as "hadoop,supergroup" but some how I think > that > > it's not making any difference. > > The system submitting the job is running with another user, call it: > > myusername and not hadoop. > > > > I believe it is related to the user permissions but I can't seem to get > it > > right. > > > > Thanks for the help, > > > > Amit. > > > > > > -- > Harsh J > --e89a8f23438193891b04da6611db Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

The client prints the two lines I posted and the cluster sho= ws nothing. Not even incrementing the number of submitted jobs.

On Apr 15, 2013 4:10 PM, "Harsh J" <= ;harsh@cloudera.com> wrote:
When you say "nothing happens"; where exactly do you mean? The cl= ient
doesn't print anything, or the cluster doesn't run anything?

On Mon, Apr 15, 2013 at 3:36 PM, Amit Sela <amits@infolinks.com> wrote:
> Hi all,
>
> I'm trying to submit a mapreduce job remotely using job.submit() >
> I get the following:
>
> [WARN ] org.apache.hadoop.mapred.JobClient =A0 =A0 =A0 =BB Use Generic= OptionsParser
> for parsing the arguments. Applications should implement Tool for the = same.
> [INFO ] org.apache.hadoop.mapred.JobClient =A0 =A0 =A0 =BB Cleaning up= the staging
> area hdfs://{namenode
> address}:{port}{hadoop.tmp.dir}/mapred/staging/myusername/.staging/job= _201304150711_0022
>
> and nothing happens...
>
> I set the the mapred.job.tracker and changed permissions for hadoop.tm= p.dir.
> I also set "hadoop.job.ugi" as "hadoop,supergroup"= but some how I think that
> it's not making any difference.
> The system submitting the job is running with another user, call it: > myusername and not hadoop.
>
> I believe it is related to the user permissions but I can't seem t= o get it
> right.
>
> Thanks for the help,
>
> Amit.
>



--
Harsh J
--e89a8f23438193891b04da6611db--