Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EDC6A10ECF for ; Sat, 29 Mar 2014 16:33:46 +0000 (UTC) Received: (qmail 47164 invoked by uid 500); 29 Mar 2014 16:33:32 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 46506 invoked by uid 500); 29 Mar 2014 16:33:29 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 46499 invoked by uid 99); 29 Mar 2014 16:33:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Mar 2014 16:33:28 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jayunit100@gmail.com designates 209.85.217.171 as permitted sender) Received: from [209.85.217.171] (HELO mail-lb0-f171.google.com) (209.85.217.171) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Mar 2014 16:33:21 +0000 Received: by mail-lb0-f171.google.com with SMTP id w7so4567228lbi.2 for ; Sat, 29 Mar 2014 09:33:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=i0/au8Ep4sHHoDfyM54Ghlw9945Na669+0hKYy+kB60=; b=fLxgFhkFwoA/4NPQuYZFkTjSpZWLrqENBeu/yjbpXzVvGEppayns1yYkmerLZVcT4a z2NaNPLgWb9XXUzyGlozFq7T1NT1f9fdkPizC3bYTECVo0shYJ78BhU6x0n8Vvjp19KP SIsdDySUNJE09BqeeUa973mwlZtPYeVLGdZQCzgc4hzp/jfFjqPrR1Tv1Z9u1nWMF6UJ Uoo1Z2Y1s89WwUQhjMat5ti1Lpvk0Q/EXLu65OwtZ2ea++F/wJfwcuND4N/mQAPMLyPs 24ngNTu3ZY8Jvzepj2KEPDYYMgRsGJgX9UHl5lOl2iFXAwFrpHFG/SP8EmJxcLrYkRnM sVFw== MIME-Version: 1.0 X-Received: by 10.152.19.65 with SMTP id c1mr950229lae.35.1396110780397; Sat, 29 Mar 2014 09:33:00 -0700 (PDT) Received: by 10.112.189.165 with HTTP; Sat, 29 Mar 2014 09:33:00 -0700 (PDT) Date: Sat, 29 Mar 2014 11:33:00 -0500 Message-ID: Subject: Jobs fail immediately in local mode ? From: Jay Vyas To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=089e0149430821fee704f5c15fd9 X-Virus-Checked: Checked by ClamAV on apache.org --089e0149430821fee704f5c15fd9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Im running a job in local mode, and have found that it returns immediately, switching job state to FAILURE. >From the /tmp/hadoop-jay directory, I see that clearly an attempt was made to run the job , and that some files seem to have been created.... But I don't see any clues. =E2=94=9C=E2=94=80=E2=94=80 [ 102] local =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 102] localRunner =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 170] jay =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 [ 68] job_local153= 1736937_0001 =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 [ 68] job_local218= 993552_0002 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 136] jobcache =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 [ 102] job_loca= l1531736937_0001 =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 10= 2] attempt_local1531736937_0001_m_000000_0 =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ = 136] output =E2=94=82 =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 [ = 14] file.out =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ = 32] file.out.index =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 102] job_loca= l218993552_0002 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 102] attempt_local218993552_0002_m_000000_0 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 136] = output =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 [ 1= 4] file.out =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 [ 3= 2] file.out.index =E2=94=94=E2=94=80=E2=94=80 [ 136] staging =E2=94=9C=E2=94=80=E2=94=80 [ 102] jay1531736937 =E2=94=94=E2=94=80=E2=94=80 [ 102] jay218993552 Any thoughts on how i can further diagnose whats happening and why my job fails without a stacktrace? Because I dont have hadoop installed on the system (i.e. im just running a java app that fires up a hadoop client locally), I cant see anything in /var/log . --=20 Jay Vyas http://jayunit100.blogspot.com --089e0149430821fee704f5c15fd9 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdiBkaXI9Imx0ciI+PGRpdj5JbSBydW5uaW5nIGEgam9iIGluIGxvY2FsIG1vZGUsIGFuZCBo YXZlIGZvdW5kIHRoYXQgaXQgcmV0dXJucyBpbW1lZGlhdGVseSwgc3dpdGNoaW5nIGpvYiBzdGF0 ZSB0byBGQUlMVVJFLiA8YnI+PGJyPjwvZGl2PjxkaXY+RnJvbSB0aGUgL3RtcC9oYWRvb3AtamF5 IGRpcmVjdG9yeSwgSSBzZWUgdGhhdCBjbGVhcmx5IGFuIGF0dGVtcHQgd2FzIG1hZGUgdG8gcnVu IHRoZSBqb2IgLCBhbmQgdGhhdCBzb21lIGZpbGVzIHNlZW0gdG8gaGF2ZSBiZWVuIGNyZWF0ZWQu Li4uwqAgQnV0IEkgZG9uJiMzOTt0IHNlZSBhbnkgY2x1ZXMuPGJyPg0KPC9kaXY+PGRpdj48YnI+ 4pSc4pSA4pSAIFvCoMKgwqDCoMKgwqDCoCAxMDJdwqAgbG9jYWw8YnI+4pSCwqDCoCDilJTilIDi lIAgW8KgwqDCoMKgwqDCoMKgIDEwMl3CoCBsb2NhbFJ1bm5lcjxicj7ilILCoMKgwqDCoMKgwqAg 4pSU4pSA4pSAIFvCoMKgwqDCoMKgwqDCoCAxNzBdwqAgamF5PGJyPuKUgsKgwqDCoMKgwqDCoMKg wqDCoMKgIOKUnOKUgOKUgCBbwqDCoMKgwqDCoMKgwqDCoCA2OF3CoCBqb2JfbG9jYWwxNTMxNzM2 OTM3XzAwMDE8YnI+4pSCwqDCoMKgwqDCoMKgwqDCoMKgwqAg4pSc4pSA4pSAIFvCoMKgwqDCoMKg wqDCoMKgIDY4XcKgIGpvYl9sb2NhbDIxODk5MzU1Ml8wMDAyPGJyPg0K4pSCwqDCoMKgwqDCoMKg wqDCoMKgwqAg4pSU4pSA4pSAIFvCoMKgwqDCoMKgwqDCoCAxMzZdwqAgam9iY2FjaGU8YnI+4pSC wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCDilJzilIDilIAgW8KgwqDCoMKgwqDCoMKgIDEw Ml3CoCBqb2JfbG9jYWwxNTMxNzM2OTM3XzAwMDE8YnI+4pSCwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoCDilILCoMKgIOKUlOKUgOKUgCBbwqDCoMKgwqDCoMKgwqAgMTAyXcKgIGF0dGVtcHRf bG9jYWwxNTMxNzM2OTM3XzAwMDFfbV8wMDAwMDBfMDxicj7ilILCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgIOKUgsKgwqDCoMKgwqDCoCDilJTilIDilIAgW8KgwqDCoMKgwqDCoMKgIDEzNl3C oCBvdXRwdXQ8YnI+DQrilILCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIOKUgsKgwqDCoMKg wqDCoMKgwqDCoMKgIOKUnOKUgOKUgCBbwqDCoMKgwqDCoMKgwqDCoCAxNF3CoCBmaWxlLm91dDxi cj7ilILCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIOKUgsKgwqDCoMKgwqDCoMKgwqDCoMKg IOKUlOKUgOKUgCBbwqDCoMKgwqDCoMKgwqDCoCAzMl3CoCBmaWxlLm91dC5pbmRleDxicj7ilILC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIOKUlOKUgOKUgCBbwqDCoMKgwqDCoMKgwqAgMTAy XcKgIGpvYl9sb2NhbDIxODk5MzU1Ml8wMDAyPGJyPuKUgsKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoCDilJTilIDilIAgW8KgwqDCoMKgwqDCoMKgIDEwMl3CoCBhdHRlbXB0X2xv Y2FsMjE4OTkzNTUyXzAwMDJfbV8wMDAwMDBfMDxicj4NCuKUgsKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIOKUlOKUgOKUgCBbwqDCoMKgwqDCoMKgwqAgMTM2XcKg IG91dHB1dDxicj7ilILCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgIOKUnOKUgOKUgCBbwqDCoMKgwqDCoMKgwqDCoCAxNF3CoCBmaWxlLm91dDxicj7i lILCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIOKU lOKUgOKUgCBbwqDCoMKgwqDCoMKgwqDCoCAzMl3CoCBmaWxlLm91dC5pbmRleDxicj7ilJTilIDi lIAgW8KgwqDCoMKgwqDCoMKgIDEzNl3CoCBzdGFnaW5nPGJyPsKgwqDCoCDilJzilIDilIAgW8Kg wqDCoMKgwqDCoMKgIDEwMl3CoCBqYXkxNTMxNzM2OTM3PGJyPg0KwqDCoMKgIOKUlOKUgOKUgCBb wqDCoMKgwqDCoMKgwqAgMTAyXcKgIGpheTIxODk5MzU1Mjxicj48YnI+PGJyPjwvZGl2PjxkaXY+ QW55IHRob3VnaHRzIG9uIGhvdyBpIGNhbiBmdXJ0aGVyIGRpYWdub3NlIHdoYXRzIGhhcHBlbmlu ZyBhbmQgd2h5IG15IGpvYiBmYWlscyB3aXRob3V0IGEgc3RhY2t0cmFjZT/CoCBCZWNhdXNlIEkg ZG9udCBoYXZlIGhhZG9vcCBpbnN0YWxsZWQgb24gdGhlIHN5c3RlbSAoaS5lLiBpbSBqdXN0IHJ1 bm5pbmcgYSBqYXZhIGFwcCB0aGF0IGZpcmVzIHVwwqAgYSBoYWRvb3AgY2xpZW50IGxvY2FsbHkp LCBJIGNhbnQgc2VlIGFueXRoaW5nIGluIC92YXIvbG9nIC48YnI+DQo8L2Rpdj48ZGl2Pjxicj48 YnI+PGJyPjxkaXY+PGJyPi0tIDxicj5KYXkgVnlhczxicj48YSBocmVmPSJodHRwOi8vamF5dW5p dDEwMC5ibG9nc3BvdC5jb20iIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vamF5dW5pdDEwMC5ibG9n c3BvdC5jb208L2E+DQo8L2Rpdj48L2Rpdj48L2Rpdj4NCg== --089e0149430821fee704f5c15fd9--