Return-Path: 
 <oozie-users-return-74-apmail-incubator-oozie-users-archive=incubator.apache.org@incubator.apache.org>
X-Original-To: apmail-incubator-oozie-users-archive@minotaur.apache.org
Delivered-To: apmail-incubator-oozie-users-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 9816170D5
	for <apmail-incubator-oozie-users-archive@minotaur.apache.org>;
 Sun,  2 Oct 2011 23:32:53 +0000 (UTC)
Received: (qmail 48974 invoked by uid 500); 2 Oct 2011 23:32:53 -0000
Delivered-To: apmail-incubator-oozie-users-archive@incubator.apache.org
Received: (qmail 48943 invoked by uid 500); 2 Oct 2011 23:32:53 -0000
Mailing-List: contact oozie-users-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:oozie-users-help@incubator.apache.org>
List-Unsubscribe: <mailto:oozie-users-unsubscribe@incubator.apache.org>
List-Post: <mailto:oozie-users@incubator.apache.org>
List-Id: <oozie-users.incubator.apache.org>
Reply-To: oozie-users@incubator.apache.org
Delivered-To: mailing list oozie-users@incubator.apache.org
Received: (qmail 48935 invoked by uid 99); 2 Oct 2011 23:32:53 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 23:32:53 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
	tests=RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of dreddy@couponsinc.com
 designates 64.75.15.132 as permitted sender)
Received: from [64.75.15.132] (HELO mx02.coupons.com) (64.75.15.132)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Oct 2011 23:32:48 +0000
X-ASG-Debug-ID: 1317598323-0428e23e9c4fdb00001-ID1pR3
Received: from ECH02CRPUS.corp.coupons.com ([10.30.15.34]) by mx02.coupons.com
 with ESMTP id oFMyi5x4u0eDisg2 for <oozie-users@incubator.apache.org>;
 Sun, 02 Oct 2011 16:32:26 -0700 (PDT)
X-Barracuda-Envelope-From: dreddy@couponsinc.com
Received: from EMB02CRPUS.corp.coupons.com ([fe80::e10f:36c:67b9:bcd0]) by
 ECH02CRPUS.corp.coupons.com ([fe80::885c:6b71:e51e:bdbd%15]) with mapi id
 14.01.0289.001; Sun, 2 Oct 2011 16:32:03 -0700
From: Deepak Reddy <dreddy@couponsinc.com>
X-Barracuda-Apparent-Source-IP: fe80::e10f:36c:67b9:bcd0
To: "oozie-users@incubator.apache.org" <oozie-users@incubator.apache.org>
Subject: RE: Oozie streaming script not found on nodes
Thread-Topic: Oozie streaming script not found on nodes
X-ASG-Orig-Subj: RE: Oozie streaming script not found on nodes
Thread-Index: Acx/ZZ2IIg39q+tSRkaFsnkPTo8ycAB9U1wg
Date: Sun, 2 Oct 2011 23:32:03 +0000
Message-ID: 
 <6CB5C89496CB044A80B1635D0FD5D9A8465E4E76@EMB02CRPUS.corp.coupons.com>
References: 
 <5A2135DF37BCC744A23F90D76F51E75A77279E7A3B@EGL-EX07VS02.ds.corp.yahoo.com>
In-Reply-To: 
 <5A2135DF37BCC744A23F90D76F51E75A77279E7A3B@EGL-EX07VS02.ds.corp.yahoo.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [10.20.39.188]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Barracuda-Connect: UNKNOWN[10.30.15.34]
X-Barracuda-Start-Time: 1317598346
X-Barracuda-URL: http://mx02.coupons.com:8000/cgi-mod/mark.cgi
X-Virus-Scanned: by bsmtpd at coupons.com
X-Barracuda-Spam-Score: 0.00
X-Barracuda-Spam-Status: No,
 SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0
 KILL_LEVEL=9.0 tests=
X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.76236
	Rule breakdown below
	 pts rule name              description
	---- ----------------------
 --------------------------------------------------

I believe <file> refers to the hdfs location.

This pattern works for me

<mapper>filename</mapper>
...
...
<file>filename</file>
<file>depfile1</file>
<file>depfile2>/file>



-DR

-----Original Message-----
From: Sridhar Narayanan [mailto:srinar@yahoo-inc.com]=20
Sent: Friday, September 30, 2011 4:39 AM
To: oozie-users@incubator.apache.org
Subject: Oozie streaming script not found on nodes

I am running a workflow- currently only single actions at a time for diagno=
stics.
                                    Workflow looks like(relevant section):
<action name=3D'preclean'>
            <streaming>
                <mapper>python mapper1 </mapper>
                <reducer>python reducer1 </reducer>
            </streaming>
                     ...
                     ...
 <file>$path/mapper1#mapper1</file>
            <file>$path/reducer1#reducer1</file>
            <file>$path/tools.py#tools.py</file>
            <file>$path/streaming.py#streaming.py</file>
Note: $path and all other variables are defined in the config file.
         Files exist at these locations
         All action stages work executed through a script On running the wo=
rkflow(OOZIE URL set, correct config file,
updated(3.0.2) version of oozie, examples run fine), ALL map tasks fail and=
 the following is the error :
                                                          Error:
File "reducer1", line 10, in ?
    import streaming
ImportError: No module named streaming
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess fail=
ed with code 1
                                                        Questions:
1. Does the path of the file point to a HDFS location or home?
(currently points to the HDFS location, which is a mirror image of home, fo=
r this purpose) 2. Is this a permissions problem?
3. Does forcing sim-links create this problem?(I have had earlier problems =
because the mapper cannot follow sim-links, but either way doesn't change t=
he error here) (All paths are absolute, and correct. All scripts work. All =
archives(where used) are uncorrupted) Advice is much appreciated. Please fe=
el free to ask for additional information.