Mailing-List: contact oozie-users-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: oozie-users@incubator.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=tlDIHIZcSKcET9Yw7ptAVFqYELSscSOKWpaQ5FbVa+LjyASqkd7qasMHgHD+31/3gDqozoMFGFxt28AhUzFvgPNWXouikL1XCsCSogYxVBO9vYhnMlpb47ZyctSpIcbiGKzXcZxMaZRo7MsCdPy1TPu0ArvPV7SP9R4DLpUCQKw=;
References: 
 <5A2135DF37BCC744A23F90D76F51E75A77279E7A3B@EGL-EX07VS02.ds.corp.yahoo.com>
Message-ID: <1317544842.4510.YahooMailNeo@web161302.mail.bf1.yahoo.com>
Date: Sun, 2 Oct 2011 01:40:42 -0700 (PDT)
From: Mohammad Islam <mislam77@yahoo.com>
Reply-To: Mohammad Islam <mislam77@yahoo.com>
Subject: Re: Oozie streaming script not found on nodes
To: "oozie-users@incubator.apache.org" <oozie-users@incubator.apache.org>
In-Reply-To: 
 <5A2135DF37BCC744A23F90D76F51E75A77279E7A3B@EGL-EX07VS02.ds.corp.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="2145414650-475108221-1317544842=:4510"

--2145414650-475108221-1317544842=:4510
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Sridhar,=0APlease excuse my limited knowledge of python.=0A=0AHow the im=
port in python works? Does it look into current directory by default?=0A=0A=
You could double check the current directory from where the actual streamin=
g job was launched by accessing the launcher mapper log. You might already =
knew that Launcher mapper is started by oozie for most of the actions. You =
could find it in your JT job list with name something oozie launcher. The f=
irst few lines of the task attempt log show the list of the files in curren=
t dir. If possible, please cut-paste the relevant log.=0A=0AIf you find the=
 contents of the current directory are as expected, please create an exact =
test environment in your local setup and run the command.=A0=0A=0ARegards,=
=0AMohammad=0A=0A=0A=A0=0A=0A=0A________________________________=0AFrom: Sr=
idhar Narayanan <srinar@yahoo-inc.com>=0ATo: "oozie-users@incubator.apache.=
org" <oozie-users@incubator.apache.org>=0ASent: Friday, September 30, 2011 =
4:39 AM=0ASubject: Oozie streaming script not found on nodes=0A=0AI am runn=
ing a workflow- currently only single actions at a time for=0Adiagnostics.=
=0A=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
Workflow looks like(relevant section):=0A<action name=3D'preclean'>=0A=A0 =
=A0 =A0 =A0 =A0 =A0 <streaming>=0A=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <mapper>p=
ython mapper1 </mapper>=0A=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <reducer>python r=
educer1 </reducer>=0A=A0 =A0 =A0 =A0 =A0 =A0 </streaming>=0A=A0 =A0 =A0 =A0=
 =A0 =A0 =A0 =A0 =A0 =A0  ...=0A=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0  ..=
.=0A<file>$path/mapper1#mapper1</file>=0A=A0 =A0 =A0 =A0 =A0 =A0 <file>$pat=
h/reducer1#reducer1</file>=0A=A0 =A0 =A0 =A0 =A0 =A0 <file>$path/tools.py#t=
ools.py</file>=0A=A0 =A0 =A0 =A0 =A0 =A0 <file>$path/streaming.py#streaming=
.py</file>=0ANote: $path and all other variables are defined in the config =
file.=0A=A0 =A0 =A0 =A0  Files exist at these locations=0A=A0 =A0 =A0 =A0  =
All action stages work executed through a script=0AOn running the workflow(=
OOZIE URL set, correct config file,=0Aupdated(3.0.2) version of oozie, exam=
ples run fine), ALL map tasks=0Afail and the following is the error :=0A=A0=
 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 Error:=0AFile "reducer1", line 10, =
in ?=0A=A0 =A0 import streaming=0AImportError: No module named streaming=0A=
java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess=0Afa=
iled with code 1=0A=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 Questions:=0A1. Doe=
s the path of the file point to a HDFS location or home?=0A(currently point=
s to the HDFS location, which is a mirror image of=0Ahome, for this purpose=
)=0A2. Is this a permissions problem?=0A3. Does forcing sim-links create th=
is problem?(I have had earlier=0Aproblems because the mapper cannot follow =
sim-links, but either way=0Adoesn't change the error here)=0A(All paths are=
 absolute, and correct. All scripts work. All=0Aarchives(where used) are un=
corrupted)=0AAdvice is much appreciated. Please feel free to ask for additi=
onal=0Ainformation.
--2145414650-475108221-1317544842=:4510--