Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of vangjake@googlemail.com
 designates 209.85.212.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=googlemail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject
         :content-type:content-transfer-encoding;
        b=XMb7RWUjrMcIJDWayPRCQ6Xktajh0MQaTo5VoxnWkID106mWW4rTb91G35di4PsBSm
         aNQlbPh2LTnsYv69RIxqEuOgMk6FB+RpkA2uKGsLX1aWTWixEeab1OXlPkkq14Qf+dwU
         tTY5cap4WFy59XGAbvYq/C5Ru2KcfYcAJbp0g=
Message-ID: <4C68464F.5030300@gmail.com>
Date: Sun, 15 Aug 2010 15:55:59 -0400
From: Jake Vang <vangjake@googlemail.com>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US;
 rv:1.9.2.8) Gecko/20100802 Lightning/1.0b2 Thunderbird/3.1.2
MIME-Version: 1.0
To: mapreduce-user@hadoop.apache.org
Subject: how to submit jobs to a multi-node cluster (linux) from cygwin
 (windows)
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

  i seem to be having problems submitting jobs from hadoop using cygwin 
in windows (windows 7) to a hadoop multi-node cluster (ubuntu).

in windows/cygwin, i have created a user called hadoop. this user, 
hadoop, is also the user that is created on the master/slave nodes as 
well. furthermore, i have set dfs.permissions to false.

i have an xml file called, hadoop-cluster.xml with the following 
name-value pairs.
* fs.default.name=hdfs://hadoop-0:54310
* mapred.job.tracker=hadoop-0:54311

when i run hadoop (using cygwin) i try a command like this:
bin/hadoop my-lib.jar /user/hadoop/input-dir /user/hadoop/output-dir 
-conf conf/hadoop-cluster.xml

but it always fails. the command never passes in the input and output 
arguments to the program and it exits. why is this? when i upload this 
jar file to a data node (more precisely, the master node, name node), 
and run this command then it works (of course, then i don't need to pass 
in the -conf param).

any help is appreciated.