Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-ID: <4CA05361.2090903@affinitas.de>
Date: Mon, 27 Sep 2010 10:18:41 +0200
From: Martin Kuhn <martin.kuhn@affinitas.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
 rv:1.9.1.12) Gecko/20100915 Lightning/1.0b1 Thunderbird/3.0.8
MIME-Version: 1.0
To: mapreduce-user@hadoop.apache.org
Subject: Re: Remote connection bottleneck?
References: <AANLkTikF=6UATJr=n=jg9wjfxwSt9mGMsNqZ3gjKu+yy@mail.gmail.com>
	<AANLkTi=VtNOfRy9R6Bg2GHQ8hdyRi8cpyigjX4gSmkfo@mail.gmail.com>
	<AANLkTik_Lf1XXkkhmp5-iVdxgDL10xZDE1WmoRhw1dE9@mail.gmail.com>
	<AANLkTik8U=f=u5we=LvOCAk6EyqokCFbo3w9ytAnm39H@mail.gmail.com>
	<AANLkTikG0LNZH9e=YMa4URq2+0m+yCQDEC_M8OU-XwTS@mail.gmail.com>
	<AANLkTin6ZOht5C7PkukbrFVuszg9j9ywNJzVFJce87T2@mail.gmail.com>
	<AANLkTi=Y9JC3qTihH9x2TTn=xUWWXznmxiCC0zp5Zk9W@mail.gmail.com>
	<AANLkTinDKhtDGtgJe2F4OaQfPSZYa2RHj23zhX_Ai=-m@mail.gmail.com>
 <AANLkTinEAhDt5m+b6Rh_c0djMrdtfEJ2JvVHAZBeocuQ@mail.gmail.com>
In-Reply-To: <AANLkTinEAhDt5m+b6Rh_c0djMrdtfEJ2JvVHAZBeocuQ@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi Mario,

> In the ssh I can't execute local files while my session is open...

Of course, you can refer to local files in the hadoop command, but
if you're in the ssh window, the files on your PC are remote ;-)

It should work fine if you put your jar via (win)scp on the remote
computer. With an appropriate hadoop configuration, you should also
be able to submit jobs directly from your local PC into the cluster,
without actually being part of it.

The only idea I have so far for your split problem is that you may
not have your big input file deployed on HDFS before you've started
your hadoop job?


Best regards.
martin.