hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shahab Yunus <shahab.yu...@gmail.com>
Subject Re: Pulling data from secured hadoop cluster to another hadoop cluster
Date Tue, 28 May 2013 14:05:47 GMT
Also Samir, when you say 'secured', by any chance that cluster is secured
with Kerberos (rather than ssh)?

-Shahab


On Tue, May 28, 2013 at 8:29 AM, Nitin Pawar <nitinpawar432@gmail.com>wrote:

> hadoop daemons do not use ssh to communicate.
>
> if  your distcp job could not connect to remote server then either the
> connection was rejected by the target namenode or the it was not able to
> establish the network connection.
>
> were you able to see the hdfs on server1 from server2?
>
>
> On Tue, May 28, 2013 at 5:17 PM, samir das mohapatra <
> samir.helpdoc@gmail.com> wrote:
>
>> Hi All,
>>   I could able to connect the hadoop (source ) cluster after ssh is
>> established.
>>
>> But i wanted to know, If I want to pull some data using distcp from
>> source secured hadoop box to another hadoop cluster , I could not able to
>> ping  name node machine.  In this approach how to run distcp command from
>> target cluster in with secured connection.
>>
>> Source: hadoop.server1 (ssh secured)
>> Target:  hadoop.server2 (runing distcp here)
>>
>>
>> running command:
>>
>> distcp hftp://hadoop.server1:50070/dataSet
>> hdfs://hadoop.server2:54310/targetDataSet
>>
>>
>> Regards,
>> samir.
>>
>
>
>
> --
> Nitin Pawar
>

Mime
View raw message