hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From thkunkel <thkun...@gmail.com>
Subject Re: Replication happens too many time when FTP to HDFS
Date Tue, 25 Aug 2009 17:00:45 GMT

Gotcha, thanks.

Any idea how to do that on a Windows machine?  My Hadoop cluster is on 3
Ubuntu nodes, but I'm transferring data from a bunch of Windows servers.  Or
can I configure replication in the FTP client itself?

-Turner


Brian Bockelman wrote:
> 
> Hey Turner,
> 
> Replication level is requested by the client.  You need to set the  
> replication factor on the hadoop configuration of the client, not the  
> nodes.
> 
> Brian
> 
> On Aug 25, 2009, at 11:28 AM, Turner Kunkel wrote:
> 
>> Is there any way to set the replication to a specific number while
>> FTP-ing to the HDFS?
>> I have dfs.replication set to 2 on the nodes, but when I transfer
>> something via FTP to HDFS it replicates 3 times.
>>
>> Thanks.
>> -- 
>>
>> -Turner Kunkel
> 
> 
>  
> 

-- 
View this message in context: http://www.nabble.com/Replication-happens-too-many-time-when-FTP-to-HDFS-tp25137745p25138298.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message