Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Message-ID: <25138298.post@talk.nabble.com>
Date: Tue, 25 Aug 2009 10:00:45 -0700 (PDT)
From: thkunkel <thkunkel@gmail.com>
To: core-user@hadoop.apache.org
Subject: Re: Replication happens too many time when FTP to HDFS
In-Reply-To: <A173EBE1-F375-4B25-8580-046FE26437DC@cse.unl.edu>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
References: <8134a2730908250928y797b95b5mda7d894ba1adf907@mail.gmail.com>
 <A173EBE1-F375-4B25-8580-046FE26437DC@cse.unl.edu>


Gotcha, thanks.

Any idea how to do that on a Windows machine?  My Hadoop cluster is on 3
Ubuntu nodes, but I'm transferring data from a bunch of Windows servers.  Or
can I configure replication in the FTP client itself?

-Turner


Brian Bockelman wrote:
> 
> Hey Turner,
> 
> Replication level is requested by the client.  You need to set the  
> replication factor on the hadoop configuration of the client, not the  
> nodes.
> 
> Brian
> 
> On Aug 25, 2009, at 11:28 AM, Turner Kunkel wrote:
> 
>> Is there any way to set the replication to a specific number while
>> FTP-ing to the HDFS?
>> I have dfs.replication set to 2 on the nodes, but when I transfer
>> something via FTP to HDFS it replicates 3 times.
>>
>> Thanks.
>> -- 
>>
>> -Turner Kunkel
> 
> 
>  
> 

-- 
View this message in context: http://www.nabble.com/Replication-happens-too-many-time-when-FTP-to-HDFS-tp25137745p25138298.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.