Mailing-List: contact hadoop-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=X-YMail-OSG:Received:Date:From:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID;
  b=XnJ56r/hGPIOSZOUzS0g0OvhCIamBV02WnBFOA9AIvzwE6Jw5OqXtJGmuYHLWut3I0E1J4+1JwO8yJi5Et+zlWuPzt4Zf96WMAhSLcxKOavKk3sNx5OgnAUnqnKwvvHVOkLTO2iNZebenmCwrtwi/od6wweHKjFQjJAuPDVwG7g=;
Date: Mon, 10 Dec 2007 11:58:49 -0800 (PST)
From: C G <parallelguy@yahoo.com>
Subject: HDFS tool and replication questions...
To: hadoop-user@lucene.apache.org
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-2128194045-1197316729=:18294"
Content-Transfer-Encoding: 8bit
Message-ID: <639206.18294.qm@web45406.mail.sp1.yahoo.com>

--0-2128194045-1197316729=:18294
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: 8bit

Hi All:
   
  Is there a tool available that will provide information about how a file is replicated within HDFS?  I'm looking for something that will "prove" that a file is replicated across multiple nodes, and let me see how many nodes participated, etc.  This is a point of interest technically, but more importantly a point of due diligence around data security and integrity accountability. 
   
  Also, are there any metrics or best practices around what the replication factor should be based on the number of nodes in the grid?  Does HDFS attempt to involve all nodes in the grid in replication?  In other words, if I have 100 nodes in my grid, and a replication factor of 6, will all 100 nodes wind up storing data for a given file assuming the file large enough?
   
  Thanks,
  C G

       
---------------------------------
Looking for last minute shopping deals?  Find them fast with Yahoo! Search.
--0-2128194045-1197316729=:18294--