hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: testing if replication working
Date Mon, 01 Mar 2010 18:02:24 GMT

On 2/28/10 11:48 PM, "Terrence Martin" <tmartin@physics.ucsd.edu> wrote:

> Mag Gam wrote:
>> I just setup my first hadoop cluster with 5 nodes. What is the best
>> way to check if replication is really working? I assume the best way
>> is to power down 2 nodes and see if I can still reach my data?

> Well if you run
> hadoop fsck /
> it will give you a report of the number of replicas, if a file has less
> than your configured replicas it will tell you that you are under
> replicated.

You can also tell fsck to show you which blocks are on which datanodes ...

hadoop fsck / -files -blocks -locations

... to do a manual inspection.

View raw message