hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nascimento, Rodrigo" <Rodrigo.Nascime...@netapp.com>
Subject Fwd: hdfs fsck -locations
Date Fri, 24 Jan 2014 22:00:13 GMT
Mark,

there we go ;-)

Rodrigo Nascimento
Systems Engineer @ Brazil
Mobile +55 11 991.873.810

Sent from my iPhone

Begin forwarded message:

From: "Nascimento, Rodrigo" <Rodrigo.Nascimento@netapp.com<mailto:Rodrigo.Nascimento@netapp.com>>
Date: 24 de janeiro de 2014 15:59:33 BRST
To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>>
Subject: RE: hdfs fsck -locations

Hi Mark,

It is a sample from my sandbox. Your question is about the part that is in RED at the output
below, right?

[root@sandbox ~]# hdfs fsck /user/ambari-qa/passwd  -locations
Connecting to namenode via http://sandbox.hortonworks.com:50070
FSCK started by root (auth:SIMPLE) from /172.16.13.30 for path /user/ambari-qa/passwd at Fri
Jan 24 09:53:43 PST 2014
.
/user/ambari-qa/passwd:  Under replicated BP-1578958328-10.0.2.15-1382306880516:blk_1073742464_1640.
Target Replicas is 3 but found 1 replica(s).
Status: HEALTHY
 Total size:    1708 B
 Total dirs:    0
 Total files:    1
 Total symlinks:        0
 Total blocks (validated):    1 (avg. block size 1708 B)
 Minimally replicated blocks:    1 (100.0 %)
 Over-replicated blocks:    0 (0.0 %)
 Under-replicated blocks:    1 (100.0 %)
 Mis-replicated blocks:        0 (0.0 %)
 Default replication factor:    3
 Average block replication:    1.0
 Corrupt blocks:        0
 Missing replicas:        2 (66.666664 %)
 Number of data-nodes:        1
 Number of racks:        1
FSCK ended at Fri Jan 24 09:53:43 PST 2014 in 1 milliseconds


The filesystem under path '/user/ambari-qa/passwd' is HEALTHY
[root@sandbox ~]#

Rod Nascimento

________________________________
From: Nascimento, Rodrigo [Rodrigo.Nascimento@netapp.com<mailto:Rodrigo.Nascimento@netapp.com>]
Sent: Friday, January 24, 2014 3:34 PM
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: RE: hdfs fsck -locations

I’m not seeing locations flag yet.

Rod Nascimento
Systems Engineer @ Brazil

People don’t buy WHAT you do. They buy WHY you do it.

From: Mark Kerzner [mailto:mark.kerzner@shmsoft.com]
Sent: Friday, January 24, 2014 3:16 PM
To: Hadoop User
Subject: Re: hdfs fsck -locations

Sorry, did not copy the full command

hdfs fsck /user/mark/data/word_count.csv -locations
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232<http://192.168.1.232> for path
/user/mark/data/word_count.csv at Fri Jan 24 11:15:17 CST 2014
.Status: HEALTHY
 Total size:       7217 B
 Total dirs:       0
 Total files:      1
 Total blocks (validated):        1 (avg. block size 7217 B)
 Minimally replicated blocks:  1 (100.0 %)
 Over-replicated blocks:          0 (0.0 %)
 Under-replicated blocks:        0 (0.0 %)
 Mis-replicated blocks:                        0 (0.0 %)
 Default replication factor:      1
 Average block replication:     1.0
 Corrupt blocks:                      0
 Missing replicas:                     0 (0.0 %)
 Number of data-nodes:                      1
 Number of racks:                   1
FSCK ended at Fri Jan 24 11:15:17 CST 2014 in 1 milliseconds


The filesystem under path '/user/mark/data/word_count.csv' is HEALTHY


On Fri, Jan 24, 2014 at 11:08 AM, Harsh J <harsh@cloudera.com<mailto:harsh@cloudera.com>>
wrote:

Sorry, but what was the question? I also do not see a locations option flag.
On Jan 24, 2014 7:17 PM, "Mark Kerzner" <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
wrote:
Here is an example

 hdfs fsck /user/mark/data/word_count.csv
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232<http://192.168.1.232> for path
/user/mark/data/word_count.csv at Fri Jan 24 07:45:24 CST 2014
.Status: HEALTHY
 Total size: 7217 B
 Total dirs: 0
 Total files: 1
 Total blocks (validated): 1 (avg. block size 7217 B)
 Minimally replicated blocks: 1 (100.0 %)
 Over-replicated blocks: 0 (0.0 %)
 Under-replicated blocks: 0 (0.0 %)
 Mis-replicated blocks: 0 (0.0 %)
 Default replication factor: 1
 Average block replication: 1.0
 Corrupt blocks: 0
 Missing replicas: 0 (0.0 %)
 Number of data-nodes: 1
 Number of racks: 1
FSCK ended at Fri Jan 24 07:45:24 CST 2014 in 0 milliseconds


On Fri, Jan 24, 2014 at 4:34 AM, Harsh J <harsh@cloudera.com<mailto:harsh@cloudera.com>>
wrote:
Hi Mark,

Yes, the locations are shown as IP.

On Fri, Jan 24, 2014 at 12:09 AM, Mark Kerzner <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
wrote:
> Hi,
>
> hdfs fsck -locations
>
> is supposed to show every block with its location? Is location the ip of the
> datanode?
>
> Thank you,
> Mark


--
Harsh J



Mime
View raw message