hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nascimento, Rodrigo" <Rodrigo.Nascime...@netapp.com>
Subject Re: hdfs fsck -locations
Date Fri, 24 Jan 2014 19:35:32 GMT
Hi Mark,

How are you?

at your output from word_count.csv, the portion related to the nlock locations is missing.
This is the reason why I told you in my previous message that "I'm not seeing locations yet."

please, take a look at my last e-mail.

All the best,

Rodrigo Nascimento
Systems Engineer @ Brazil

Sent from my iPhone

On 24/01/2014, at 16:40, "Mark Kerzner" <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
wrote:


hdfs fsck /user/mark/data/word_count.csv -locations


On Fri, Jan 24, 2014 at 11:34 AM, Nascimento, Rodrigo <Rodrigo.Nascimento@netapp.com<mailto:Rodrigo.Nascimento@netapp.com>>
wrote:
I’m not seeing locations flag yet.

Rod Nascimento
Systems Engineer @ Brazil

People don’t buy WHAT you do. They buy WHY you do it.

From: Mark Kerzner [mailto:mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>]
Sent: Friday, January 24, 2014 3:16 PM
To: Hadoop User
Subject: Re: hdfs fsck -locations

Sorry, did not copy the full command

hdfs fsck /user/mark/data/word_count.csv -locations
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232<http://192.168.1.232> for path
/user/mark/data/word_count.csv at Fri Jan 24 11:15:17 CST 2014
.Status: HEALTHY
 Total size:       7217 B
 Total dirs:       0
 Total files:      1
 Total blocks (validated):        1 (avg. block size 7217 B)
 Minimally replicated blocks:  1 (100.0 %)
 Over-replicated blocks:          0 (0.0 %)
 Under-replicated blocks:        0 (0.0 %)
 Mis-replicated blocks:                        0 (0.0 %)
 Default replication factor:      1
 Average block replication:     1.0
 Corrupt blocks:                      0
 Missing replicas:                     0 (0.0 %)
 Number of data-nodes:                      1
 Number of racks:                   1
FSCK ended at Fri Jan 24 11:15:17 CST 2014 in 1 milliseconds


The filesystem under path '/user/mark/data/word_count.csv' is HEALTHY


On Fri, Jan 24, 2014 at 11:08 AM, Harsh J <harsh@cloudera.com<mailto:harsh@cloudera.com>>
wrote:

Sorry, but what was the question? I also do not see a locations option flag.
On Jan 24, 2014 7:17 PM, "Mark Kerzner" <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
wrote:
Here is an example

 hdfs fsck /user/mark/data/word_count.csv
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232<http://192.168.1.232> for path
/user/mark/data/word_count.csv at Fri Jan 24 07:45:24 CST 2014
.Status: HEALTHY
 Total size: 7217 B
 Total dirs: 0
 Total files: 1
 Total blocks (validated): 1 (avg. block size 7217 B)
 Minimally replicated blocks: 1 (100.0 %)
 Over-replicated blocks: 0 (0.0 %)
 Under-replicated blocks: 0 (0.0 %)
 Mis-replicated blocks: 0 (0.0 %)
 Default replication factor: 1
 Average block replication: 1.0
 Corrupt blocks: 0
 Missing replicas: 0 (0.0 %)
 Number of data-nodes: 1
 Number of racks: 1
FSCK ended at Fri Jan 24 07:45:24 CST 2014 in 0 milliseconds


On Fri, Jan 24, 2014 at 4:34 AM, Harsh J <harsh@cloudera.com<mailto:harsh@cloudera.com>>
wrote:
Hi Mark,

Yes, the locations are shown as IP.

On Fri, Jan 24, 2014 at 12:09 AM, Mark Kerzner <mark.kerzner@shmsoft.com<mailto:mark.kerzner@shmsoft.com>>
wrote:
> Hi,
>
> hdfs fsck -locations
>
> is supposed to show every block with its location? Is location the ip of the
> datanode?
>
> Thank you,
> Mark


--
Harsh J




Mime
View raw message