hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Kerzner <mark.kerz...@shmsoft.com>
Subject Re: hdfs fsck -locations
Date Fri, 24 Jan 2014 20:31:07 GMT
HI, Rodrigo, I am fine thank you :)

Here is the _complete_ output

mark@mark-7:~$ hdfs fsck /user/mark/data/word_count.csv -locations
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path
/user/mark/data/word_count.csv at Fri Jan 24 14:30:23 CST 2014
.Status: HEALTHY
 Total size: 7217 B
 Total dirs: 0
 Total files: 1
 Total blocks (validated): 1 (avg. block size 7217 B)
 Minimally replicated blocks: 1 (100.0 %)
 Over-replicated blocks: 0 (0.0 %)
 Under-replicated blocks: 0 (0.0 %)
 Mis-replicated blocks: 0 (0.0 %)
 Default replication factor: 1
 Average block replication: 1.0
 Corrupt blocks: 0
 Missing replicas: 0 (0.0 %)
 Number of data-nodes: 1
 Number of racks: 1
FSCK ended at Fri Jan 24 14:30:23 CST 2014 in 0 milliseconds


The filesystem under path '/user/mark/data/word_count.csv' is HEALTHY
mark@mark-7:~$


On Fri, Jan 24, 2014 at 1:35 PM, Nascimento, Rodrigo <
Rodrigo.Nascimento@netapp.com> wrote:

>  Hi Mark,
>
>  How are you?
>
>  at your output from word_count.csv, the portion related to the nlock
> locations is missing. This is the reason why I told you in my previous
> message that "I'm not seeing locations yet."
>
>  please, take a look at my last e-mail.
>
> All the best,
>
> Rodrigo Nascimento
> Systems Engineer @ Brazil
>
>  Sent from my iPhone
>
> On 24/01/2014, at 16:40, "Mark Kerzner" <mark.kerzner@shmsoft.com> wrote:
>
>
> hdfs fsck /user/mark/data/word_count.csv *-locations*
>
>
> On Fri, Jan 24, 2014 at 11:34 AM, Nascimento, Rodrigo <
> Rodrigo.Nascimento@netapp.com> wrote:
>
>>  I’m not seeing locations flag yet.
>>
>>
>>
>> *Rod Nascimento*
>>
>> *Systems Engineer @ Brazil*
>>
>>
>>
>> *People **don’t** buy **WHAT** you do. They buy **WHY** you do it.*
>>
>>
>>
>> *From:* Mark Kerzner [mailto:mark.kerzner@shmsoft.com]
>> *Sent:* Friday, January 24, 2014 3:16 PM
>> *To:* Hadoop User
>> *Subject:* Re: hdfs fsck -locations
>>
>>
>>
>> Sorry, did not copy the full command
>>
>>
>>
>> hdfs fsck /user/mark/data/word_count.csv -locations
>>
>> Connecting to namenode via http://mark-7:50070
>>
>> FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path
>> /user/mark/data/word_count.csv at Fri Jan 24 11:15:17 CST 2014
>>
>> .Status: HEALTHY
>>
>>  Total size:       7217 B
>>
>>  Total dirs:       0
>>
>>  Total files:      1
>>
>>  Total blocks (validated):        1 (avg. block size 7217 B)
>>
>>  Minimally replicated blocks:  1 (100.0 %)
>>
>>  Over-replicated blocks:          0 (0.0 %)
>>
>>  Under-replicated blocks:        0 (0.0 %)
>>
>>  Mis-replicated blocks:                        0 (0.0 %)
>>
>>  Default replication factor:      1
>>
>>  Average block replication:     1.0
>>
>>  Corrupt blocks:                      0
>>
>>  Missing replicas:                     0 (0.0 %)
>>
>>  Number of data-nodes:                      1
>>
>>  Number of racks:                   1
>>
>> FSCK ended at Fri Jan 24 11:15:17 CST 2014 in 1 milliseconds
>>
>>
>>
>>
>>
>> The filesystem under path '/user/mark/data/word_count.csv' is HEALTHY
>>
>>
>>
>>
>>
>> On Fri, Jan 24, 2014 at 11:08 AM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Sorry, but what was the question? I also do not see a locations option
>> flag.
>>
>> On Jan 24, 2014 7:17 PM, "Mark Kerzner" <mark.kerzner@shmsoft.com> wrote:
>>
>> Here is an example
>>
>>
>>
>>  hdfs fsck /user/mark/data/word_count.csv
>>
>> Connecting to namenode via http://mark-7:50070
>>
>> FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path
>> /user/mark/data/word_count.csv at Fri Jan 24 07:45:24 CST 2014
>>
>> .Status: HEALTHY
>>
>>  Total size: 7217 B
>>
>>  Total dirs: 0
>>
>>  Total files: 1
>>
>>  Total blocks (validated): 1 (avg. block size 7217 B)
>>
>>  Minimally replicated blocks: 1 (100.0 %)
>>
>>  Over-replicated blocks: 0 (0.0 %)
>>
>>  Under-replicated blocks: 0 (0.0 %)
>>
>>  Mis-replicated blocks: 0 (0.0 %)
>>
>>  Default replication factor: 1
>>
>>  Average block replication: 1.0
>>
>>  Corrupt blocks: 0
>>
>>  Missing replicas: 0 (0.0 %)
>>
>>  Number of data-nodes: 1
>>
>>  Number of racks: 1
>>
>> FSCK ended at Fri Jan 24 07:45:24 CST 2014 in 0 milliseconds
>>
>>
>>
>>
>>
>> On Fri, Jan 24, 2014 at 4:34 AM, Harsh J <harsh@cloudera.com> wrote:
>>
>> Hi Mark,
>>
>> Yes, the locations are shown as IP.
>>
>>
>> On Fri, Jan 24, 2014 at 12:09 AM, Mark Kerzner <mark.kerzner@shmsoft.com>
>> wrote:
>> > Hi,
>> >
>> > hdfs fsck -locations
>> >
>> > is supposed to show every block with its location? Is location the ip
>> of the
>> > datanode?
>> >
>> > Thank you,
>> > Mark
>>
>>
>>   --
>> Harsh J
>>
>>
>>
>>
>>
>
>

Mime
View raw message