Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A559A10FA4 for ; Fri, 24 Jan 2014 17:31:26 +0000 (UTC) Received: (qmail 65996 invoked by uid 500); 24 Jan 2014 17:16:16 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 65902 invoked by uid 500); 24 Jan 2014 17:16:15 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 65894 invoked by uid 99); 24 Jan 2014 17:16:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jan 2014 17:16:15 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [74.125.82.51] (HELO mail-wg0-f51.google.com) (74.125.82.51) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jan 2014 17:16:08 +0000 Received: by mail-wg0-f51.google.com with SMTP id z12so3228584wgg.6 for ; Fri, 24 Jan 2014 09:15:48 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=25HlMr8quOBVnGweJTQmVK+aMttMh6y1rQxlDjpz7DM=; b=LE9gjbxwqErRg59ol3IdjovBi+fbBrPX2BjIQ1em2Xc4fxE5mGAz3p+mDcoPnDX4dy FBqDLtilSOwAvDrO+U6f1N9X4ADnofF9I3251j9d6jyUA0O+9eRJY4Ql9DMUpfeUI5vX 827PSUsOwFoWGDXttxGQG84+KJ4l2tsXOByOlk2wfy6VsWqrzYEMSvXJHKnRgY1H1P70 fZVv0TwIhPc0eYku9Qv1VBlXk+dbW88sWtFztt1U7oSZoABosXGYffzNBAA3WjJcqHEb KXZYSVlJcexWZeukFKYEP3LiIGEyg4krX/ctNEJ/lkCyU1aQJQGj65PhJY9ZXjooB90q nUTg== X-Gm-Message-State: ALoCoQmejKdFAU+3mx9Pvtpk3rgH3rlXnvYkrHooCErQxaj8DlcnK43PjGq3nWsIcYBDz3Bm6GeM MIME-Version: 1.0 X-Received: by 10.181.13.11 with SMTP id eu11mr3941041wid.30.1390583748344; Fri, 24 Jan 2014 09:15:48 -0800 (PST) Received: by 10.194.8.71 with HTTP; Fri, 24 Jan 2014 09:15:48 -0800 (PST) X-Originating-IP: [50.162.32.156] In-Reply-To: References: Date: Fri, 24 Jan 2014 11:15:48 -0600 Message-ID: Subject: Re: hdfs fsck -locations From: Mark Kerzner To: Hadoop User Content-Type: multipart/alternative; boundary=f46d043c7de659d40b04f0ba8262 X-Virus-Checked: Checked by ClamAV on apache.org --f46d043c7de659d40b04f0ba8262 Content-Type: text/plain; charset=ISO-8859-1 Sorry, did not copy the full command hdfs fsck /user/mark/data/word_count.csv -locations Connecting to namenode via http://mark-7:50070 FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path /user/mark/data/word_count.csv at Fri Jan 24 11:15:17 CST 2014 .Status: HEALTHY Total size: 7217 B Total dirs: 0 Total files: 1 Total blocks (validated): 1 (avg. block size 7217 B) Minimally replicated blocks: 1 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 1 Average block replication: 1.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 1 Number of racks: 1 FSCK ended at Fri Jan 24 11:15:17 CST 2014 in 1 milliseconds The filesystem under path '/user/mark/data/word_count.csv' is HEALTHY On Fri, Jan 24, 2014 at 11:08 AM, Harsh J wrote: > Sorry, but what was the question? I also do not see a locations option > flag. > On Jan 24, 2014 7:17 PM, "Mark Kerzner" wrote: > >> Here is an example >> >> hdfs fsck /user/mark/data/word_count.csv >> Connecting to namenode via http://mark-7:50070 >> FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path >> /user/mark/data/word_count.csv at Fri Jan 24 07:45:24 CST 2014 >> .Status: HEALTHY >> Total size: 7217 B >> Total dirs: 0 >> Total files: 1 >> Total blocks (validated): 1 (avg. block size 7217 B) >> Minimally replicated blocks: 1 (100.0 %) >> Over-replicated blocks: 0 (0.0 %) >> Under-replicated blocks: 0 (0.0 %) >> Mis-replicated blocks: 0 (0.0 %) >> Default replication factor: 1 >> Average block replication: 1.0 >> Corrupt blocks: 0 >> Missing replicas: 0 (0.0 %) >> Number of data-nodes: 1 >> Number of racks: 1 >> FSCK ended at Fri Jan 24 07:45:24 CST 2014 in 0 milliseconds >> >> >> >> On Fri, Jan 24, 2014 at 4:34 AM, Harsh J wrote: >> >>> Hi Mark, >>> >>> Yes, the locations are shown as IP. >>> >>> On Fri, Jan 24, 2014 at 12:09 AM, Mark Kerzner >>> wrote: >>> > Hi, >>> > >>> > hdfs fsck -locations >>> > >>> > is supposed to show every block with its location? Is location the ip >>> of the >>> > datanode? >>> > >>> > Thank you, >>> > Mark >>> >>> >>> >>> -- >>> Harsh J >>> >> >> --f46d043c7de659d40b04f0ba8262 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Sorry, did not copy the full command

hdfs fsck /user/mark/data/word_count.csv -locations
Connecting= to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path /user/mark/data/word_count.csv at Fri Jan 24= 11:15:17 CST 2014
.Status: HEALTHY
=A0Total size: 7217 B
=A0Total dirs: 0
=A0Total files: 1<= /div>
=A0Total blocks (validated): 1 (avg. block size 7217 B)
=A0Minimally replicated blocks: 1 (100.0 %)
=A0Over-replicated blocks: 0 (0.0 %)
=A0Under-replicated= blocks: 0 (0.0 %)
=A0Mis-replicated blocks: = 0 (0.0 %)
=A0Default replication factor: 1
=A0Average block replication:<= span class=3D"" style=3D"white-space:pre"> 1.0
=A0Corrupt blocks: = 0
=A0Missing replicas:= 0 (0.0 %)
=A0Number of data-nodes: 1
=A0Number of racks: 1
FSCK ended at Fri Jan 24 11:15:17 CST 2014 in 1 milliseconds


The filesystem under path '/user= /mark/data/word_count.csv' is HEALTHY



On Fri, Jan 24, 2014 at 11:08 AM, Harsh J &= lt;harsh@cloudera.c= om> wrote:

Sorry, but what was the quest= ion? I also do not see a locations option flag.

On Jan 24, 2014 7:17 PM, "Mark Kerzner"= ; <mark.ke= rzner@shmsoft.com> wrote:
Here is an example

=A0hdfs fsck /u= ser/mark/data/word_count.csv
Connecting to namenode via http://mark-7:50070
FSCK started by mark (auth:SIMPLE) from /192.168.1.232 for path /user/mark/data/word_count.cs= v at Fri Jan 24 07:45:24 CST 2014
.Status: HEALTHY
=A0Total size: 7217 B
=A0Total dirs: 0
=A0Total files: 1
=A0Total blocks (validated): 1 (avg. block size 7217 B)
=A0Minimally replicated blocks: 1 (100.0 %)
=A0Over-repl= icated blocks: 0 (0.0 %)
=A0Under-replicated blocks: 0 (0.0 %)
=A0Mis-replicated blocks: 0 (0.0 %)
=A0Default replication factor: 1
=A0Average block replication: 1.0
=A0Corrupt blocks: = 0
=A0Missing replicas: 0 (0.0 %)
=A0Number of data-nodes: = 1
=A0Number of racks: 1
FSCK ended at Fri Jan 24 07:45:24 CST 2014 in 0 milliseconds<= /div>



On Fri, Jan 24, 2014 at 4:34 AM, Harsh J &l= t;harsh@cloudera.co= m> wrote:
Hi Mark,

Yes, the locations are shown as IP.

On Fri, Jan 24, 2014 at 12:09 AM, Mark Kerzner <mark.kerzner@shmsoft.com> wrot= e:
> Hi,
>
> hdfs fsck -locations
>
> is supposed to show every block with its location? Is location the ip = of the
> datanode?
>
> Thank you,
> Mark



--
Harsh J


--f46d043c7de659d40b04f0ba8262--