Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dechouxb@gmail.com designates
 209.85.215.41 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CACeqxwToV2YX_aMZ9b62HPU89yDFbSxY_fKHuixkXzNiF+ZocA@mail.gmail.com>
References: 
 <CACeqxwToV2YX_aMZ9b62HPU89yDFbSxY_fKHuixkXzNiF+ZocA@mail.gmail.com>
Date: Tue, 30 Jul 2013 09:10:06 +0200
Message-ID: 
 <CAO6W-2fHnY_4uffbDXpxAwgk2PPbd3FGcQg4nFetQm1x2Lxutw@mail.gmail.com>
Subject: Re: hadoop missing file?
From: Bertrand Dechoux <dechouxb@gmail.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=001a11c3ed306ffbf704e2b54cc2

--001a11c3ed306ffbf704e2b54cc2
Content-Type: text/plain; charset=ISO-8859-1

(10-3) * 129 = 903

But long answer
1) which missing file?
2) how do you know it is missing?

You have a cluster with 3 datanodes, the default replication factor is 3
but not for the job jar which is 10 (mapred.submit.replication).
Let's say you ran 129 jobs who failed in a weird way (like at submission),
you would have 129 under-replicated blocks (one block per jar because your
jar is small) and 903 missing replicas because with 3 datanodes you can't
have more than 3 replicas anyway.

So back to the first question : which missing file?
It might only be that the file hasn't be uploaded in the first place. It
happens.

For all your blocks, you do have at least one replica : Minimally
replicated blocks:   5651 (100.0 %)

Bertrand


On Tue, Jul 30, 2013 at 8:54 AM, ch huang <justlooks@gmail.com> wrote:

> one of my workmate told me some of his file missing ,i use fs check find
> following info , how can i prevent  them from missing? anyone can help me?
>
> Status: HEALTHY
>  Total size:    272020850157 B (Total open files size: 652056 B)
>  Total dirs:    1143
>  Total files:   1886 (Files currently being written: 2)
>  Total blocks (validated):      5651 (avg. block size 48136763 B) (Total
> open file blocks (not validated): 1)
>  Minimally replicated blocks:   5651 (100.0 %)
>  Over-replicated blocks:        0 (0.0 %)
>  Under-replicated blocks:       129 (2.2827818 %)
>  Mis-replicated blocks:         0 (0.0 %)
>  Default replication factor:    3
>  Average block replication:     3.0
>  Corrupt blocks:                0
>  Missing replicas:              903 (5.0571237 %)
>  Number of data-nodes:          3
>  Number of racks:               1
> FSCK ended at Tue Jul 30 14:38:01 CST 2013 in 462 milliseconds
>


-- 
Bertrand Dechoux

--001a11c3ed306ffbf704e2b54cc2
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div><div><div><div>(10-3) * 129 =3D 9=
03<br><br></div>But long answer<br></div>1) which missing file?<br></div>2)=
 how do you know it is missing?<br><br></div>You have a cluster with 3 data=
nodes, the default replication factor is 3 but not for the job jar which is=
 10 (mapred.submit.replication).<br>
</div>Let&#39;s say you ran 129 jobs who failed in a weird way (like at sub=
mission), you would have 129 under-replicated blocks (one block per jar bec=
ause your jar is small) and 903 missing replicas because with 3 datanodes y=
ou can&#39;t have more than 3 replicas anyway.<br>
<br></div>So back to the first question : which missing file?<br></div>It m=
ight only be that the file hasn&#39;t be uploaded in the first place. It ha=
ppens.<br><br></div><div>For all your blocks, you do have at least one repl=
ica : Minimally replicated blocks:=A0=A0 5651 (100.0 %)</div>
<div><br></div>Bertrand<br><br><div class=3D"gmail_extra"><br><br><div clas=
s=3D"gmail_quote">On Tue, Jul 30, 2013 at 8:54 AM, ch huang <span dir=3D"lt=
r">&lt;<a href=3D"mailto:justlooks@gmail.com" target=3D"_blank">justlooks@g=
mail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div>one of my workmate told me some of his =
file missing ,i use fs check find following info , how can i prevent=A0 the=
m from missing? anyone can help me?</div>

<div>=A0</div>
<div>Status: HEALTHY<br>=A0Total size:=A0=A0=A0 272020850157 B (Total open =
files size: 652056 B)<br>=A0Total dirs:=A0=A0=A0 1143<br>=A0Total files:=A0=
=A0 1886 (Files currently being written: 2)<br>=A0Total blocks (validated):=
=A0=A0=A0=A0=A0 5651 (avg. block size 48136763 B) (Total open file blocks (=
not validated): 1)<br>

=A0Minimally replicated blocks:=A0=A0 5651 (100.0 %)<br>=A0Over-replicated =
blocks:=A0=A0=A0=A0=A0=A0=A0 0 (0.0 %)<br>=A0Under-replicated blocks:=A0=A0=
=A0=A0=A0=A0 129 (2.2827818 %)<br>=A0Mis-replicated blocks:=A0=A0=A0=A0=A0=
=A0=A0=A0 0 (0.0 %)<br>=A0Default replication factor:=A0=A0=A0 3<br>

=A0Average block replication:=A0=A0=A0=A0 3.0<br>=A0Corrupt blocks:=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0<br>=A0Missing replicas:=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 903 (5.0571237 %)<br>=A0Number of data-nodes=
:=A0=A0=A0=A0=A0=A0=A0=A0=A0 3<br>=A0Number of racks:=A0=A0=A0=A0=A0=A0=A0=
=A0=A0=A0=A0=A0=A0=A0 1<br>FSCK ended at Tue Jul 30 14:38:01 CST 2013 in 46=
2 milliseconds<br>

</div>
</blockquote></div><br><br clear=3D"all"><br>-- <br>Bertrand Dechoux
</div></div>

--001a11c3ed306ffbf704e2b54cc2--