Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 65C5B200C19 for ; Sun, 12 Feb 2017 13:15:54 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 646E5160B6B; Sun, 12 Feb 2017 12:15:54 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8511B160B45 for ; Sun, 12 Feb 2017 13:15:53 +0100 (CET) Received: (qmail 80539 invoked by uid 500); 12 Feb 2017 12:15:51 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 80527 invoked by uid 99); 12 Feb 2017 12:15:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 12 Feb 2017 12:15:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B9741C130F for ; Sun, 12 Feb 2017 12:15:50 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.898 X-Spam-Level: * X-Spam-Status: No, score=1.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 5VhLxx1Z0l5j for ; Sun, 12 Feb 2017 12:15:46 +0000 (UTC) Received: from mail-io0-f172.google.com (mail-io0-f172.google.com [209.85.223.172]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 02CCC5F5C7 for ; Sun, 12 Feb 2017 12:15:45 +0000 (UTC) Received: by mail-io0-f172.google.com with SMTP id j13so75836707iod.3 for ; Sun, 12 Feb 2017 04:15:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=4ZjDgflu19hlfkVBgsPbQ3f/ezNindRGWI9/mZ/jICw=; b=DaWYubgJ+y8D3jFrqTEHhEMfl8M6TOSyyAAEhZYfblcB4VBvvKa7NB30KqzBbGfycv t6uHzBIZvFuEOOhkLyF8Ke9e88+xAu/XOCq5PCG5fgoufmbclZMMAFv5QZdmnXmn0T8M 7kpjqgz/TXJg9ziTm5sASpoTXQEuvh+N+ag15ZCmSStmLI9Bncuo3s/03zYcXwlMl+6m ECnZht4SGScDEaR3p4RJdqRZDw1GfNn4q3syYuG0lxBacnU/esXKQNb7So/1s1JiDqu4 FlAcyTNaai4UHBiOI0b+3VEwnsQJBRBur5JGzKjts5ogiODeuoN1h2s41XTEKlpGmWRi ReVw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4ZjDgflu19hlfkVBgsPbQ3f/ezNindRGWI9/mZ/jICw=; b=Eex73dQt4aHQqrfytRwxZMFe9UKZnzSqc9SoL9nd7txJQrE4/CyOqkWY/pGpmgAp5R piBRJ2E7BxZKjg7XIC5yHsY7O9BVH3VUTPKEzwZUkSbntogaA8SBh5VU9mSfRee4VqYB a8XzwAG+2X5spmLW4N9/1vfXxLeURmk/5lF9ypLGyCxRoyz5i78eIdyC11L9zZGFMotk TPaahq33ZUx2nbQwXLUUfHFB4lsqptVFsojfuvl7iFGTujXUP/ugbE9MjOUQSzX0urgi DaMclRbnztSjnkMFC6ERgm5hWGmlaFGPDZY7WzGqX/sQ6KQP/k5SZDFx5ad/OCQmEuHT rfiw== X-Gm-Message-State: AMke39krMdYYWmesvbf7+FdEiWXWz2xFmTlhMb30xG2FDzmYHfNgTx237sGxUJiWvc3QZBfyFjqWX5k8h7jp7Q== X-Received: by 10.107.132.81 with SMTP id g78mr17728234iod.227.1486901739016; Sun, 12 Feb 2017 04:15:39 -0800 (PST) MIME-Version: 1.0 Received: by 10.107.137.146 with HTTP; Sun, 12 Feb 2017 04:15:38 -0800 (PST) From: Ascot Moss Date: Sun, 12 Feb 2017 20:15:38 +0800 Message-ID: Subject: How to fix "HDFS Missing replicas" To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a113f3926f85a8105485449dc archived-at: Sun, 12 Feb 2017 12:15:54 -0000 --001a113f3926f85a8105485449dc Content-Type: text/plain; charset=UTF-8 Hi, After running 'hdfs fsck /blocks' to check the cluster, I got 'Missing replicas: 441 (0.24602923 %)" How to fix HDFS missing replicas? Regards (detailed output) Status: HEALTHY Total size: 3375617914739 B (Total open files size: 68183613174 B) Total dirs: 2338 Total files: 39960 Total symlinks: 0 (Files currently being written: 60) Total blocks (validated): 59493 (avg. block size 56739749 B) (Total open file blocks (not validated): 560) Minimally replicated blocks: 59493 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 111 (0.18657658 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 3.0054965 Corrupt blocks: 0 Missing replicas: 441 (0.24602923 %) Number of data-nodes: 7 Number of racks: 1 --001a113f3926f85a8105485449dc Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

After running 'hdfs fsck /block= s' to check the cluster, I got
'Missing replicas:=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 441 (0.24602923 %)"=C2=A0

How to fix HDFS missing=C2=A0replicas?
Regards

=



(detailed output)

Status: HEALTHY

=C2=A0Total size:=C2=A0 =C2= =A0 3375617914739 B (Total open files size: 68183613174 B)

=C2=A0Total dirs:=C2=A0 =C2= =A0 2338

=C2=A0Total files: =C2=A0 39= 960

=C2=A0Total symlinks:=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 (Files currently being w= ritten: 60)

=C2=A0Total blocks (validate= d):=C2=A0 =C2=A0 =C2=A0 59493 (avg. block size 56739749 B) (Total open file= blocks (not validated): 560)

=C2=A0Minimally replicated b= locks: =C2=A0 59493 (100.0 %)

=C2=A0Over-replicated blocks= :=C2=A0 =C2=A0 =C2=A0 =C2=A0 0 (0.0 %)

=C2=A0Under-replicated block= s: =C2=A0 =C2=A0 =C2=A0 111 (0.18657658 %)

=C2=A0Mis-replicated blocks:= =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 (0.0 %)

=C2=A0Default replication fa= ctor:=C2=A0 =C2=A0 3

=C2=A0Average block replicat= ion: =C2=A0 =C2=A0 3.0054965

=C2=A0Corrupt blocks:=C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0

=C2=A0Missing replicas:=C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 441 (0.24602923 %)

=C2=A0Number of data-nodes:= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 7

=C2=A0Number of racks: =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 1


--001a113f3926f85a8105485449dc--