Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 02532200AC0 for ; Mon, 9 May 2016 20:37:59 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0112D160A10; Mon, 9 May 2016 18:37:59 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 489AB16099C for ; Mon, 9 May 2016 20:37:58 +0200 (CEST) Received: (qmail 33896 invoked by uid 500); 9 May 2016 18:37:57 -0000 Mailing-List: contact commits-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list commits@accumulo.apache.org Received: (qmail 33887 invoked by uid 99); 9 May 2016 18:37:57 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 May 2016 18:37:57 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 5A044DFA6C; Mon, 9 May 2016 18:37:57 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: dlmarion@apache.org To: commits@accumulo.apache.org Date: Mon, 09 May 2016 18:37:57 -0000 Message-Id: <1555c85046f149e49b5dcb35badffecd@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [1/3] accumulo git commit: ACCUMULO-4176: Add blurb to troubleshooting doc for tserver.walog.max.age archived-at: Mon, 09 May 2016 18:37:59 -0000 Repository: accumulo Updated Branches: refs/heads/master 4e2adbb3d -> 7c812c3a2 ACCUMULO-4176: Add blurb to troubleshooting doc for tserver.walog.max.age Project: http://git-wip-us.apache.org/repos/asf/accumulo/repo Commit: http://git-wip-us.apache.org/repos/asf/accumulo/commit/b95a1f95 Tree: http://git-wip-us.apache.org/repos/asf/accumulo/tree/b95a1f95 Diff: http://git-wip-us.apache.org/repos/asf/accumulo/diff/b95a1f95 Branch: refs/heads/master Commit: b95a1f951298d7497afdf9f0c5093ea17f3ad3be Parents: a38c9ad Author: Dave Marion Authored: Mon May 9 13:51:57 2016 -0400 Committer: Dave Marion Committed: Mon May 9 13:51:57 2016 -0400 ---------------------------------------------------------------------- docs/src/main/asciidoc/chapters/troubleshooting.txt | 5 +++++ 1 file changed, 5 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/accumulo/blob/b95a1f95/docs/src/main/asciidoc/chapters/troubleshooting.txt ---------------------------------------------------------------------- diff --git a/docs/src/main/asciidoc/chapters/troubleshooting.txt b/docs/src/main/asciidoc/chapters/troubleshooting.txt index 9546638..667303f 100644 --- a/docs/src/main/asciidoc/chapters/troubleshooting.txt +++ b/docs/src/main/asciidoc/chapters/troubleshooting.txt @@ -821,3 +821,8 @@ maximum file limit, so it began merging memory updates with files to keep the fi slows down ingest performance, so knowing there are many files like this tells you that the system is struggling to keep up with ingest vs the compaction strategy which reduces the number of files. +### HDFS Decommissioning Issues + +*Q*: My Hadoop DataNode is hung for hours trying to decommission. + +*A*: Write Ahead Logs stay open until they hit the size threshold, which could be many hours or days in some cases. These open files will prevent a DN from finishing its decommissioning process (HDFS-3599) in some versions of Hadoop 2. If you stop the DN, then the WALog file will not be closed and you could lose data. To work around this issue, we now close WALogs on a time period specified by the property +tserver.walog.max.age+ with a default period of 24 hours.