Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 5 Oct 2016 22:41:20 +0000 (UTC)
From: "Zhe Zhang (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13010025.1475707279000.747658.1475707280523@Atlassian.JIRA>
In-Reply-To: <JIRA.13010025.1475707279000@Atlassian.JIRA>
References: <JIRA.13010025.1475707279000@Atlassian.JIRA> <JIRA.13010025.1475707279266@arcas>
Subject: [jira] [Created] (HDFS-10966) Enhance Dispatcher logic on deciding
 when to give up a source DataNode
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 05 Oct 2016 22:41:22 -0000

Zhe Zhang created HDFS-10966:
--------------------------------

             Summary: Enhance Dispatcher logic on deciding when to give up a source DataNode
                 Key: HDFS-10966
                 URL: https://issues.apache.org/jira/browse/HDFS-10966
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: balancer & mover
            Reporter: Zhe Zhang
            Assignee: Mark Wagner


When a {{Dispatcher}} thread works on a source DataNode, in each iteration it tries to execute a {{PendingMove}}. If no block is moved after 5 iterations, this source (over-utlized) DataNode is given up for this Balancer iteration (20 mins). This is problematic if the source DataNode was heavily loaded in the beginning of the iteration. It will quickly encounter 5 unsuccessful moves and be abandoned.

We should enhance this logic by e.g. using elapsed time instead of number of iterations.
{code}
// Check if the previous move was successful
        } else {
          // source node cannot find a pending block to move, iteration +1
          noPendingMoveIteration++;
          // in case no blocks can be moved for source node's task,
          // jump out of while-loop after 5 iterations.
          if (noPendingMoveIteration >= MAX_NO_PENDING_MOVE_ITERATIONS) {
            LOG.info("Failed to find a pending move "  + noPendingMoveIteration
                + " times.  Skipping " + this);
            resetScheduledSize();
          }
        }
{code}


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org