hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "J.Andreina (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4244) BlockPlacementPolicy related logs should contain the details about the filename and blockid
Date Fri, 09 Oct 2015 03:26:26 GMT
J.Andreina created YARN-4244:
--------------------------------

             Summary: BlockPlacementPolicy related logs should contain the details about the
filename and blockid
                 Key: YARN-4244
                 URL: https://issues.apache.org/jira/browse/YARN-4244
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: J.Andreina
            Assignee: J.Andreina


Currently the user will not get the details about which file/block , the BlockPlacementPolicy
is not able to find a replica node , if there is a huge client write operation is going on.

For example consider below failure message , which does'nt have details about file/block ,
which will be difficult to track later.
{noformat}
      final String message =
          "Failed to place enough replicas, still in need of "
              + (totalReplicasExpected - results.size()) + " to reach " + totalReplicasExpected
              + " (unavailableStorages=" + unavailableStorages + ", storagePolicy="
              + storagePolicy + ", newBlock=" + newBlock + ")";

        String msg = "All required storage types are unavailable: "
            + " unavailableStorages=" + unavailableStorages
            + ", storagePolicy=" + storagePolicy.getName();
{noformat}

It  is better to provide the file/block information in the logs for better debugability .



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message