hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mukul Kumar Singh (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests
Date Sun, 19 Nov 2017 11:53:00 GMT
Mukul Kumar Singh created HDFS-12838:
----------------------------------------

             Summary: Ozone: Optimize number of allocated block rpc by aggregating multiple
block allocation requests
                 Key: HDFS-12838
                 URL: https://issues.apache.org/jira/browse/HDFS-12838
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ozone
    Affects Versions: HDFS-7240
            Reporter: Mukul Kumar Singh
            Assignee: Mukul Kumar Singh
             Fix For: HDFS-7240


Currently KeySpaceManager allocates multiple blocks by sending multiple block allocation requests
over the RPC. This can be optimized to aggregate multiple block allocation request over one
rpc.

{code}
      while (requestedSize > 0) {
        long allocateSize = Math.min(scmBlockSize, requestedSize);
        AllocatedBlock allocatedBlock =
            scmBlockClient.allocateBlock(allocateSize, type, factor);
        KsmKeyLocationInfo subKeyInfo = new KsmKeyLocationInfo.Builder()
            .setContainerName(allocatedBlock.getPipeline().getContainerName())
            .setBlockID(allocatedBlock.getKey())
            .setShouldCreateContainer(allocatedBlock.getCreateContainer())
            .setIndex(idx++)
            .setLength(allocateSize)
            .setOffset(0)
            .build();
        locations.add(subKeyInfo);
        requestedSize -= allocateSize;
      }
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message