hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mukul Kumar Singh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-12838) Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation requests
Date Tue, 21 Nov 2017 11:11:00 GMT

     [ https://issues.apache.org/jira/browse/HDFS-12838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mukul Kumar Singh updated HDFS-12838:
-------------------------------------
    Attachment: HDFS-12838-HDFS-7240.002.patch

> Ozone: Optimize number of allocated block rpc by aggregating multiple block allocation
requests
> -----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-12838
>                 URL: https://issues.apache.org/jira/browse/HDFS-12838
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Mukul Kumar Singh
>            Assignee: Mukul Kumar Singh
>             Fix For: HDFS-7240
>
>         Attachments: HDFS-12838-HDFS-7240.001.patch, HDFS-12838-HDFS-7240.002.patch
>
>
> Currently KeySpaceManager allocates multiple blocks by sending multiple block allocation
requests over the RPC. This can be optimized to aggregate multiple block allocation request
over one rpc.
> {code}
>       while (requestedSize > 0) {
>         long allocateSize = Math.min(scmBlockSize, requestedSize);
>         AllocatedBlock allocatedBlock =
>             scmBlockClient.allocateBlock(allocateSize, type, factor);
>         KsmKeyLocationInfo subKeyInfo = new KsmKeyLocationInfo.Builder()
>             .setContainerName(allocatedBlock.getPipeline().getContainerName())
>             .setBlockID(allocatedBlock.getKey())
>             .setShouldCreateContainer(allocatedBlock.getCreateContainer())
>             .setIndex(idx++)
>             .setLength(allocateSize)
>             .setOffset(0)
>             .build();
>         locations.add(subKeyInfo);
>         requestedSize -= allocateSize;
>       }
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message