hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks
Date Mon, 21 Aug 2017 21:32:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135871#comment-16135871

Anu Engineer commented on HDFS-11888:

[~nandakumar131] , [~yuanbo] This patch fixes some of the workarounds we had put in place
inside the client/ corona because we were not correctly handling the container state in SCM.
It might be a good idea to make sure that we remove all workarounds once we check this patch

> Ozone: SCM: use container state machine for open containers allocated for key/blcoks

> -------------------------------------------------------------------------------------
>                 Key: HDFS-11888
>                 URL: https://issues.apache.org/jira/browse/HDFS-11888
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-11888-HDFS-7240.001.patch
> SCM BlockManager provision a pool of containers upon block creation request that can't
be satisfied with current open containers in the pool. However, only one container is returned
with the creationFlag to the client. The other container provisioned in the same batch will
not have this flag. Client can't assume to use these containers that has not been created
on SCM datanodes, 
> This ticket is opened to fix the issue by persist the createContainerNeeded flag for
the provisioned containers. The flag will be eventually cleared by processing container report
from datanode when the container report handler is fully implemented on SCM. 
> For now, we will use a default batch size of 1 for ozone.scm.container.provision_batch_size
so that the container will be created on demand upon the first block allocation into the container.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message