hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HDDS-1561) Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove
Date Thu, 05 Sep 2019 10:28:00 GMT

     [ https://issues.apache.org/jira/browse/HDDS-1561?focusedWorklogId=307049&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-307049

ASF GitHub Bot logged work on HDDS-1561:

                Author: ASF GitHub Bot
            Created on: 05/Sep/19 10:27
            Start Date: 05/Sep/19 10:27
    Worklog Time Spent: 10m 
      Work Description: lokeshj1703 commented on issue #1401: HDDS-1561: Mark OPEN containers
as QUASI_CLOSED as part of Ratis groupRemove
URL: https://github.com/apache/hadoop/pull/1401#issuecomment-528301702
   @nandakumar131 Thanks for reviewing the PR! 2nd commit addresses checkstyle issues and
review comments.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 307049)
    Time Spent: 40m  (was: 0.5h)

> Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove
> -----------------------------------------------------------------
>                 Key: HDDS-1561
>                 URL: https://issues.apache.org/jira/browse/HDDS-1561
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: Ozone Datanode, SCM
>    Affects Versions: 0.3.0
>            Reporter: Mukul Kumar Singh
>            Assignee: Lokesh Jain
>            Priority: Blocker
>              Labels: pull-request-available
>         Attachments: HDDS-1561.001.patch
>          Time Spent: 40m
>  Remaining Estimate: 0h
> Right now, if a pipeline is destroyed by SCM, all the container on the pipeline are marked
as quasi closed when datanode received close container command. SCM while processing these
containers reports, marks these containers as closed once majority of the nodes are available.
> This is however not a sufficient condition in cases where the raft log directory is missing
or corrupted. As the containers will not have all the applied transaction. 
> To solve this problem, we should QUASI_CLOSE the containers in datanode as part of ratis
groupRemove. If a container is in OPEN state in datanode without any active pipeline, it will
be marked as Unhealthy while processing close container command.
> cc [~jnp], [~shashikant], [~sdeka], [~nandakumar131]

This message was sent by Atlassian Jira

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message