hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lokesh Jain (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDDS-1306) TestContainerStateManagerIntegration fails in Ratis shutdown
Date Tue, 19 Mar 2019 15:09:00 GMT

    [ https://issues.apache.org/jira/browse/HDDS-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796176#comment-16796176

Lokesh Jain commented on HDDS-1306:

The issue is occurring because the raft server creation thread is blocked in ratis. During
pipeline creation, ratis creates a new RaftServerImpl for the pipeline in the datanode. This
creation is done in common thread pool. All the threads in the common thread pool are blocked
by ReplicationActivityStatus#fireReplicationStart call. This function calls Thread.sleep
which is blocking the thread in common thread pool. I think we should use scheduled thread
pool or a better executor for this purpose.

Regarding the exception seen in the test: When the RaftServerImpl creation is unblocked the
raft server has already moved to CLOSING state. So when it tries to move it to RUNNING state
it throws the illegal state exception.

> TestContainerStateManagerIntegration fails in Ratis shutdown
> ------------------------------------------------------------
>                 Key: HDDS-1306
>                 URL: https://issues.apache.org/jira/browse/HDDS-1306
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>          Components: Ozone Datanode, test
>            Reporter: Arpit Agarwal
>            Assignee: Lokesh Jain
>            Priority: Blocker
> TestContainerStateManagerIntegration occasionally fails in Ratis shutdown. Other test
cases like TestScmChillMode may be failing due to the same error.
> Full stack trace in a comment below since it's a lot of text.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message