hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zsolt Venczel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-12891) Do not invalidate blocks if toInvalidate is empty
Date Tue, 12 Dec 2017 09:42:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280479#comment-16280479
] 

Zsolt Venczel edited comment on HDFS-12891 at 12/12/17 9:41 AM:
----------------------------------------------------------------

* Check not to send empty toInvalidate list for block invalidation. (org.apache.hadoop.hdfs.server.namenode.InvalidateBlocks:296)


was (Author: zvenczel):
* Remove double read operation check where the first one can fail unchecked (org.apache.hadoop.hdfs.server.namenode.FSNamesystem:1862).

* Check not to send empty toInvalidate list for block invalidation. (org.apache.hadoop.hdfs.server.namenode.InvalidateBlocks:296)

> Do not invalidate blocks if toInvalidate is empty
> -------------------------------------------------
>
>                 Key: HDFS-12891
>                 URL: https://issues.apache.org/jira/browse/HDFS-12891
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Zsolt Venczel
>            Assignee: Zsolt Venczel
>              Labels: flaky-test
>             Fix For: 3.1.0, 3.0.1
>
>         Attachments: HDFS-12891.01.patch, HDFS-12891.02.patch
>
>
> {code:java}
> java.lang.AssertionError: Test resulted in an unexpected exit
> 	at org.apache.hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication.testFencingStress(TestDNFencingWithReplication.java:147)
> :
> :
> 2017-10-19 21:39:40,068 [main] INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdown(1965))
- Shutting down the Mini HDFS Cluster
> 2017-10-19 21:39:40,068 [main] FATAL hdfs.MiniDFSCluster (MiniDFSCluster.java:shutdown(1968))
- Test resulted in an unexpected exit
> 1: java.lang.AssertionError
> 	at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:265)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$RedundancyMonitor.run(BlockManager.java:4437)
> 	at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.AssertionError
> 	at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeDescriptor.addBlocksToBeInvalidated(DatanodeDescriptor.java:641)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.InvalidateBlocks.invalidateWork(InvalidateBlocks.java:299)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.invalidateWorkForOneNode(BlockManager.java:4246)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeInvalidateWork(BlockManager.java:1736)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.computeDatanodeWork(BlockManager.java:4561)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager$RedundancyMonitor.run(BlockManager.java:4418)
> 	... 1 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message