hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinayakumar B (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-9783) DataNode deadlocks after running hdfs mover
Date Tue, 09 Feb 2016 16:19:18 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinayakumar B resolved HDFS-9783.
---------------------------------
    Resolution: Duplicate

Resolving as duplicate.
Feel free to re-open if fix in HDFS-9661 doesnt work for you.

> DataNode deadlocks after running hdfs mover
> -------------------------------------------
>
>                 Key: HDFS-9783
>                 URL: https://issues.apache.org/jira/browse/HDFS-9783
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode
>    Affects Versions: 2.6.0
>            Reporter: David Watzke
>         Attachments: datanode.stack.txt
>
>
> We're running CDH 5.4.4 (with Hadoop 2.6.0). Recently we've added 800T of ARCHIVE storage,
marked some data (16T * 2 repl. factor) as "COLD" and ran the hdfs mover to enforce the storage
policy.
> After a few minutes, the mover hangs because one or more datanodes hang as well. Please
check out the deadlock revealed by jstack. Also, here's what appeared in DN log:
> 2016-02-09 15:58:15,676 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Not able
to copy block 1157230686 to /5.45.60.142:40144 because threads quota is exceeded.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message