hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-10480) Add an admin command to list currently open files
Date Thu, 02 Jun 2016 16:11:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312546#comment-15312546
] 

Kihwal Lee edited comment on HDFS-10480 at 6/2/16 4:11 PM:
-----------------------------------------------------------

While debugging issues, I had to dump a huge fsimage to get the list of open files. I was
looking for files being open for a long time, so it was okay but took a long time to get them.
 The list may surprise you if there are runaway clients keeping renewing leases. I've seen
something open for many months, surviving multiple rolling upgrades. They also pose risk of
data loss since even the finalized blocks don't get re-replicated if the file is under construction.
 If conformed to be a "forgotten" file that is left open, the admin can use {{hdfs debug recoverLease}}
command to revoke the lease and close the file.


was (Author: kihwal):
While debugging issues, I had to dump a huge fsimage to get the list of open files. I was
looking for files being open for a long time, so it was okay but took a long time to get them.
 The list may surprise you if there are runaway clients keeping renewing leases. I've seen
something open for many months, surviving multiple rolling upgrades. They also pose risk of
data loss since even the finalized blocks don't get re-replicated if the file is under construction.

> Add an admin command to list currently open files
> -------------------------------------------------
>
>                 Key: HDFS-10480
>                 URL: https://issues.apache.org/jira/browse/HDFS-10480
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Kihwal Lee
>
> Currently there is a no easy way to obtain the list of active leases or files being written.
It will be nice if we have an admin command to list open files and their lease holders.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message