hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lantao Jin (JIRA)" <j...@apache.org>
Subject [jira] Lantao Jin shared "HDFS-11060: make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable" with you
Date Wed, 02 Nov 2016 14:01:58 GMT
    Lantao Jin shared an issue with you


> ---------------------------------------------------------
>                 Key: HDFS-11060
>                 URL: https://issues.apache.org/jira/browse/HDFS-11060
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Lantao Jin
>            Priority: Minor
> Current, the easiest way to determine which blocks is missing is using NN web UI or JMX.
Unfortunately, because the DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED=100 is hard code in FSNamesystem,
only 100 missing blocks can be return by UI and JMX. Even the result of URL "https://nn:50070/fsck?listcorruptfileblocks=1&path=%2F"
is limited by this hard code value too.
> I did know FSCK can return more than 100 result but due to the security reason(with kerberos),
it is very hard to involve to costumer programs and scripts.
> So I think it should add a configurable var "maxCorruptFileBlocksReturned" to fix above
> If community also think it's worth to do, I will patch this. If not, please feel free
to tell me the reason. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: user-unsubscribe@hadoop.apache.org
For additional commands, e-mail: user-help@hadoop.apache.org

View raw message