hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiandan Yang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException
Date Mon, 18 Sep 2017 03:44:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169546#comment-16169546
] 

Jiandan Yang  edited comment on HDFS-12446 at 9/18/17 3:43 AM:
---------------------------------------------------------------

NN log exception info as description. this because LeaseManager$Monitor#run is in a dead loop,
every run will throw IllegalStateException.
[HDFS-11817|https://issues.apache.org/jira/browse/HDFS-11817] has the same exception, but
did not fix completely.

{code:java}
          boolean completed = false;
          try {
            completed = fsnamesystem.internalReleaseLease(
                leaseToCheck, p, iip, newHolder);
          } catch (IOException e) {                     // NOTE:  did not catch IllegalStateException
            LOG.warn("Cannot release the path " + p + " in the lease "
                + leaseToCheck + ". It will be retried.", e);
            continue;
          }
{code}



was (Author: yangjiandan):
NN log exception info as description. this because LeaseManager$Monitor#run is in a dead loop,
every run will throw IllegalStateException.
[HDFS-11817|https://issues.apache.org/jira/browse/HDFS-11817] has the same exception, but
did not fix completely.

{code:java}
          boolean completed = false;
          try {
            completed = fsnamesystem.internalReleaseLease(
                leaseToCheck, p, iip, newHolder);
          } catch (IOException e) {                                                  // NOTE:
 did not catch IllegalStateException
            LOG.warn("Cannot release the path " + p + " in the lease "
                + leaseToCheck + ". It will be retried.", e);
            continue;
          }
{code}


> FSNamesystem#internalReleaseLease throw IllegalStateException
> -------------------------------------------------------------
>
>                 Key: HDFS-12446
>                 URL: https://issues.apache.org/jira/browse/HDFS-12446
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 2.8.1
>            Reporter: Jiandan Yang 
>
> NameNode always print following logs.
> {code:java}
> 2017-09-14 10:21:32,042 INFO org.apache.hadoop.hdfs.server.namenode.LeaseManager: [Lease.
 Holder: DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7] has expired hard limit
> 2017-09-14 10:21:32,042 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Recovering
[Lease.  Holder: DFSClient_NONMAPREDUCE_-275421369_84, pending creates: 7], src=/xxx
> 2017-09-14 10:21:32,042 WARN org.apache.hadoop.hdfs.server.namenode.LeaseManager: Unexpected
throwable:
> java.lang.IllegalStateException: Unexpected block state: blk_1265519060_203004758 is
COMMITTED but not COMPLETE, file=xxx (INodeFile), blocks=[blk_1265519060_203004758] (i=0)
>         at com.google.common.base.Preconditions.checkState(Preconditions.java:172)
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.assertAllBlocksComplete(INodeFile.java:218)
>         at org.apache.hadoop.hdfs.server.namenode.INodeFile.toCompleteFile(INodeFile.java:207)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.finalizeINodeFileUnderConstruction(FSNamesystem.java:3312)
>         at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.internalReleaseLease(FSNamesystem.java:3184)
>         at org.apache.hadoop.hdfs.server.namenode.LeaseManager.checkLeases(LeaseManager.java:383)
>         at org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor.run(LeaseManager.java:329)
>         at java.lang.Thread.run(Thread.java:834)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message