hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "amith (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3584) Blocks are getting marked as corrupt with append operation under high load.
Date Mon, 02 Jul 2012 11:53:22 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405025#comment-13405025
] 

amith commented on HDFS-3584:
-----------------------------

Here I can see client1 are not able to get the lease renewed with in soft limit period and
client2 try to trigger lease recovery
I can see this from the exception @ client

Client log
{noformat}
2012-06-28 19:40:56,452 INFO  hdfs.TestHDFSAPI (TestHDFSAPI.java:writeFile(168)) - Writing
File with client DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1, ugi=B00902108
(auth:SIMPLE)]] File = /home/test/writefile_36673810701636
2012-06-28 19:41:04,619 INFO  hdfs.TestHDFSAPI (TestHDFSAPI.java:writeFile(179)) - Creating
File with client DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1, ugi=B00902108
(auth:SIMPLE)]] File = /home/test/writefile_36673810701636
2012-06-28 19:42:28,004 INFO  hdfs.TestHDFSAPI (TestHDFSAPI.java:writeFile(186)) - Closing
File with client DFS[DFSClient[clientName=DFSClient_clientIDD36655341694508_139393306_1, ugi=B00902108
(auth:SIMPLE)]] File = /home/test/writefile_36673810701636 file size= 524288
2012-06-28 19:42:32,680 INFO  hdfs.TestHDFSAPI (TestHDFSAPI.java:appendFile(76)) - Going Append
File with client DFS[DFSClient[clientName=DFSClient_clientIDD36661058974201_139393306_1, ugi=B00902108
(auth:SIMPLE)]]File = /home/test/writefile_36673810701636file size= 524288
org.apache.hadoop.hdfs.protocol.RecoveryInProgressException: Failed to close file /home/test/writefile_36673810701636.
Lease recovery is in progress. Try again later.
{noformat}
                
> Blocks are getting marked as corrupt with append operation under high load.
> ---------------------------------------------------------------------------
>
>                 Key: HDFS-3584
>                 URL: https://issues.apache.org/jira/browse/HDFS-3584
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: name-node
>    Affects Versions: 2.0.1-alpha
>            Reporter: Brahma Reddy Battula
>
> Scenario:
> ========= 
> 1. There are 2 clients cli1 and cli2 cli1 write a file F1 and not closed
> 2. The cli2 will call append on unclosed file and triggers a leaserecovery
> 3. Cli1 is closed
> 4. Lease recovery is completed and with updated GS in DN and got BlockReport since there
is a mismatch in GS the block got corrupted
> 5. Now we got a CommitBlockSync this will also fail since the File is already closed
by cli1 and state in NN is Finalized

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message