hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12885) An operation of atomic fold rename crashed in Wasb FileSystem
Date Mon, 07 Mar 2016 04:39:40 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182574#comment-15182574
] 

Chris Nauroth commented on HADOOP-12885:
----------------------------------------

bq. ...storage account details of the cluster...

Please do not share any passwords, ssh keys, or any other forms of private credentials over
Apache JIRA.  This is a public forum, and you wouldn't want to let the whole Internet into
your cluster.  :-)  I apologize if I misinterpreted this comment, but I wanted to make sure
no one was compromised by mistake.

Sharing additional logs though would be fine to help troubleshoot root cause.

> An operation of atomic fold rename crashed in Wasb FileSystem
> -------------------------------------------------------------
>
>                 Key: HADOOP-12885
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12885
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Liu Shaohui
>            Assignee: madhumita chakraborty
>            Priority: Critical
>
> An operation of atomic fold rename crashed in Wasb FileSystem
> {code}
> org.apache.hadoop.fs.azure.AzureException: Source blob hbase/azurtst-xiaomi/data/default/YCSBTest/5f882f5492c90b4c03a26561a2ee0a96/.regioninfo
does not exist.
>         at org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.rename(AzureNativeFileSystemStore.java:2405)
>         at org.apache.hadoop.fs.azure.NativeAzureFileSystem$FolderRenamePending.execute(NativeAzureFileSystem.java:413)
>         at org.apache.hadoop.fs.azure.NativeAzureFileSystem.rename(NativeAzureFileSystem.java:1997)
> {code}
> The problem is that there are duplicated file is the RenamePending.json. 
> {code}
>     "5f882f5492c90b4c03a26561a2ee0a96",                                             
       
> "5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",                                    
                                                                                         
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/.regioninfo",                                
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/.tmp",                                       
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C",                                          
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/8a2c08db432d447d9e0ed5266940b25e",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/9425c621073e41df9430e88f0ef61c01",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/C\/f9fc55a94fa34efbb2d26be77c76187c",        
                
>     "5f882f5492c90b4c03a26561a2ee0a96\/recovered.edits", 
> {code}
> Maybe there is a bug in the Listing of all the files in the folder in Wasb. Any suggestions?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message