hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] Issue Comment Edited: (HADOOP-3561) With trash enabled, 'hadoop fs -rmr .' still fully deletes the working dir
Date Sat, 14 Jun 2008 00:15:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605003#action_12605003
] 

chris.douglas edited comment on HADOOP-3561 at 6/13/08 5:14 PM:
----------------------------------------------------------------

After issuing this command and shutting down the namenode, attempting to bring it up causes
the following exception:
{noformat}
2008-06-13 16:14:41,116 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020, call
rename(/user/username, /user/username/.Trash/Current/username) from 127.0.0.1:53108: error:
java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSNamesystem.changeLease(FSNamesystem.java:4343)
        at org.apache.hadoop.dfs.FSNamesystem.renameToInternal(FSNamesystem.java:1425)
        at org.apache.hadoop.dfs.FSNamesystem.renameTo(FSNamesystem.java:1401)
        at org.apache.hadoop.dfs.NameNode.rename(NameNode.java:401)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
{noformat}

      was (Author: chris.douglas):
    This may not be related, but after issuing this command and shutting down the namenode,
attempting to bring it up causes the following exception:
{noformat}
2008-06-13 15:56:01,028 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSNamesystem.changeLease(FSNamesystem.java:4349)
        at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:561)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:843)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:672)
        at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:289)
        at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
        at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
        at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:252)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
        at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:822)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:831)
{noformat}

With HADOOP-3534 applied:
{noformat}
2008-06-13 16:14:41,116 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020, call
rename(/user/username, /user/username/.Trash/Current/username) from 127.0.0.1:53108: error:
java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSNamesystem.changeLease(FSNamesystem.java:4343)
        at org.apache.hadoop.dfs.FSNamesystem.renameToInternal(FSNamesystem.java:1425)
        at org.apache.hadoop.dfs.FSNamesystem.renameTo(FSNamesystem.java:1401)
        at org.apache.hadoop.dfs.NameNode.rename(NameNode.java:401)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
2008-06-13 16:14:41,127 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020, call
rename(/user/username, /user/username/.Trash/Current/username) from 127.0.0.1:53108: error:
java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
        at org.apache.hadoop.dfs.FSNamesystem.changeLease(FSNamesystem.java:4343)
        at org.apache.hadoop.dfs.FSNamesystem.renameToInternal(FSNamesystem.java:1425)
        at org.apache.hadoop.dfs.FSNamesystem.renameTo(FSNamesystem.java:1401)
        at org.apache.hadoop.dfs.NameNode.rename(NameNode.java:401)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
{noformat}
  
> With trash enabled, 'hadoop fs -rmr .' still fully deletes the working dir
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-3561
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3561
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>         Environment: r667675
>            Reporter: Chris Douglas
>            Priority: Blocker
>             Fix For: 0.18.0
>
>
> With trash enabled, it should be more difficult to fully delete the working dir:
> {noformat}
> bash$ bin/hadoop fs -lsr /
> drwxr-xr-x   - username supergroup          0 2008-06-13 15:51 /user
> drwxr-xr-x   - username supergroup          0 2008-06-13 15:52 /user/username
> drwxr-xr-x   - username supergroup          0 2008-06-13 15:52 /user/username/.Trash
> drwx------   - username supergroup          0 2008-06-13 15:52 /user/username/.Trash/Current
> -rw-r--r--   1 username supergroup     232060 2008-06-13 15:52 /user/username/.Trash/Current/file.txt
> pineapple-lm:~/work/18-commit chrisdo$ bin/hadoop fs -rmr .
> rmr: Failed to move to trash: hdfs://localhost/user/username
> bash$ bin/hadoop fs -lsr /
> drwxr-xr-x   - username supergroup          0 2008-06-13 15:52 /user
> bash$
> {noformat}
> In 0.17, the working dir remains.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message