hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuan Gong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-71) Ensure/confirm that the NodeManager cleans up local-dirs on restart
Date Thu, 14 Mar 2013 23:56:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13602904#comment-13602904
] 

Xuan Gong commented on YARN-71:
-------------------------------

Uploaded new patch:
1. move out the timestamps, so all local dirs will use the same timestamps.
2. Rewrite the rename and deletion block, create two new functions, renameLocalDir() to rename
the dirs, deleteLocalDir() to delete dirs
3. change to unit test to cover:
   a: verify the correct user who is used by deletionService
   b. verify fileCache and NM_PRIVATE_DIR deletion
4. Use Records instead of RecordFatory
                
> Ensure/confirm that the NodeManager cleans up local-dirs on restart
> -------------------------------------------------------------------
>
>                 Key: YARN-71
>                 URL: https://issues.apache.org/jira/browse/YARN-71
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Xuan Gong
>            Priority: Critical
>         Attachments: YARN-71.1.patch, YARN-71.2.patch, YARN-71.3.patch, YARN.71.4.patch,
YARN-71.5.patch, YARN-71.6.patch, YARN-71.7.patch, YARN-71.8.patch
>
>
> We have to make sure that NodeManagers cleanup their local files on restart.
> It may already be working like that in which case we should have tests validating this.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message