hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Adkins (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1900) MapReduce daemons should close FileSystems that are not needed anymore
Date Thu, 09 Sep 2010 22:36:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12907806#action_12907806
] 

Dan Adkins commented on MAPREDUCE-1900:
---------------------------------------

This patch breaks hadoop for me.  Can we reconsider it?

It is not safe to call

      FileSystem.closeAllForUGI(UserGroupInformation.getCurrentUser());

in order to close one filesystem connection.

See MAPREDUCE-2060

It causes the parent JobTracker's FileSystem object to be closed as well, making it impossible
(for me) to successfully submit a job.

> MapReduce daemons should close FileSystems that are not needed anymore
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1900
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1900
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobtracker, tasktracker
>            Reporter: Devaraj Das
>            Assignee: Kan Zhang
>             Fix For: 0.22.0
>
>         Attachments: fs-close-delta.patch, m1900-04.patch, mapred-fs-close.patch
>
>
> Related to HADOOP-6843, this jira is to make MapReduce behave better with respect to
closing FileSystems when they are not needed anymore.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message