hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Yang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1322) Cached FileSystem can lead to persistant IOExceptions
Date Tue, 11 May 2010 23:43:41 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Paul Yang updated HIVE-1322:
----------------------------

    Attachment: HIVE-1322.2.patch

> Cached FileSystem can lead to persistant IOExceptions
> -----------------------------------------------------
>
>                 Key: HIVE-1322
>                 URL: https://issues.apache.org/jira/browse/HIVE-1322
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Paul Yang
>            Assignee: Paul Yang
>            Priority: Minor
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1322.1.patch, HIVE-1322.2.patch
>
>
> In the metastore, the FileSystem object is created through Path.getFileSytem(), which
caches the created instance for performance. For DFS, the cached FileSystem seems to retain
the original IP (resolved from the supplied hostname). If the hostname->IP mapping changes,
then FS operations will throw IOExceptions. Because the FileSystem is cached, re-creating
the object has no effect and will continue to result in IOExceptions.
> One solution is to call close on an IOException. That will remove the entry in the cache.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message