hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Kling (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-2110) add getArchiveIndex to HarFileSystem
Date Thu, 28 Oct 2010 00:08:21 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12925610#action_12925610
] 

Patrick Kling commented on MAPREDUCE-2110:
------------------------------------------

Another argument in favour of exposing the index file is that the HarIndex (which indexes
parity files in a HAR archive) is constructed by reading this file, so it already has a notion
of an index file but there is no easy way to obtain it (other than hard coding the filename
pattern used).

One alternative to this change would be to have the HarFileSystem construct a HarIndex object
when needed, but that would introduce a dependency on RAID code.

> add getArchiveIndex to HarFileSystem
> ------------------------------------
>
>                 Key: MAPREDUCE-2110
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2110
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Patrick Kling
>            Priority: Minor
>         Attachments: MAPREDUCE-2110.patch
>
>
> This patch adds a public getter for archiveIndex to HarFileSystem, allowing us to access
the index file corresponding to a har file system (useful for raid).
> Index: src/tools/org/apache/hadoop/fs/HarFileSystem.java
> ===================================================================
> --- src/tools/org/apache/hadoop/fs/HarFileSystem.java   (revision 1004421)
> +++ src/tools/org/apache/hadoop/fs/HarFileSystem.java   (working copy)
> @@ -759,6 +759,13 @@
>    }
>    
>    /**
> +   * returns the archive index
> +   */
> +  public Path getArchiveIndex() {
> +    return archiveIndex;
> +  }
> +
> +  /**
>     * return the top level archive path.
>     */
>    public Path getHomeDirectory() {

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message