hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3307) Archives in Hadoop.
Date Fri, 25 Apr 2008 18:43:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12592463#action_12592463

Doug Cutting commented on HADOOP-3307:

> How about assuming file names ending with .har to be considered as special file format.

I'd prefer not doing a naming hack like that directly in HDFS or in FileSystem.  But I don't
mind doing it in a layered filesystem, perhaps something like:


So the "har" FileSystem could pull the nested scheme off the front of the host, and scan the
path for a ".har", parse the index there (caching it, presumably), and finally access the
file.  In the above case, the har path would be hdfs://host:port/dir/my.har.  No changes to
FileSystem or HDFS are required.  That's not too ugly, is it?

> Archives in Hadoop.
> -------------------
>                 Key: HADOOP-3307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3307
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Mahadev konar
>            Assignee: Mahadev konar
>             Fix For: 0.18.0
> This is a new feature for archiving and unarchiving files in HDFS. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message