hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3307) Archives in Hadoop.
Date Fri, 25 Apr 2008 18:43:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12592463#action_12592463
] 

Doug Cutting commented on HADOOP-3307:
--------------------------------------

> How about assuming file names ending with .har to be considered as special file format.

I'd prefer not doing a naming hack like that directly in HDFS or in FileSystem.  But I don't
mind doing it in a layered filesystem, perhaps something like:

har://hdfs-host:port/dir/my.har/file/in/har

So the "har" FileSystem could pull the nested scheme off the front of the host, and scan the
path for a ".har", parse the index there (caching it, presumably), and finally access the
file.  In the above case, the har path would be hdfs://host:port/dir/my.har.  No changes to
FileSystem or HDFS are required.  That's not too ugly, is it?

> Archives in Hadoop.
> -------------------
>
>                 Key: HADOOP-3307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3307
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Mahadev konar
>            Assignee: Mahadev konar
>             Fix For: 0.18.0
>
>
> This is a new feature for archiving and unarchiving files in HDFS. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message