hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3315) New binary file format
Date Thu, 20 Nov 2008 19:52:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649456#action_12649456
] 

Hong Tang commented on HADOOP-3315:
-----------------------------------

@Stack,

Some work has been done based on comments we receive after our initial patch release, major
feature additions include:
- More efficient random access implementation. [Reader interface change]
- Customized comparator (support java class comparators).
- Added an ObjectFile layer on top of TFile, with corresponding InputFormat and outputFormat.

I think it may be a good idea for us to upload another patch and collect feedback. However,
I have very limited time working on TFile now so I may not be able to answer questions and
address issues promptly.


> New binary file format
> ----------------------
>
>                 Key: HADOOP-3315
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3315
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: io
>            Reporter: Owen O'Malley
>            Assignee: Amir Youssefi
>         Attachments: HADOOP-3315_20080908_TFILE_PREVIEW_WITH_LZO_TESTS.patch, HADOOP-3315_20080915_TFILE.patch,
TFile Specification Final.pdf
>
>
> SequenceFile's block compression format is too complex and requires 4 codecs to compress
or decompress. It would be good to have a file format that only needs 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message