Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hadoop-dev@lucene.apache.org
Message-ID: <10783188.1169803669263.JavaMail.jira@brutus>
Date: Fri, 26 Jan 2007 01:27:49 -0800 (PST)
From: "Runping Qi (JIRA)" <jira@apache.org>
To: hadoop-dev@lucene.apache.org
Subject: [jira] Updated: (HADOOP-732) SequenceFile's header should allow to
 store metadata in the form of key/value pairs
In-Reply-To: <31123399.1163722837105.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Runping Qi updated HADOOP-732:
------------------------------

    Attachment: seqFileMetadata.patch.2


Knock off a few createWriter methods.
seqFileMetadata.patch.2 contains the new patch.


> SequenceFile's header should allow to store metadata in the form of key/value pairs
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-732
>                 URL: https://issues.apache.org/jira/browse/HADOOP-732
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: io
>            Reporter: Runping Qi
>         Assigned To: Runping Qi
>         Attachments: seqFileMetadata.patch, seqFileMetadata.patch.2
>
>
> The sequence file currently stores a fixed list of metadata attributes, such as key/value class names, 
> compression method, etc.  To make sequence file more self descriptable, it should allow to store a list of key/value pairs.  One particular attribute of interest is to indicate whether the key/value classes are actually hadoop record classes, 
> if so, store the DDls for the records. This way, we may create tools to extract DDl from a sequence file and 
> then generate necessary classes. It also make it possible to provide an interpretive version of Hadoop record. 
> This way, even in the situation where Hadoop or the application does not have the necessary classes, 
> a sequence file of Hadoop records can be read and deserialized "interpretively".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.