Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 19115 invoked from network); 17 Nov 2006 00:20:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 17 Nov 2006 00:20:58 -0000 Received: (qmail 14597 invoked by uid 500); 17 Nov 2006 00:21:09 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 14395 invoked by uid 500); 17 Nov 2006 00:21:08 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 14383 invoked by uid 99); 17 Nov 2006 00:21:08 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Nov 2006 16:21:08 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Nov 2006 16:20:57 -0800 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 1A850714324 for ; Thu, 16 Nov 2006 16:20:37 -0800 (PST) Message-ID: <31123399.1163722837105.JavaMail.jira@brutus> Date: Thu, 16 Nov 2006 16:20:37 -0800 (PST) From: "Runping Qi (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-732) SequenceFile's header should allow to store metadata in the form of key/value pairs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org SequenceFile's header should allow to store metadata in the form of key/value pairs ------------------------------------------------------------------------------------ Key: HADOOP-732 URL: http://issues.apache.org/jira/browse/HADOOP-732 Project: Hadoop Issue Type: New Feature Reporter: Runping Qi The sequence file currently stores a fixed list of metadata attributes, such as key/value class names, compression method, etc. To make sequence file more self descriptable, it should allow to store a list of key/value pairs. One particular attribute of interest is to indicate whether the key/value classes are actually hadoop record classes, if so, store the DDls for the records. This way, we may create tools to extract DDl from a sequence file and then generate necessary classes. It also make it possible to provide an interpretive version of Hadoop record. This way, even in the situation where Hadoop or the application does not have the necessary classes, a sequence file of Hadoop records can be read and deserialized "interpretively". -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira