hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sameer Paranjpye (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-957) Map/Reduce job with SequenceFileOutputFormat should be able to add user specified metadata to the output file
Date Wed, 27 Jun 2007 17:15:26 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sameer Paranjpye updated HADOOP-957:
------------------------------------

    Component/s: mapred
    Description: 
When creating a map/reduce job with SequenceFileFormat, 
the user would like to add some metada to the output files automatically. 
In particular, if the output value class was a JuteRecord class generated from a Jute IDL,

we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
This way, the output files will be self describing: 
When an application that tries to use the files may not have the value class with it. 
But the application can use Jute tool to generate the classes on demand.
Or better yet, the SequenceFile record reader may be able to do that automatically.




  was:

When creating a map/reduce job with SequenceFileFormat, 
the user would like to add some metada to the output files automatically. 
In particular, if the output value class was a JuteRecord class generated from a Jute IDL,

we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
This way, the output files will be self describing: 
When an application that tries to use the files may not have the value class with it. 
But the application can use Jute tool to generate the classes on demand.
Or better yet, the SequenceFile record reader may be able to do that automatically.





> Map/Reduce job with SequenceFileOutputFormat should be able to add user specified metadata
to the output file
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-957
>                 URL: https://issues.apache.org/jira/browse/HADOOP-957
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: mapred
>            Reporter: Runping Qi
>
> When creating a map/reduce job with SequenceFileFormat, 
> the user would like to add some metada to the output files automatically. 
> In particular, if the output value class was a JuteRecord class generated from a Jute
IDL, 
> we would like to add JUTE_IDL/IDL_STRING as a attribute/value pair of the metadata.
> This way, the output files will be self describing: 
> When an application that tries to use the files may not have the value class with it.

> But the application can use Jute tool to generate the classes on demand.
> Or better yet, the SequenceFile record reader may be able to do that automatically.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message