hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron Kimball (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6708) New file format for very large records
Date Mon, 26 Apr 2010 23:15:33 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12861161#action_12861161

Aaron Kimball commented on HADOOP-6708:

Possibly. But then we'd have to wait for the next Avro release as well, and then ensure that
this Avro version works with the available Hadoop releases, which would introduce further
dependency-management complications. The point of doing this large object format work here
is for broader compatibility. Until Avro compatibility in general is improved in Hadoop (e.g.,
resolution of MAPREDUCE-815), it doesn't seem like this directly facilitates this goal.

> New file format for very large records
> --------------------------------------
>                 Key: HADOOP-6708
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6708
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: io
>            Reporter: Aaron Kimball
>            Assignee: Aaron Kimball
>         Attachments: lobfile.pdf
> A file format that handles multi-gigabyte records efficiently, with lazy disk access

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message