hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Dunning" <ted.dunn...@gmail.com>
Subject Re: Serialization with additional schema info
Date Thu, 04 Sep 2008 19:53:03 GMT
Hadoop 3693 is, btw, how archives got implemented for 18.  As the spec at
the beginning says, compression is not a goal.

On Thu, Sep 4, 2008 at 12:45 PM, Ted Dunning <ted.dunning@gmail.com> wrote:

>
> It is the one that I was remembering.  I had thought it was for Hadoop, but
> it was filed as a PIG issue.
>
> As the last few comments make clear, this is closely related to
> https://issues.apache.org/jira/browse/HADOOP-1824 (archive files).  I had
> thought that archive files were about to come out as part of hadoop, but Dev
> canceled the patch because of various issues.
>
> Clearly, a compressed archive file would do the job just fine.
>
>
> On Thu, Sep 4, 2008 at 12:26 PM, Tom White <tom.e.white@gmail.com> wrote:
>
>> On Thu, Sep 4, 2008 at 7:32 PM, Ted Dunning <ted.dunning@gmail.com>
>> wrote:
>> > What happened to the effort to build a splittable gzip codec by
>> inserting
>> > dummy compression resets with a known pattern?
>>
>> Is this the one you mean:
>> https://issues.apache.org/jira/browse/PIG-42? Looks like it is most of
>> the way there. (Famous last words.)
>>
>> Tom
>>
>
>
>
> --
> ted
>
>
>


-- 
ted

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message