hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicholas Carlini (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6837) Support for LZMA compression
Date Mon, 09 Aug 2010 22:21:20 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Nicholas Carlini updated HADOOP-6837:

    Attachment: HADOOP-6837-lzma-3-20100809.patch

I'm going to respond to each one this time to make sure I don't miss anything again...

FakeOutputStream isn't the one I'm talking about in package.html. That's for the OutputStream/FakeInputStream.
FakeOutputStream is just the one where I couldn't justify the maximum acting correctly (wrtiting
a max of 273 bytes extra) so I added the linked list in case anything goes wrong.

Changed directory structure as suggested -- src/contrib/lzma912/src/SevenZip/* has the java
files and src/contrib/lzma912/src/native has the native code.

The default dictionary size doesn't matter, because it gets set to something else on initialization.
I left it there to keep the minimum set of changes.

I needed library.properties there for it to build correctly: I have no idea what it does,
but if I delete it then it doesn't build. And when it's empty it doesn't complain, so that's
why it's there.

Sorry about the ec2 file; I didn't realize that went into the patch! It's not supposed to
be there.

Deleted CRC.java ... apparently it was never used.

Removed the read() while loop and wrote as suggested.

Fixed names (buffered/sendData) again, I had fixed them but then reverted to an older version
when I introduced a bug.

Removed 1<<x's to y*1024.

Makefile.am, fixed grammar.

Yeah, sorry. I didn't realize that happened with the off-indentation. Fixed it.

I'll talk to you about ant test-patch. I'm running ant test right now and if anything goes
wrong I'll push another patch. ant javadoc has no warnings.

> Support for LZMA compression
> ----------------------------
>                 Key: HADOOP-6837
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6837
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>            Reporter: Nicholas Carlini
>            Assignee: Nicholas Carlini
>         Attachments: HADOOP-6837-lzma-1-20100722.non-trivial.pseudo-patch, HADOOP-6837-lzma-1-20100722.patch,
HADOOP-6837-lzma-2-20100806.patch, HADOOP-6837-lzma-3-20100809.patch, HADOOP-6837-lzma-c-20100719.patch,
> Add support for LZMA (http://www.7-zip.org/sdk.html) compression, which generally achieves
higher compression ratios than both gzip and bzip2.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message