hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2
Date Wed, 02 Sep 2020 00:01:21 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188872#comment-17188872

Masatake Iwasaki commented on HADOOP-17144:

directBufferSize will be the size of raw data , so the compressedDirectBuf and UncompressedDirectBuf
will have of same size

The compressedDirectBuf and uncompressedDirectBuf are working buffer whose size can be set
regardless of input data size. The buffer size is set to EFAULT_DIRECT_BUFFER_SIZE (= 64 *
1024) if the default constructor (Lz4Decompressor()) is used. Practically the userBufLen is
greater than directBufferSize. Adding a test case similar to TestLz4CompressorDecompressor#testSetInputWithBytesSizeMoreThenDefaultLz4CompressorByfferSize
for decompressor would make the point clear.

> Update Hadoop's lz4 to v1.9.2
> -----------------------------
>                 Key: HADOOP-17144
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17144
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Hemanth Boyina
>            Assignee: Hemanth Boyina
>            Priority: Major
>         Attachments: HADOOP-17144.001.patch, HADOOP-17144.002.patch, HADOOP-17144.003.patch,
> Update hadoop's native lz4 to v1.9.2 

This message was sent by Atlassian Jira

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message