hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-17144) Update Hadoop's lz4 to v1.9.2
Date Wed, 02 Sep 2020 00:01:21 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188872#comment-17188872
] 

Masatake Iwasaki commented on HADOOP-17144:
-------------------------------------------

{quote}
directBufferSize will be the size of raw data , so the compressedDirectBuf and UncompressedDirectBuf
will have of same size
{quote}

The compressedDirectBuf and uncompressedDirectBuf are working buffer whose size can be set
regardless of input data size. The buffer size is set to EFAULT_DIRECT_BUFFER_SIZE (= 64 *
1024) if the default constructor (Lz4Decompressor()) is used. Practically the userBufLen is
greater than directBufferSize. Adding a test case similar to TestLz4CompressorDecompressor#testSetInputWithBytesSizeMoreThenDefaultLz4CompressorByfferSize
for decompressor would make the point clear.


> Update Hadoop's lz4 to v1.9.2
> -----------------------------
>
>                 Key: HADOOP-17144
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17144
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Hemanth Boyina
>            Assignee: Hemanth Boyina
>            Priority: Major
>         Attachments: HADOOP-17144.001.patch, HADOOP-17144.002.patch, HADOOP-17144.003.patch,
HADOOP-17144.004.patch
>
>
> Update hadoop's native lz4 to v1.9.2 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message