hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7842) a compress tool for test compress/decompress locally use hadoop compress codecs
Date Mon, 21 Nov 2011 09:52:52 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154091#comment-13154091
] 

Harsh J commented on HADOOP-7842:
---------------------------------

Hello Kang,

Could you explain the rationale behind this? Files are already decompressed by {{-cat}}, etc.
shell utils, native programs like lzo's.

If its for testing native lib loads, or compression codec loading, we already have TestCodec
for that, which I've once explained how to use at: http://search-hadoop.com/m/RqwE52Sh1GI

Given these two facts, I believe the only usefulness of adding this is to compress a file
given a codec? Perhaps TestCodec may be extended to provide such a utility as well?
                
> a compress tool for test compress/decompress locally use hadoop compress codecs
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-7842
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7842
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io
>            Reporter: Kang Xiao
>            Assignee: Kang Xiao
>              Labels: compression
>         Attachments: HADOOP-7842.patch
>
>
> add a compress tool for test compress/decompress locally use hadoop compress codecs.
> It can be used as follows:
> compress a.txt to a.lzo:
> hadoop jar test.jar org.apache.hadoop.io.compress.CodecTool org.apache.hadoop.io.compress.LzoCodec
-c 1024 1024 a.txt a.lzo
> decompress a.lzo to stdout:
> hadoop jar test.jar org.apache.hadoop.io.compress.CodecTool org.apache.hadoop.io.compress.LzoCodec
-x 1024 1024 a.lzo /dev/stdout

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message