Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 43EAA7335 for ; Mon, 21 Nov 2011 09:53:17 +0000 (UTC) Received: (qmail 61330 invoked by uid 500); 21 Nov 2011 09:53:17 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 61297 invoked by uid 500); 21 Nov 2011 09:53:17 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 61289 invoked by uid 99); 21 Nov 2011 09:53:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Nov 2011 09:53:17 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Nov 2011 09:53:13 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id C90A2937E0 for ; Mon, 21 Nov 2011 09:52:52 +0000 (UTC) Date: Mon, 21 Nov 2011 09:52:52 +0000 (UTC) From: "Harsh J (Commented) (JIRA)" To: common-issues@hadoop.apache.org Message-ID: <448940076.50728.1321869172824.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1151219834.50659.1321864491736.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HADOOP-7842) a compress tool for test compress/decompress locally use hadoop compress codecs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154091#comment-13154091 ] Harsh J commented on HADOOP-7842: --------------------------------- Hello Kang, Could you explain the rationale behind this? Files are already decompressed by {{-cat}}, etc. shell utils, native programs like lzo's. If its for testing native lib loads, or compression codec loading, we already have TestCodec for that, which I've once explained how to use at: http://search-hadoop.com/m/RqwE52Sh1GI Given these two facts, I believe the only usefulness of adding this is to compress a file given a codec? Perhaps TestCodec may be extended to provide such a utility as well? > a compress tool for test compress/decompress locally use hadoop compress codecs > ------------------------------------------------------------------------------- > > Key: HADOOP-7842 > URL: https://issues.apache.org/jira/browse/HADOOP-7842 > Project: Hadoop Common > Issue Type: Improvement > Components: io > Reporter: Kang Xiao > Assignee: Kang Xiao > Labels: compression > Attachments: HADOOP-7842.patch > > > add a compress tool for test compress/decompress locally use hadoop compress codecs. > It can be used as follows: > compress a.txt to a.lzo: > hadoop jar test.jar org.apache.hadoop.io.compress.CodecTool org.apache.hadoop.io.compress.LzoCodec -c 1024 1024 a.txt a.lzo > decompress a.lzo to stdout: > hadoop jar test.jar org.apache.hadoop.io.compress.CodecTool org.apache.hadoop.io.compress.LzoCodec -x 1024 1024 a.lzo /dev/stdout -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira