Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0751A9C1E for ; Mon, 31 Oct 2011 17:49:43 +0000 (UTC) Received: (qmail 50134 invoked by uid 500); 31 Oct 2011 17:49:40 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 50096 invoked by uid 500); 31 Oct 2011 17:49:40 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 50088 invoked by uid 99); 31 Oct 2011 17:49:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Oct 2011 17:49:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of static.void.dev@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qy0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 31 Oct 2011 17:49:32 +0000 Received: by qyk29 with SMTP id 29so4701246qyk.14 for ; Mon, 31 Oct 2011 10:49:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=H1n+MPRd5fA9QxynXe0Jk8iO7ZiCs1foaz2+5Z+o2xw=; b=ndbbfYnZGpE1XaCt7WQwIa3j+uGErYWaUOH28Ywxy57WR2B1+E3Upmh8MRXxptRAFV JVN3+rEwP+TK/zmUtQqgucW0LgljktNTv0zYOcJGv1wgU1PhnZw9EYfOteojK6thnw2k pmIvFpYf0Yhcyo+cgwxSxxKpsDLT6DTDgsSdM= Received: by 10.68.15.225 with SMTP id a1mr24582723pbd.66.1320083350980; Mon, 31 Oct 2011 10:49:10 -0700 (PDT) Received: from Robs-MacBook-Pro.local (c-76-103-169-217.hsd1.ca.comcast.net. [76.103.169.217]) by mx.google.com with ESMTPS id d9sm52076577pbb.13.2011.10.31.10.49.08 (version=SSLv3 cipher=OTHER); Mon, 31 Oct 2011 10:49:10 -0700 (PDT) Message-ID: <4EAEDF91.5050502@gmail.com> Date: Mon, 31 Oct 2011 10:49:05 -0700 From: Mark User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: common-user@hadoop.apache.org Subject: Default Compression Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit I recently added the following to my core-site.xml io.compression.codecs org.apache.hadoop.io.compress.DefaultCodec, org.apache.hadoop.io.compress.GzipCodec, org.apache.hadoop.io.compress.BZip2Codec However when I try and test a simple MR job I am seeing the following errors in my log. java.lang.IllegalArgumentException: Compression codec org.apache.hadoop.io.compress.DefaultCodec not found. at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:116) at org.apache.hadoop.io.compress.CompressionCodecFactory.(CompressionCodecFactory.java:156) at org.apache.hadoop.mapreduce.lib.input.TextInputFormat.isSplitable(TextInputFormat.java:51) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:254) at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944) Aren't these codecs installed by default? If not, how would I enable them? Thanks