hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tony Burton <TBur...@SportingIndex.com>
Subject Map output compression in Hadoop 1.0.3
Date Wed, 28 Nov 2012 11:12:30 GMT
Hi,

Quick question: What's the best way to turn on Map Output Compression in Hadoop 1.0.3? The
tutorial at http://hadoop.apache.org/docs/r1.0.3/mapred_tutorial.html says to use JobConf.setCompressMapOutput(boolean),
but I'm using o.a.h.mapreduce.Job rather than o.a.h.mapred.JobConf.

Is it simply a case of using getConf.set("mapred.output.compress", true) then constructing
my Job from the Configuration object, or is there more direct way that I've missed?

Thanks,

Tony



**********************************************************************
Please consider the environment before printing this email or attachments

This email and any attachments are confidential, protected by copyright and may be legally
privileged.  If you are not the intended recipient, then the dissemination or copying of this
email is prohibited. If you have received this in error, please notify the sender by replying
by email and then delete the email completely from your system.  Neither Sporting Index nor
the sender accepts responsibility for any virus, or any other defect which might affect any
computer or IT system into which the email is received and/or opened.  It is the responsibility
of the recipient to scan the email and no responsibility is accepted for any loss or damage
arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered
in England and Wales with company number 2636842, whose registered office is at Gateway House,
Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the
UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).
 Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.

Outbound email has been scanned for viruses and SPAM

Mime
View raw message