hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8021) Hadoop ignores old-style config options for enabling compressed output when passed on from PIG
Date Fri, 03 Feb 2012 23:35:53 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13200161#comment-13200161

Mahadev konar commented on HADOOP-8021:

 I dont uderstand how this is different from running from CLI. Both of them should call Configuration.load().
Why is there a difference?
> Hadoop ignores old-style config options for enabling compressed output when passed on
from PIG
> ----------------------------------------------------------------------------------------------
>                 Key: HADOOP-8021
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8021
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>    Affects Versions: 0.23.1
>            Reporter: Anupam Seth
>            Assignee: Anupam Seth
>             Fix For: 0.23.1
> Hadoop seems to ignore the config options even though they are printed as deprecation
warnings in the log: mapred.output.compress and
> mapred.output.compression.codec
> - settings that work on 0.20 but not on 0.23
> mapred.output.compress=true
> mapred.output.compression.codec=org.apache.hadoop.io.compress.BZip2Codec
> - settings that work on 0.23
> mapreduce.output.fileoutputformat.compress=true
> mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.BZip2Codec
> This breaks backwards compatibility and causes existing jobs to fail.
> This is different from HADOOP-7993 in that that one fixes any jobs run from the CLI but
PIG jobs are still facing this issue.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message