hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4918) Make bzip2 work with SequenceFile
Date Wed, 14 Jan 2009 23:48:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12663931#action_12663931
] 

Zheng Shao commented on HADOOP-4918:
------------------------------------

     [exec]
     [exec] BUILD SUCCESSFUL
     [exec] Total time: 9 minutes 8 seconds
     [exec] Starting with /home/zshao/tmp/trunkFindbugsWarnings.xml
     [exec] Merging /home/zshao/tmp/patchFindbugsWarnings.xml
     [exec]
     [exec]
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]     Running Eclipse classpath verification.
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]
     [exec]
     [exec]
     [exec]
     [exec]
     [exec]
     [exec] +1 overall.
     [exec]
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec]
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec]
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec]
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler
warnings.
     [exec]
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]
     [exec]     +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
     [exec]
     [exec]
     [exec]
     [exec]
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]     Finished build.
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]
     [exec]

BUILD SUCCESSFUL
Total time: 30 minutes 55 seconds


> Make bzip2 work with SequenceFile
> ---------------------------------
>
>                 Key: HADOOP-4918
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4918
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: Zheng Shao
>            Assignee: Zheng Shao
>             Fix For: 0.21.0
>
>         Attachments: HADOOP-4918.3.patch
>
>
> Somehow bzip2 does not work with SequenceFile:
> {code}
>     String codec = "org.apache.hadoop.io.compress.BZip2Codec";
>     SequenceFile.Writer writer = SequenceFile.createWriter(fs, conf, new Path(output),

>         reader.getKeyClass(), reader.getValueClass(), CompressionType.BLOCK, 
>         (CompressionCodec)Class.forName(codec).newInstance());
> {code}
> The stack trace is here:
> {noformat}
> java.lang.UnsupportedOperationException
>         at org.apache.hadoop.io.compress.BZip2Codec.getCompressorType(BZip2Codec.java:80)
>         at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:98)
>         at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:914)
>         at org.apache.hadoop.io.SequenceFile$BlockCompressWriter.<init>(SequenceFile.java:1198)
>         at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:401)
>         at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:329)
>         at org.apache.hadoop.mapred.TestSequenceFileBZip.main(TestSequenceFileBZip.java:43)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
>         at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message