hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Trupti Dhavle (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-8540) Compression with non-default codec's fail on winhadoop
Date Thu, 28 Jun 2012 18:14:44 GMT
Trupti Dhavle created HADOOP-8540:
-------------------------------------

             Summary: Compression with non-default codec's fail on winhadoop
                 Key: HADOOP-8540
                 URL: https://issues.apache.org/jira/browse/HADOOP-8540
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Trupti Dhavle


I was trying to run the compression test case with GZipCodec. However the test fails with
NPE. It is running fine with DefaultCodec.

With text input
c:\Workspace\winhadoopqe>c:\hdp\branch-1-win\bin\hadoop jar c:\hdp\branch-1-win\
build\hadoop-examples-1.1.0-SNAPSHOT.jar sort "-Dmapred.compress.map.output=true
" "-Dmapred.map.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec
" "-Dmapred.output.compress=true"  "-Dmapred.output.compression.type=NONE"  "-Dm
apred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec" -outKey
org.apache.hadoop.io.Text -outValue org.apache.hadoop.io.Text  Compression/texti
nput Compression/textoutput-123


Running on 1 nodes to sort from hdfs://localhost:8020/user/Administrator/Compres
sion/textinput into hdfs://localhost:8020/user/Administrator/Compression/textout
put-123 with 1 reduces.
Job started: Thu Jun 28 10:02:18 PDT 2012
12/06/28 10:02:18 INFO mapred.FileInputFormat: Total input paths to process : 1
12/06/28 10:02:18 INFO mapred.JobClient: Running job: job_201206271409_0045
12/06/28 10:02:19 INFO mapred.JobClient:  map 0% reduce 0%
12/06/28 10:02:36 INFO mapred.JobClient: Task Id : attempt_201206271409_0045_m_0
00000_0, Status : FAILED
java.lang.NullPointerException
        at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:102)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask
.java:1407)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1
298)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma
tion.java:1103)
        at org.apache.hadoop.mapred.Child.main(Child.java:265)



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message