hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Seema Datar <sda...@yahoo-inc.com>
Subject OrcOutputFormat
Date Tue, 29 Apr 2014 10:40:08 GMT
Hi,

I am trying to run an MR job to write files in ORC format.  I do not see any files created
although the job runs successfully. If I change the output format from OrcOutputFormat to
TextOutputFormat (and that being the only change), I see the output files getting created.
I am using Hive-0.12.0. I tried upgrading to Hive 0.13.0 but with this version I get the following
error -


2014-04-29 10:37:07,426 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child
: java.lang.VerifyError: org/apache/hadoop/hive/ql/io/orc/OrcProto$RowIndex
        at org.apache.hadoop.hive.ql.io.orc.WriterImpl.<init>(WriterImpl.java:129)
        at org.apache.hadoop.hive.ql.io.orc.OrcFile.createWriter(OrcFile.java:369)
        at org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat$OrcRecordWriter.close(OrcOutputFormat.java:104)
        at org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat$OrcRecordWriter.close(OrcOutputFormat.java:91)
        at org.apache.hadoop.mapred.MapTask$DirectMapOutputCollector.close(MapTask.java:784)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:411)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:335)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1300)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153)


How do you think can this issue be resolved?


Thanks,

Seema

Mime
View raw message