hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Yang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1409) File format information is retrieved from first partition
Date Tue, 15 Jun 2010 03:29:23 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Paul Yang updated HIVE-1409:
----------------------------

    Attachment: HIVE-1409.1.patch

> File format information is retrieved from first partition
> ---------------------------------------------------------
>
>                 Key: HIVE-1409
>                 URL: https://issues.apache.org/jira/browse/HIVE-1409
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.6.0
>            Reporter: Paul Yang
>            Assignee: Paul Yang
>         Attachments: HIVE-1409.1.patch
>
>
> Currently, if no partitions match the partition predicate, the first partition is used
to retrieve the file format. This can cause an problem if the table is set to use RCFile,
but the first partition uses SequenceFile:
> {code}
> java.lang.RuntimeException: java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer.()
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> 	at org.apache.hadoop.mapred.SequenceFileRecordReader.createKey(SequenceFileRecordReader.java:65)
> 	at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.createKey(CombineHiveRecordReader.java:76)
> 	at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.createKey(CombineHiveRecordReader.java:42)
> 	at org.apache.hadoop.hive.shims.Hadoop20Shims$CombineFileRecordReader.createKey(Hadoop20Shims.java:212)
> 	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.createKey(MapTask.java:167)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:159)
> Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer.()
> 	at java.lang.Class.getConstructor0(Class.java:2706)
> 	at java.lang.Class.getDeclaredConstructor(Class.java:1985)
> 	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:109)
> 	... 9 more
> {code}
> The proposed change is to use the table's metadata in such cases.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message