incubator-hcatalog-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Francis Liu (JIRA)" <>
Subject [jira] [Resolved] (HCATALOG-380) If pig script does load then order by, hive-site.xml doesn't seem to propagate properly
Date Wed, 09 May 2012 23:43:51 GMT


Francis Liu resolved HCATALOG-380.

       Resolution: Fixed
    Fix Version/s: 0.4.1

checked into trunk and branch-0.4
> If pig script does load then order by, hive-site.xml doesn't seem to propagate properly

> ----------------------------------------------------------------------------------------
>                 Key: HCATALOG-380
>                 URL:
>             Project: HCatalog
>          Issue Type: Bug
>          Components: pig
>    Affects Versions: 0.4, 0.5, 0.4.1
>            Reporter: David Capwell
>            Assignee: Francis Liu
>             Fix For: 0.4.1
>         Attachments: HCATALOG-380.patch
> Table is not partitioned and has an RCFile for the data.
> The following pig script will cause the MR jobs to fail:
> a = load 'default.table' USING org.apache.hcatalog.pig.HCatLoader();
> b = order a by id;
> dump b;
> If I prefix the order by with a foreach statement, then the job will pass.
> The MR job fails with the following exception:
> Error: java.lang.ClassNotFoundException: javax.jdo.JDOException at$
at Method) at
at java.lang.ClassLoader.loadClass( at sun.misc.Launcher$AppClassLoader.loadClass(
at java.lang.ClassLoader.loadClass( at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.<init>(
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(
at org.apache.hcatalog.mapreduce.InitializeInput.createHiveMetaClient(
at org.apache.hcatalog.mapreduce.InitializeInput.getSerializedHcatKeyJobInfo(
at org.apache.hcatalog.mapreduce.InitializeInput.setInput( at org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(
at org.apache.hcatalog.pig.HCatLoader.setLocation( at org.apache.pig.impl.builtin.SampleLoader.setLocation(
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(
at org.apache.hadoop.mapred.MapTask.runNewMapper( at
at org.apache.hadoop.mapred.Child$ at
Method) at at
at org.apache.hadoop.mapred.Child.main( 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message