incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <traviscrawf...@gmail.com>
Subject Re: No input storage driver classname found, cannot read partition
Date Wed, 29 Aug 2012 16:23:14 GMT
Can you already read your data with hive? If so, the upgrade to 0.4 or
trunk will be straightforward. If not, you'll need to get your data
working with hive first.

What format is your data in?

--travis


On Wed, Aug 29, 2012 at 9:14 AM, rajeev gupta <rajeev1071@gmail.com> wrote:
>
> True. I am using 0.2. How does one specify storage drivers (is it
> possible to read schema if table is not written using RCFile format)?
> Thanks
> -Rajeev
>
> On Wed, Aug 29, 2012 at 9:30 PM, Travis Crawford
> <traviscrawford@gmail.com> wrote:
> > Hey Rajeev -
> >
> > What version of hcat are you using? Sounds like you're using ~0.2,
> > which uses "storage drivers" that were later removed in favor of
> > directly using Hive serde's.
> >
> > --travis
> >
> >
> >
> > On Wed, Aug 29, 2012 at 6:55 AM, rajeev gupta <rajeev1071@gmail.com> wrote:
> >> Hi,
> >>
> >> I am getting error: No input storage driver classname found, cannot
> >> read partition, when trying to read HCatalog table schema.
> >> Specifically I am trying:
> >>                     HiveConf hcatConf = new HiveConf(this.getClass());
> >>                     hcatConf.set(ConfVars.METASTOREURIS.varname,
> >> "thrift://"+hostName+":9933");
> >>
> >> hcatConf.set(ConfVars.METASTOREWAREHOUSE.varname,wareHouseDir);
> >>                     hcatConf.set(ConfVars.SEMANTIC_ANALYZER_HOOK.varname,
> >> HCatSemanticAnalyzer.class.getName());
> >>                    HiveMetaStoreClient  msc = new HiveMetaStoreClient(hcatConf);
> >>                     SessionState.start(new CliSessionState(hcatConf));
> >>
> >>                  .........................................
> >>
> >>                    Configuration conf= new Configuration();
> >>                    Job job= new Job(conf, "Hcatalog Read Table");
> >>                     HCatTableInfo hti=
> >> HCatTableInfo.getInputTableInfo("thrift://"+hostName+":9933", null,
> >> databaseName, tableName,  null);
> >>                     HCatInputFormat.setInput(job, hti);
> >>                     HCatSchema schema=HCatBaseInputFormat.getTableSchema(job);
> >>
> >> The error occurs on the line   HCatInputFormat.setInput(job, hti).
> >> Full stack trace is as below:
> >>
> >> Exception in thread "main" java.io.IOException: java.io.IOException:
> >> No input storage driver classname found, cannot read partition
> >>         at org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:42)
> >>         at ReadTable.run(ReadTable.java:110)
> >>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>         at ReadTable.main(ReadTable.java:148)
> >> Caused by: java.io.IOException: No input storage driver classname
> >> found, cannot read partition
> >>         at org.apache.hcatalog.mapreduce.InitializeInput.extractPartInfo(InitializeInput.java:162)
> >>         at org.apache.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:111)
> >>         at org.apache.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:40)
> >>         ... 3 more
> >>
> >>
> >> --
> >> Thanks and Regards,
> >> Rajeev
> >>
> >> --
> >> Thanks and Regards,
> >> Rajeev Gupta
>
>
>
> --
> Thanks and Regards,
> Rajeev Gupta

Mime
View raw message