I am not sure about java docs... ;-]

I = have spent the last three years integrating with HCat and to make it work h= ad to go thru the code...

So here are some samples= that can be helpful to start with. If you are using Hive 0.12.0 I would no= t bother with the new APIs... I had to create some shim classes for HCat to= make my code version independent but I cannot share that.=C2=A0

So=C2=A0

1. To enumerate table= s ... just use Hive client ... this seems to be version independent=C2=A0

=C2=A0 =C2=A0hiveMetastoreClient =3D new = HiveMetaStoreClient(conf);

// the conf should contain the "hive.metastore.uri= s" property that point to your Hive Metastore thrift server
=C2=A0 = =C2=A0List<String> databases =3D hiveMetastoreClient.getAll= Databases();

// this will get you all the databases

=C2=A0 =C2=A0Li= st<String> tables =3D hiveMetastoreClient.getAllTables(database);
=

// this will get you all the tables for the give data base

2. To get the table schema... I assume that you are after HCat s= chema =C2=A0

import org.apache.hado= op.conf.Configuration;
import org.apache.hadoop.mapreduce.InputSplit; import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapredu= ce.lib.output.TextOutputFormat;
import org.apache.hcatalog.data.schema.H= CatSchemaUtils;
import org.apache.hcatalog.mapreduce.HCatInputFormat; import org.apache.hcatalog.mapreduce.HCatSplit;
import org.apache.hcatal= og.mapreduce.InputJobInfo;

=C2= =A0 Job job =3D new Job(config);
=C2=A0 job.setJarByClass(XX= XXXX.class); // this will be your class=C2=A0
job.setInputFormatClass(HCatInputFormat.class);
job.setO= utputFormatClass(TextOutputFormat.class);
=C2=A0 InputJobInfo inpu= tJobInfo =3D InputJobInfo.create("my_data_base", "my_table&q= uot;, "partition filter");
HCatInputFormat.setInput(job, inputJobInfo);
HCatSchema s =3D=C2= =A0 HCatInputFormat.getTableSchema(job);

3. To read the HCat records....

It= depends on how you' like to read the records =C2=A0... will you be rea= ding ALL the records remotely from the client app =C2=A0

or you will get input splits and read the records on mappers....???

The code will be different (somewhat)... let me know= ...

=C2=A0

On Fri, Jun 13, 2014 at 8:25 AM, Brian J= eltema <brian.jeltema@digitalenvoy.net> wrote:<= br>

Version 0.12.0.

I=E2= =80=99d like to obtain the table=E2=80=99s schema, scan a table partition, = and use the schema to parse the rows.

I can probab= ly figure this out by looking at the HCatalog source. My concern was that
the HCatalog packages in the Hive distributions are excluded in the Ja= vaDoc, which implies
that the API is not public. Is there a reaso= n for this?

Brian

On Jun 13, 2014, at 9:10 AM, Dmitry Vasilenko <dvasilen@gmail.com> wrote:
You should be able to access= this information. The exact API depends on the version of Hive/HCat. As yo= u know earlier HCat API is being deprecated and will be removed in Hive 0.1= 4.0. I can provide you with the code sample if you tell me what you are try= ing to do and what version of Hive you are using.

On Fri,= Jun 13, 2014 at 7:33 AM, Brian Jeltema <brian.jeltema@digita= lenvoy.net> wrote:

I=E2=80=99m experimenting with HCatalog, and= would like to be able to access tables and their schema
from a Java application (not Hive/Pig/MapReduce). However, the API seems to= be hidden, which
leads leads me to believe that this is not a supported use case. Is HCatalo= g use limited to
one of the supported frameworks?

TIA

Brian

--001a11c1c196c0298304fbb7f817--