Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 704A6C441 for ; Mon, 29 Jul 2013 07:47:50 +0000 (UTC) Received: (qmail 62003 invoked by uid 500); 29 Jul 2013 07:47:46 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 61911 invoked by uid 500); 29 Jul 2013 07:47:46 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 61903 invoked by uid 99); 29 Jul 2013 07:47:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 07:47:44 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Peter.Marron@trilliumsoftware.com designates 216.32.181.182 as permitted sender) Received: from [216.32.181.182] (HELO ch1outboundpool.messaging.microsoft.com) (216.32.181.182) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jul 2013 07:47:37 +0000 Received: from mail51-ch1-R.bigfish.com (10.43.68.238) by CH1EHSOBE016.bigfish.com (10.43.70.66) with Microsoft SMTP Server id 14.1.225.22; Mon, 29 Jul 2013 07:47:14 +0000 Received: from mail51-ch1 (localhost [127.0.0.1]) by mail51-ch1-R.bigfish.com (Postfix) with ESMTP id 467292E0101 for ; Mon, 29 Jul 2013 07:47:14 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.232.53;KIP:(null);UIP:(null);IPV:NLI;H:BLUPRD0811HT003.namprd08.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: -3 X-BigFish: PS-3(zzc85fh1443I1a09Jzz1f42h208ch1ee6h1de0h1fdah2073h1202h1e76h1d1ah1d2ah1fc6hzz1d7338h17326ah18c673h1de096h18de19h8275bh8275dh1de097hz31h2a8h668h839hd25hf0ah1288h12a5h12bdh137ah1441h1504h1537h153bh15d0h162dh1631h1758h18e1h1946h19b5h19ceh1ad9h1b0ah1bceh1d07h1d0ch1d2eh1d3fh1dc1h1de9h1dfeh1dffh1e1dh1155h) Received-SPF: softfail (mail51-ch1: transitioning domain of trilliumsoftware.com does not designate 157.56.232.53 as permitted sender) client-ip=157.56.232.53; envelope-from=Peter.Marron@trilliumsoftware.com; helo=BLUPRD0811HT003.namprd08.prod.outlook.com ;.outlook.com ; Received: from mail51-ch1 (localhost.localdomain [127.0.0.1]) by mail51-ch1 (MessageSwitch) id 1375084031665253_25098; Mon, 29 Jul 2013 07:47:11 +0000 (UTC) Received: from CH1EHSMHS032.bigfish.com (snatpool1.int.messaging.microsoft.com [10.43.68.248]) by mail51-ch1.bigfish.com (Postfix) with ESMTP id 9E51046004C for ; Mon, 29 Jul 2013 07:47:11 +0000 (UTC) Received: from BLUPRD0811HT003.namprd08.prod.outlook.com (157.56.232.53) by CH1EHSMHS032.bigfish.com (10.43.70.32) with Microsoft SMTP Server (TLS) id 14.16.227.3; Mon, 29 Jul 2013 07:47:11 +0000 Received: from BLUPRD0811MB401.namprd08.prod.outlook.com ([169.254.4.68]) by BLUPRD0811HT003.namprd08.prod.outlook.com ([10.255.123.38]) with mapi id 14.16.0341.000; Mon, 29 Jul 2013 07:47:11 +0000 From: Peter Marron To: "user@hive.apache.org" Subject: Templeton create table with custom inputformat Thread-Topic: Templeton create table with custom inputformat Thread-Index: Ac6MLRXpr46Skv9mRYSFENF32VnpXg== Date: Mon, 29 Jul 2013 07:47:10 +0000 Message-ID: <458BA7AF19306B4FAA5FADDAD6D223353F085189@BLUPRD0811MB401.namprd08.prod.outlook.com> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [77.76.110.77] Content-Type: multipart/alternative; boundary="_000_458BA7AF19306B4FAA5FADDAD6D223353F085189BLUPRD0811MB401_" MIME-Version: 1.0 X-OriginatorOrg: trilliumsoftware.com X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn% X-Virus-Checked: Checked by ClamAV on apache.org --_000_458BA7AF19306B4FAA5FADDAD6D223353F085189BLUPRD0811MB401_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, (I'm a little bit behind in reading the lists, so apologies if this is a du= plicate question.) I am running Templeton v1 (?) and HCatalog 0.5.0 with hive 0.11.0 over Hado= op 1.0.4. I can use something like this: curl -s -X PUT -HContent-type:application/json -d @createtable.json http://= hpcluster1:50111/templeton/v1/ddl/database/default/table/ordinals?user.name= =3Dpmarron to successfully create a Hive table in my metastore. Where the file createt= able.json looks like this: { "external":true, "columns" : [ { "name": "english", "type": "string" }, { "name": "number", "type": "string" }, { "name": "italian", "type": "string" } ], "format": { "storedAs" : "rcfile" "rowFormat": { "fieldsTerminatedBy": "," } } } Now, I can change the "storedAs" argument to be "rcfile", "sequencefile", "= textfile" or "orc" and they all work. However I can't work out any syntax which allows me to create a table with = a custom InputFormat. Is there some way to create a table over the Templeton RESTful interface wi= th a custom InputFormat? Also I can't find the source code where this JSON is parsed, is it shipped = with the Hive 11 source? If so can someone tell me where? Many thanks in advance. Regards, Z --_000_458BA7AF19306B4FAA5FADDAD6D223353F085189BLUPRD0811MB401_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

(I’m a little bit behind in reading the lists,= so apologies if this is a duplicate question.)

 

I am running Templeton v1 (?) and HCatalog 0.5.0 wit= h hive 0.11.0 over Hadoop 1.0.4.

 

I can use something like this:

 

curl -s -X PUT -HContent-type:application/json -d @c= reatetable.json http://hpcluster1:50111/templeton/v1/ddl/database/default/table/ordinals?us= er.name=3Dpmarron

 

to successfully create a Hive table in my metastore.= Where the file createtable.json looks like this:

 

{ "external":true,

  "columns" :  [

        { "n= ame": "english", "type": "string" },

        { "n= ame": "number", "type": "string" },

        { &q= uot;name": "italian", "type": "string" }=

    ],

  "format": {

      "storedAs" = : "rcfile"

      "rowFormat"= : { "fieldsTerminatedBy": ","  }

    }

}

 

Now, I can change the “storedAs” argumen= t to be “rcfile”, “sequencefile”, “textfile&#= 8221; or “orc” and they all work.

However I can’t work out any syntax which allo= ws me to create a table with a custom InputFormat.

Is there some way to create a table over the Templet= on RESTful interface with  a custom InputFormat?

 

Also I can’t find the source code where this J= SON is parsed, is it shipped with the Hive 11 source?

If so can someone tell me where?

 

Many thanks in advance.

 

Regards,

 

Z

 

--_000_458BA7AF19306B4FAA5FADDAD6D223353F085189BLUPRD0811MB401_--