Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B6A21055F for ; Fri, 17 Jan 2014 06:06:07 +0000 (UTC) Received: (qmail 79038 invoked by uid 500); 17 Jan 2014 06:06:04 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 78719 invoked by uid 500); 17 Jan 2014 06:05:57 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 78703 invoked by uid 99); 17 Jan 2014 06:05:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jan 2014 06:05:56 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of spragues@gmail.com designates 209.85.216.54 as permitted sender) Received: from [209.85.216.54] (HELO mail-qa0-f54.google.com) (209.85.216.54) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Jan 2014 06:05:52 +0000 Received: by mail-qa0-f54.google.com with SMTP id i13so3012414qae.27 for ; Thu, 16 Jan 2014 22:05:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=jEI/zBTL1GlKS93m7G8NbcBqWRwvZErPg2uiNiMGYP8=; b=j/NsA//JSMeOaRh7rGPr2tj4qmgs+YmgO3N0D1x/GcKdr5YVaems1brlq89RKBwatH UMxjWvttWJ15x5ONsvgiZuj1k7LB3OhoUiPytTg2PM4tZemq/IpT6rUlr3ACjycs44O+ VZeWIHr7uTkK0e1ChZRi9IsMo0+Yi5AaCkUPvrcmG8MkEw+cEuIaGAL1Ciq03OIzYXjM ufAafk92Am2r5Cb6HxmqcdDcPBmrfVxFAK3OeLqtaOujx/eCg/6dxcKB5iDDnAABKDRu CSl4uMJGgyPjCJzt3FiecIS+tfyYv+/nkhoz3X0I4El4CetPBq/Gl2Nx0JNZpnwXyCzX Wv+A== X-Received: by 10.224.113.204 with SMTP id b12mr66578qaq.35.1389938731461; Thu, 16 Jan 2014 22:05:31 -0800 (PST) MIME-Version: 1.0 Received: by 10.229.192.9 with HTTP; Thu, 16 Jan 2014 22:05:11 -0800 (PST) In-Reply-To: References: From: Stephen Sprague Date: Thu, 16 Jan 2014 22:05:11 -0800 Message-ID: Subject: Re: Hive Create Table command throws datanucleus error To: "user@hive.apache.org" Content-Type: multipart/alternative; boundary=047d7bea3e20592f4604f0245474 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bea3e20592f4604f0245474 Content-Type: text/plain; charset=ISO-8859-1 okay. so SEQUENCE_TABLE does indeed exist. that's the first thing to get out of the way then. hmm. I suspect these other tables are just artifacts from the differences in the hive versions. yeah, i'm not sure where to go from here and I couldn't find much via googling either. would it be possible to install hive v0.12? I can at least vouch for that version. (i'm using postgres v9.1 however.) Otherwise, we'll have to wait for someone else to chase this bugger down - which may not be a bad thing. :) On Thu, Jan 16, 2014 at 7:54 PM, Leena Gupta wrote: > Thanks for responding Stephen. > I checked the tables in Postgres and the SEQUENCE_TABLE exists. However in > comparison to the list you gave for Hive 0.12, the following tables are > missing, not sure if these could be the cause of the datanucleus error : > > DELEGATION_TOKENS > > MASTER_KEYS > > VERSION > > > Thanks, > > Leena > > > On Thu, Jan 16, 2014 at 4:42 PM, Stephen Sprague wrote: > >> >> On Thu, Jan 16, 2014 at 4:17 PM, Leena Gupta wrote: >> >>> Could not create "increment"/"table" value-generation container >>> "SEQUENCE_TABLE" since autoCreate flags do not allow it. >> >> >> >> >> Interestingly enough this exact same question is posted here: >> http://stackoverflow.com/questions/19205318/cannot-create-database-with-hive >> and crickets for responses. the twist is is that its for mysql! which >> leads us to the fact that its a middleware (datanucleus?) problem - not a >> metastore vendor problem. >> >> for starters first thing i'd do (regardless of the autocreate flags in >> hive-site.xml) is to confirm that table (SEQUENCE_TABLE) exists in your >> postgres metastore database. "\dt" would list the tables. Is it present? >> >> Cheers, >> Stephen. >> >> >> PS this is what have for hive v0.12 on postgres if its any help. >> >> {noformat} >> dwr_prod=> \dt >> List of relations >> Schema | Name | Type | Owner >> --------+---------------------------+-------+---------- >> public | BUCKETING_COLS | table | postgres >> public | CDS | table | postgres >> public | COLUMNS_OLD | table | postgres >> public | COLUMNS_V2 | table | postgres >> public | DATABASE_PARAMS | table | postgres >> public | DBS | table | postgres >> public | DB_PRIVS | table | postgres >> public | DELEGATION_TOKENS | table | postgres >> public | GLOBAL_PRIVS | table | postgres >> public | IDXS | table | postgres >> public | INDEX_PARAMS | table | postgres >> public | MASTER_KEYS | table | postgres >> public | NUCLEUS_TABLES | table | postgres >> public | PARTITIONS | table | postgres >> public | PARTITION_EVENTS | table | postgres >> public | PARTITION_KEYS | table | postgres >> public | PARTITION_KEY_VALS | table | postgres >> public | PARTITION_PARAMS | table | postgres >> public | PART_COL_PRIVS | table | postgres >> public | PART_COL_STATS | table | postgres >> public | PART_PRIVS | table | postgres >> public | ROLES | table | postgres >> public | ROLE_MAP | table | postgres >> public | SDS | table | postgres >> public | SD_PARAMS | table | postgres >> public | SEQUENCE_TABLE | table | postgres >> public | SERDES | table | postgres >> public | SERDE_PARAMS | table | postgres >> public | SKEWED_COL_NAMES | table | postgres >> public | SKEWED_COL_VALUE_LOC_MAP | table | postgres >> public | SKEWED_STRING_LIST | table | postgres >> public | SKEWED_STRING_LIST_VALUES | table | postgres >> public | SKEWED_VALUES | table | postgres >> public | SORT_COLS | table | postgres >> public | TABLE_PARAMS | table | postgres >> public | TAB_COL_STATS | table | postgres >> public | TBLS | table | postgres >> public | TBL_COL_PRIVS | table | postgres >> public | TBL_PRIVS | table | postgres >> public | TYPES | table | postgres >> public | TYPE_FIELDS | table | postgres >> public | VERSION | table | postgres >> (42 rows) >> {noformat} >> >> > --047d7bea3e20592f4604f0245474 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
okay. so SEQUENCE_TABLE does indeed exist.=A0 that's the= first thing to get out of the way then. hmm.

I suspect these other tables are just artifacts from the differences in the= hive versions.

yeah, i'm not sure where to go from here and= I couldn't find much via googling either.

would it be possible to install hive v0.12? I can at least vouch for th= at version. (i'm using postgres v9.1 however.)

Otherwise, w= e'll have to wait for someone else to chase this bugger down - which ma= y not be a bad thing. :)


O= n Thu, Jan 16, 2014 at 7:54 PM, Leena Gupta <gupta.leena@gmail.com> wrote:
Thanks for responding Steph= en.
I checked the tables in Postgres and the SEQUENCE_TABLE exists. How= ever in comparison to the list you gave for Hive 0.12, the following tables= are missing, not sure if these could be the cause of the datanucleus error= :

DELEGATION_TOKENS

MASTER_KEYS

VERSION


Thanks,

Leena

=

On Thu, Jan 16, 2014 at 4:42 PM, Stephen S= prague <spragues@gmail.com> wrote:
=

On Thu, Jan 16, 2014 at 4:17 PM, Leena = Gupta <gupta.leena@gmail.com> wrote:
Could not create "i= ncrement"/"table" value-generation container "SEQUENCE_= TABLE" since autoCreate flags do not allow it.



Interestingly enough this exact same question is post= ed here: http://stackoverflow.com/questions= /19205318/cannot-create-database-with-hive
and crickets for responses.=A0 the twist is is that its for mysql!=A0 w= hich leads us to the fact that its a middleware (datanucleus?) problem - no= t a metastore vendor problem.

for starters first thing i'd do (regardless of the autocreate f= lags in hive-site.xml) is to confirm that table (SEQUENCE_TABLE) exists in = your postgres metastore database.=A0 "\dt" would list the tables.= =A0 Is it present?

Cheers,
Stephen.


PS this is what have for hive v0.12 on postgres if its any help.

{noformat}
dwr_prod=3D> \dt
=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0 List of relations
=A0Schema |=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 Name=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0 | Type=A0 |=A0 Owner
--------+---------------------------+-------= +----------
=A0public | BUCKETING_COLS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 = | table | postgres
=A0public | CDS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | COLUMNS_OLD=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table |= postgres
=A0public | COLUMNS_V2=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0 | table | postgres
=A0public | DATABASE_PARAMS=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0 | table | postgres
=A0public | DBS=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | DB_PRIVS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | t= able | postgres
=A0public | DELEGATION_TOKENS=A0=A0=A0=A0=A0=A0=A0=A0 | = table | postgres
=A0public | GLOBAL_PRIVS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0 | table | postgres
=A0public | IDXS=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | INDEX_PARAMS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | p= ostgres
=A0public | MASTER_KEYS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0 | table | postgres
=A0public | NUCLEUS_TABLES=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0 | table | postgres
=A0public | PARTITIONS=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | PARTITION_EVENTS=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres<= br>=A0public | PARTITION_KEYS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | po= stgres
=A0public | PARTITION_KEY_VALS=A0=A0=A0=A0=A0=A0=A0 | table | pos= tgres
=A0public | PARTITION_PARAMS=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | = postgres
=A0public | PART_COL_PRIVS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postg= res
=A0public | PART_COL_STATS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table = | postgres
=A0public | PART_PRIVS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0 | table | postgres
=A0public | ROLES=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | ROLE_MAP=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | t= able | postgres
=A0public | SDS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | SD_PARAMS=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0publ= ic | SEQUENCE_TABLE=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | SERDES=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= | table | postgres
=A0public | SERDE_PARAMS=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0 | table | postgres
=A0public | SKEWED_COL_NAMES=A0=A0=A0=A0= =A0=A0=A0=A0=A0 | table | postgres
=A0public | SKEWED_COL_VALUE_LOC_MAP= =A0 | table | postgres
=A0public | SKEWED_STRING_LIST=A0=A0=A0=A0=A0=A0=A0 | table | postgres
= =A0public | SKEWED_STRING_LIST_VALUES | table | postgres
=A0public | SKE= WED_VALUES=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0pub= lic | SORT_COLS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | p= ostgres
=A0public | TABLE_PARAMS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | p= ostgres
=A0public | TAB_COL_STATS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | = table | postgres
=A0public | TBLS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | TBL_COL_PRIVS=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | TBL_PRIVS=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | tab= le | postgres
=A0public | TYPES=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | TYPE_FIELDS=A0=A0= =A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgres
=A0public | VERS= ION=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 | table | postgre= s
(42 rows)
{noformat}



--047d7bea3e20592f4604f0245474--