hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juan Martin Pampliega <jpampli...@gmail.com>
Subject Re: CREATE TABLE throwing error for large number of columns (very long script)
Date Fri, 25 Jul 2014 00:14:08 GMT
Are you using MySQL or Postgres for the Metastore database?
On Jul 24, 2014 9:08 PM, "Prasanth Jayachandran" <
pjayachandran@hortonworks.com> wrote:

> What version of hive are you using? What file format are you using?
>
> Thanks
> Prasanth Jayachandran
>
> On Jul 24, 2014, at 5:03 PM, <azaz.rasool@wipro.com> <
> azaz.rasool@wipro.com> wrote:
>
> I am trying to Create a table in Hive. It’s a very long script contained
> large number of columns and also contains complex fields like STRUCT, ARRAY
> etc.
> ·         Cannot create full table in one shot using CREATE TABLE
> statement so need to first run CREATE and then ALTER
> ·         If fields are just primitive fields (even if large in numbers)
> then we can Create the table in parts (First running CREATE statement and
> then running few ALTER statements)
> ·         *However In few cases*, we have very large STRUCT fields inside
> the table. Each STRUCT contains large number of columns. STRUCT cannot be
> created separately by running ALTER statements because by default ALTER
> works at field level and not inside a complex field like STRUCT
>
> When we tried to replace the column of Struct type (with few number of
> columns) to Struct type (with more number of columns) – Error message
> appeared : FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table.
>
> Is it a limitation from metastore (MySQL/Postgres) or something which can
> be tweaked in Hive configuration?
>
>
> Thanks & Regards,
>
> Azaz Rasool
>
> Mobile (US) : +1 917 691 6266
>
> Mobile (India) : +91 776 097 4826
>
> http://lnkd.in/_BDmdK
>
>
> The information contained in this electronic message and any attachments
> to this message are intended for the exclusive use of the addressee(s) and
> may contain proprietary, confidential or privileged information. If you are
> not the intended recipient, you should not disseminate, distribute or copy
> this e-mail. Please notify the sender immediately and destroy all copies of
> this message and any attachments.
>
> WARNING: Computer viruses can be transmitted via email. The recipient
> should check this email and any attachments for the presence of viruses.
> The company accepts no liability for any damage caused by any virus
> transmitted by this email.
>
> www.wipro.com
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Mime
View raw message