Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
MIME-Version: 1.0
In-Reply-To: <D22F25F5.388E2%sergey@hortonworks.com>
References: <D22F25F5.388E2%sergey@hortonworks.com>
Date: Mon, 28 Sep 2015 20:38:43 -0400
Message-ID: 
 <CANy_rP=fUQ2rwZKhfbf14TSx0touoM0=j8nNNqCtvW5dFjVfgA@mail.gmail.com>
Subject: Re: Avro column type in Hive
From: Chaoyu Tang <ctang.ma@gmail.com>
To: dev@hive.apache.org
Content-Type: multipart/alternative; boundary=001a1141c11a3b261d0520d80918

--001a1141c11a3b261d0520d80918
Content-Type: text/plain; charset=UTF-8

Yes, when you described the avro table, what you get back was actually from
your avro schema instead of database table. The avro table is NOT
considered as a metastore backed SerDe. But that it has its columns
populated to DB (e.g. HIVE-6308
<https://issues.apache.org/jira/browse/HIVE-6308>) is mainly for column
statistics purpose, which obviously is not applicable to your case which
has a type name > 100kb.

Chaoyu

On Mon, Sep 28, 2015 at 8:12 PM, Sergey Shelukhin <sergey@hortonworks.com>
wrote:

> Hi.
> I noticed that when I create an Avro table using a very large schema file,
> mysql metastore silently truncates the TYPE_NAME in COLUMNS_V2 table to
> the size of varchar (4000); however, when I do describe on the table, it
> still displays the whole type name (around 100Kb long) that I presume it
> gets from deserializer.
> Is the value in TYPE_NAME used for anything for Avro tables?
>
>

--001a1141c11a3b261d0520d80918--