hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naveen Gangam (JIRA)" <>
Subject [jira] [Commented] (HIVE-9815) Metastote column"SERDE_PARAMS"."PARAM_VALUE" limited to 4000 bytes
Date Fri, 27 Feb 2015 21:28:04 GMT


Naveen Gangam commented on HIVE-9815:

I am looking for feedback on
What Oracle DB defaults to for MAX_STRING_SIZE? 
What is the impact on existing data in the database, if one were to change the MAX_STRING_SIZE
setting from STANDARD to EXTENDED & bounce the instance? Could there be a loss of data
that could impact hive metastore?

> Metastote column"SERDE_PARAMS"."PARAM_VALUE"  limited to 4000 bytes
> -------------------------------------------------------------------
>                 Key: HIVE-9815
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.14.0
>            Reporter: Naveen Gangam
>            Assignee: Naveen Gangam
>            Priority: Critical
> Currently, in the hive metastore schema, the length of the column SERDE_PARAMS.PARAM_VALUE
is set to 4000 bytes. This is not enough for users that have a key with a value larger than
4000 bytes. Say something like hbase.columns.mapping.
> I am not a database historian but appears that this limitation may have been put in place
because Oracle's varchar2 was restricted to 4k bytes for a long time until recently. 
> According to the following documentation, even today Oracle DB's varchar2 only supports
a max size of 4000 unless a configuration parameter MAX_STRING_SIZE is set to EXTENDED.
> {code}
> {code}
> Postgres supports a max of 1GB for character datatype according to
> MySQL can support upto 65535 bytes for the entire row. So long as the PARAM_KEY value
+ PARAM_VALUE is less than 65535, we should be good.
> SQL Server's varchar max length is 8000 and can go beyond using "varchar(max)".
> Derby's varchar can be upto 32672 bytes.

This message was sent by Atlassian JIRA

View raw message