hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mahender bigdata <Mahender.BigD...@outlook.com>
Subject Re: Query Failing while querying on ORC Format
Date Tue, 17 May 2016 18:44:19 GMT
Thanks Mich. Reloading will always be there.  My only worry point is, we 
need to move 10 years of data and just looking for workaround without 
reloading.

/Mahender


On 5/17/2016 6:00 AM, Mich Talebzadeh wrote:
> Hi Mahendar,
>
> That version 1.2 is reasonable.
>
> One alternative is to create a new table (new_table) in Hive with 
> columns from old_table plus the added column new_column as ORC etc
>
> Do an INSERT/SELECT from old_table to new_table
>
> INSERT INTO new_table
> SELECT *, <value_for_new_column) from old_table
> ALTER old_table RENAME to old_table_KEEP
> RENAME new_table TO ol_table
>
> That should work. Check the syntax.
>
> HTH
>
> Dr Mich Talebzadeh
>
> LinkedIn 
> /https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/
>
> http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/>
>
>
> On 16 May 2016 at 23:53, mahender bigdata 
> <Mahender.BigData@outlook.com <mailto:Mahender.BigData@outlook.com>> 
> wrote:
>
>     I'm on Hive 1.2
>
>
>     On 5/16/2016 12:02 PM, Matthew McCline wrote:
>>
>>     ‚Äč
>>
>>     What version of Hive are you on?
>>
>>
>>     ------------------------------------------------------------------------
>>     *From:* Mahender Sarangam <mahender.bigdata@outlook.com>
>>     <mailto:mahender.bigdata@outlook.com>
>>     *Sent:* Saturday, May 14, 2016 3:29 PM
>>     *To:* user@hive.apache.org <mailto:user@hive.apache.org>
>>     *Subject:* Query Failing while querying on ORC Format
>>     Hi,
>>     We are dumping our data into ORC Partition Bucketed table. We
>>     have loaded almost 6 months data and here month is Partition by
>>     column. Now we have modified ORC partition bucketed table schema.
>>     We have added 2 more columns to the ORC table. Now whenever we
>>     are running select statement for older month which has no
>>     columns( even though these columns are not part in select clause,
>>     (projection column) ), it is throwing exception.
>>
>>     There is JIRA bug for this kind of requirement has already been
>>     raised.
>>     https://issues.apache.org/jira/browse/HIVE-11981
>>
>>     Can any one please tell me know alternative workaround for
>>     reading old previous columns of ORC partition table.
>>
>>     Thanks
>
>


Mime
View raw message