hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anthony Hsu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6365) Alter a partition to be of a different fileformat than the Table's fileformat. Use insert overwrite to write data to this partition. The partition fileformat is converted back to table's fileformat after the insert operation.
Date Sat, 10 Dec 2016 01:10:58 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anthony Hsu updated HIVE-6365:
------------------------------
    Summary: Alter a partition to be of a different fileformat than the Table's fileformat.
Use insert overwrite to write data to this partition. The partition fileformat is converted
back to table's fileformat after the insert operation.   (was: Alter a partition to be of
a different fileformat than the Table's fileformat. Use insert overwrite to write data to
this partition. The partition fileformat is coverted back to table's fileformat after the
insert operation. )

> Alter a partition to be of a different fileformat than the Table's fileformat. Use insert
overwrite to write data to this partition. The partition fileformat is converted back to table's
fileformat after the insert operation. 
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-6365
>                 URL: https://issues.apache.org/jira/browse/HIVE-6365
>             Project: Hive
>          Issue Type: Bug
>         Environment: emr
>            Reporter: Pavan Srinivas
>
> Lets say, there is partitioned table like 
> Step1:
> >> CREATE TABLE srcpart (key STRING, value STRING)
> PARTITIONED BY (ds STRING, hr STRING)
> STORED AS TEXTFILE;
> Step2:
> Alter the fileformat for a specific available partition. 
> >> alter table srcpart partition(ds="2008-04-08", hr="12") set fileformat  orc;
> Step3:
> Describe the partition.
> >> desc formatted srcpart partition(ds="2008-04-08", hr="12")
> .............
> # Storage Information
> SerDe Library:      	org.apache.hadoop.hive.ql.io.orc.OrcSerde
> InputFormat:        	org.apache.hadoop.hive.ql.io.orc.OrcInputFormat
> OutputFormat:       	org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat
> Compressed:         	No
> Num Buckets:        	-1
> Bucket Columns:     	[]
> Sort Columns:       	[]
> Storage Desc Params:
> 	serialization.format	1
> Step4:
> Write the data to this partition using insert overwrite. 
> >>insert overwrite  table srcpart partition(ds="2008-04-08",hr="12") select key,
value from ....... 
> Step5:
> Describe the partition again. 
> >> desc formatted srcpart partition(ds="2008-04-08", hr="12")
> .................
> # Storage Information
> SerDe Library:      	org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
> InputFormat:        	org.apache.hadoop.mapred.TextInputFormat
> OutputFormat:       	org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
> Compressed:         	No
> Num Buckets:        	-1
> Bucket Columns:     	[]
> Sort Columns:       	[]
> Storage Desc Params:
> 	serialization.format	1
> The fileformat of the partition is converted back to the table's original fileformat.
It should have retained and written the data in the modified fileformat. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message