Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 454F41061A for ; Mon, 6 May 2013 21:22:18 +0000 (UTC) Received: (qmail 51661 invoked by uid 500); 6 May 2013 21:22:16 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 51580 invoked by uid 500); 6 May 2013 21:22:16 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 51565 invoked by uid 500); 6 May 2013 21:22:16 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 51561 invoked by uid 99); 6 May 2013 21:22:16 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 06 May 2013 21:22:16 +0000 Date: Mon, 6 May 2013 21:22:16 +0000 (UTC) From: "Owen O'Malley (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-4195) Avro SerDe causes incorrect behavior in unrelated tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HIVE-4195: -------------------------------- Fix Version/s: (was: 0.11.0) > Avro SerDe causes incorrect behavior in unrelated tables > -------------------------------------------------------- > > Key: HIVE-4195 > URL: https://issues.apache.org/jira/browse/HIVE-4195 > Project: Hive > Issue Type: Bug > Reporter: Skye Wanderman-Milne > > When I run a file that first creates an Avro table using the Avro SerDe, then immediately creates an LZO text table and inserts data into the LZO table, the resulting LZO table contain Avro data files. When I remove the Avro CREATE TABLE statement, the LZO table contains .lzo files as expected. > {noformat} > DROP TABLE IF EXISTS avro_table; > CREATE EXTERNAL TABLE avro_table > ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' > STORED AS > INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' > OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' > TBLPROPERTIES ('avro.schema.literal' = '{ > "namespace": "testing.hive.avro.serde", > "name": "test_record", > "type": "record", > "fields": [ > {"name":"int1", "type":"long"}, > {"name":"string1", "type":"string"} > ] > }'); > DROP TABLE IF EXISTS lzo_table; > CREATE EXTERNAL TABLE lzo_table ( > id int, > bool_col boolean, > tinyint_col tinyint, > smallint_col smallint, > int_col int, > bigint_col bigint, > float_col float, > double_col double, > date_string_col string, > string_col string, > timestamp_col timestamp) > STORED AS > INPUTFORMAT 'com.hadoop.mapred.DeprecatedLzoTextInputFormat' > OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' > ; > SET hive.exec.compress.output=true; > SET mapred.output.compression.type=BLOCK; > SET mapred.output.compression.codec=com.hadoop.compression.lzo.LzopCodec; > SET hive.exec.dynamic.partition.mode=nonstrict; > SET hive.exec.dynamic.partition=true; > SET mapred.max.split.size=256000000; > SET hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat; > insert overwrite table lzo_table SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col FROM src_table; > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira