drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramana Inukonda Nagaraj (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (DRILL-1997) Hive generated parquet files with maps containing strings return wrong value
Date Tue, 13 Jan 2015 19:52:35 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ramana Inukonda Nagaraj updated DRILL-1997:
-------------------------------------------
    Attachment: hive_alltypes.parquet

The hive generated parquet file.

> Hive generated parquet files with maps containing strings return wrong value
> ----------------------------------------------------------------------------
>
>                 Key: DRILL-1997
>                 URL: https://issues.apache.org/jira/browse/DRILL-1997
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Ramana Inukonda Nagaraj
>            Assignee: Parth Chandra
>            Priority: Critical
>         Attachments: hive_alltypes.parquet
>
>
> Created a parquet file in hive having the following DDL
> hive> desc alltypesparquet;          
> OK
> c1                  	int                 	                    
> c2                  	boolean             	                    
> c3                  	double              	                    
> c4                  	string              	                    
> c5                  	array<int>          	                    
> c6                  	map<int,string>     	                    
> c7                  	map<string,string>  	                    
> c8                  	struct<r:string,s:int,t:double>	                    
> c9                  	tinyint             	                    
> c10                 	smallint            	                    
> c11                 	float               	                    
> c12                 	bigint              	                    
> c13                 	array<array<string>>	                    
> c15                 	struct<r:int,s:struct<a:int,b:string>>	            
       
> c16                 	array<struct<m:map<string,string>,n:int>>	   
                
> Time taken: 0.076 seconds, Fetched: 15 row(s)
> All the complex types with string in them are returning incorrect values in drill. For
example:
> hive> select c6 from alltypesparquet;
> NULL
> NULL
> {1:"x",2:"y"}
> 0: jdbc:drill:> select c6 from `/user/hive/warehouse/alltypesparquet`;
> +------------+
> |     c6     |
> +------------+
> | {"map":[]} |
> | {"map":[]} |
> | {"map":[{"key":1,"value":"eA=="},{"key":2,"value":"eQ=="}]} |
> +------------+
> 3 rows selected (0.077 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message