hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Selina Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10089) RCFile: lateral view explode caused ConcurrentModificationException
Date Wed, 25 Mar 2015 18:57:52 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380511#comment-14380511
] 

Selina Zhang commented on HIVE-10089:
-------------------------------------

Three conditions triggers this problem: 1. RCFIle (tested on ORC/AVRO/TEXT, all good) 2. map
column and explode columns both included in projection list 3. map column has more than one
entry. 

The reason HIVE-2540 does not fix this issue is because RCFile uses LazyBinaryMap and LazyBinaryArray,
which are missing from the HIVE-2540 patch. 

> RCFile: lateral view explode caused ConcurrentModificationException
> -------------------------------------------------------------------
>
>                 Key: HIVE-10089
>                 URL: https://issues.apache.org/jira/browse/HIVE-10089
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.2.0
>            Reporter: Selina Zhang
>            Assignee: Selina Zhang
>
> CREATE TABLE test_table123 (a INT, b MAP<STRING, STRING>) STORED AS RCFILE;
> INSERT OVERWRITE TABLE test_table123 SELECT 1, MAP("a1", "b1", "c1", "d1") FROM src LIMIT
1;
> The following query will lead to ConcurrentModificationException
> SELECT * FROM (SELECT b FROM test_table123) t1 LATERAL VIEW explode(b) x AS b,c LIMIT
1;
> Failed with exception java.io.IOException:java.util.ConcurrentModificationException



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message