hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13223) HoS may hang for queries that run on 0 splits
Date Sat, 09 Apr 2016 03:02:25 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15233315#comment-15233315
] 

Prasanth Jayachandran commented on HIVE-13223:
----------------------------------------------

Throwing exception is going to fail these tests. I think the correct behaviour is to throw
exception for invalid files. To read rows out of ORC, first we need to create Reader which
reads footer, metadata, stripe information etc.. It is at this phase we have to fail as we
cannot read footers out of invalid files. Only after successful creation of Reader we can
create RecordReaders. If there are no rows then hasNext() will return false immediately. We
won't be able to create RecordReaders with invalid files.

> HoS  may hang for queries that run on 0 splits 
> -----------------------------------------------
>
>                 Key: HIVE-13223
>                 URL: https://issues.apache.org/jira/browse/HIVE-13223
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>    Affects Versions: 2.1.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-13223.1.patch, HIVE-13223.2.patch, HIVE-13223.patch
>
>
> Can be seen on all timed out tests after HIVE-13040 went in



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message