hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <>
Subject [jira] [Commented] (HIVE-7220) Empty dir in external table causes issue (root_dir_external_table.q failure)
Date Tue, 08 Jul 2014 17:22:08 GMT


Szehon Ho commented on HIVE-7220:

Thanks.  Yea I forgot to comment, the failures do not look related, and dynpart_sort_optimization
passed so it was a random issue.

> Empty dir in external table causes issue (root_dir_external_table.q failure)
> ----------------------------------------------------------------------------
>                 Key: HIVE-7220
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>         Attachments: HIVE-7220.2.patch, HIVE-7220.3.patch, HIVE-7220.4.patch, HIVE-7220.5.patch,
HIVE-7220.5.patch, HIVE-7220.patch
> While looking at root_dir_external_table.q failure, which is doing a query on an external
table located at root ('/'), I noticed that latest Hadoop2 CombineFileInputFormat returns
split representing empty directories (like '/Users'), which leads to failure in Hive's CombineFileRecordReader
as it tries to open the directory for processing.
> Tried with an external table in a normal HDFS directory, and it also returns the same
error.  Looks like a real bug.

This message was sent by Atlassian JIRA

View raw message