flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fabian Hueske (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-8243) OrcTableSource should recursively read all files in nested directories of the input path.
Date Tue, 12 Dec 2017 11:04:00 GMT
Fabian Hueske created FLINK-8243:
------------------------------------

             Summary: OrcTableSource should recursively read all files in nested directories
of the input path.
                 Key: FLINK-8243
                 URL: https://issues.apache.org/jira/browse/FLINK-8243
             Project: Flink
          Issue Type: Improvement
          Components: Batch Connectors and Input/Output Formats
    Affects Versions: 1.4.0
            Reporter: Fabian Hueske
            Assignee: Fabian Hueske
            Priority: Critical
             Fix For: 1.5.0, 1.4.1


The {{OrcTableSource}} only reads files on the first level of the provided input path. 

Hive's default behavior is to recursively read all nested files in the input path. We should
follow this behavior and add a switch to disable recursive reading.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message