Mailing-List: contact dev-help@orc.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@orc.apache.org
From: prasanthj <git@git.apache.org>
To: dev@orc.apache.org
Reply-To: dev@orc.apache.org
References: <git-pr-163-orc@git.apache.org>
In-Reply-To: <git-pr-163-orc@git.apache.org>
Subject: [GitHub] orc issue #163: ORC-162. Handle 0 byte files as empty ORC files.
Content-Type: text/plain
Message-Id: <20170829223401.BB8E5E7DFA@git1-us-west.apache.org>
Date: Tue, 29 Aug 2017 22:34:01 +0000 (UTC)
archived-at: Tue, 29 Aug 2017 22:34:05 -0000

Github user prasanthj commented on the issue:

    https://github.com/apache/orc/pull/163
  
    Hive creates empty files only for MR to support bucketed joins. Tez doesn't create empty bucket files anymore. Hive currently discards empty files during split generation. We can do similar thing in Orc's version of OrcInputFormat (or add EmptyFilePathPattern to ignore 0 length files or files <= MAGIC.length). Creating splits for empty is anyway useless. As far as calling the Reader's directly with a empty file path, we can treat it as empty file with struct<>. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---