orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "piyush mukati (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ORC-231) Having configurable capability to overwrite the file with the same name already exists
Date Thu, 17 Aug 2017 05:46:03 GMT
piyush mukati created ORC-231:
---------------------------------

             Summary: Having configurable capability to overwrite the file with the same name
already exists 
                 Key: ORC-231
                 URL: https://issues.apache.org/jira/browse/ORC-231
             Project: ORC
          Issue Type: Improvement
            Reporter: piyush mukati


Having configurable capability to overwrite the file with the same name already exists (Line
no 90 in org.apache.orc.impl.PhysicalFsWriter). 

Use Case:
I am using OrcOutputFormat with MultipleOutput in my MapReduce job.
Since MultipleOutput does not uses OutputCommitter so there are half/corrupt files are left
from the failed reducers.
Here the files with the same name will be overwritten by the retry attempt and it will guarantee
correct result from a successful job.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message