hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-6759) Fix reading partial ORC files while they are being written
Date Tue, 08 Apr 2014 18:41:15 GMT

     [ https://issues.apache.org/jira/browse/HIVE-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Owen O'Malley updated HIVE-6759:
--------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Thanks for the review, Sergey and Harish. Thejas ran the unit tests internally and they passed.

I just committed this.

> Fix reading partial ORC files while they are being written
> ----------------------------------------------------------
>
>                 Key: HIVE-6759
>                 URL: https://issues.apache.org/jira/browse/HIVE-6759
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Critical
>             Fix For: 0.13.0
>
>         Attachments: HIVE-6759.patch
>
>
> HDFS with the hflush ensures the bytes are visible, but doesn't update the file length
on the NameNode. Currently the Orc reader will only read up to the length on the NameNode.
If the user specified a length from a flush_length file, the Orc reader should trust it to
be right.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message