hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dain Sundstrom (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8732) ORC string statistics are not merged correctly
Date Wed, 05 Nov 2014 22:44:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199268#comment-14199268
] 

Dain Sundstrom commented on HIVE-8732:
--------------------------------------

How will the code know that the stripe/file indexes are broken (i.e., written with the current
writer and not the new one)?    BWT, the current  reader will read files with future version
numbers; you only get a warning message:
{code:java}
      if (major > OrcFile.Version.CURRENT.getMajor() ||
          (major == OrcFile.Version.CURRENT.getMajor() &&
           minor > OrcFile.Version.CURRENT.getMinor())) {
        log.warn("ORC file " + path +
                 " was written by a future Hive version " +
                 versionString(version) +
                 ". This file may not be readable by this version of Hive.");
      }
{code}

> ORC string statistics are not merged correctly
> ----------------------------------------------
>
>                 Key: HIVE-8732
>                 URL: https://issues.apache.org/jira/browse/HIVE-8732
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HIVE-8732.patch
>
>
> Currently ORC's string statistics do not merge correctly causing incorrect maximum values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message