hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Douglas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15151) MapFile.fix creates a wrong index file in case of block-compressed data file.
Date Thu, 01 Feb 2018 23:54:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349533#comment-16349533
] 

Chris Douglas commented on HADOOP-15151:
----------------------------------------

Thanks, [~rybkine]. While {{MapFile}} has some odd quirks, it's maintained by the project
mostly for compatibility with older applications. Improving the code quality may not be a
good use of your time. If you're interested in file formats generally, you may want to check
out the ORC and Parquet projects.

Of course, if that impression is mistaken and {{MapFile}} is important to you, please feel
free to open JIRAs to improve it (provided it continues to read/write files compatible with
the existing format).

> MapFile.fix creates a wrong index file in case of block-compressed data file.
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-15151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15151
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: common
>            Reporter: Grigori Rybkine
>            Assignee: Grigori Rybkine
>            Priority: Major
>              Labels: patch
>             Fix For: 2.9.1
>
>         Attachments: HADOOP-15151.001.patch, HADOOP-15151.002.patch, HADOOP-15151.003.patch,
HADOOP-15151.004.patch, HADOOP-15151.004.patch, HADOOP-15151.005.patch
>
>
> Index file created with MapFile.fix for an ordered block-compressed data file does not
allow to find values for keys existing in the data file via the MapFile.get method.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message