hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4345) Pushing down query conditions to support on-the-fly filtering at the file parsing
Date Mon, 08 Jul 2013 04:23:48 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13701759#comment-13701759
] 

Ashutosh Chauhan commented on HIVE-4345:
----------------------------------------

There is an interface proposed in HIVE-4579 for doing this cleanly. Will that be sufficient
for this? There is also an implementation of that interface on HIVE-4246
                
> Pushing down query conditions to support on-the-fly filtering at the file parsing
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-4345
>                 URL: https://issues.apache.org/jira/browse/HIVE-4345
>             Project: Hive
>          Issue Type: New Feature
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Yifeng Geng
>              Labels: patch
>             Fix For: 0.10.0
>
>         Attachments: HIVE-4345.patch
>
>
> Serialize "predicate" conditions in query plan to MapredWork class, so the FileFormat
class can use the conditions to do on-the-fly filtering on the files. It can improve the performance
a lot for processsing certain binary files(NetCDF files for example).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message