hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Wagner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4579) Create a SARG interface for RecordReaders
Date Wed, 29 May 2013 18:36:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669548#comment-13669548
] 

Mark Wagner commented on HIVE-4579:
-----------------------------------

This looks good. My one comment is that it would be good to extend this to support nested
columns, especially since all the recent columnar file formats that have come out support
storing nested columns individually.
                
> Create a SARG interface for RecordReaders
> -----------------------------------------
>
>                 Key: HIVE-4579
>                 URL: https://issues.apache.org/jira/browse/HIVE-4579
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: h-4579.patch, pushdown.pdf
>
>
> I think we should create a SARG (http://en.wikipedia.org/wiki/Sargable) interface for
RecordReaders. For a first pass, I'll create an API that uses the value stored in hive.io.filter.expr.serialized.
> The desire is to define an simpler interface that the direct AST expression that is provided
by hive.io.filter.expr.serialized so that the code to evaluate expressions can be generalized
instead of put inside a particular RecordReader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message