hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4579) Create a SARG interface for RecordReaders
Date Sun, 11 Aug 2013 03:29:49 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736172#comment-13736172
] 

Owen O'Malley commented on HIVE-4579:
-------------------------------------

Ed,
  I forgot to answer your previous question. The serialized predicate is stored into the jobconf
and the sarg api provides a simplified and shared mechanism for record readers to implement
predicate push down based on the serialized predicate.
                
> Create a SARG interface for RecordReaders
> -----------------------------------------
>
>                 Key: HIVE-4579
>                 URL: https://issues.apache.org/jira/browse/HIVE-4579
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: h-4579.patch, HIVE-4579.D11409.1.patch, HIVE-4579.D11409.2.patch,
HIVE-4579.D11409.3.patch, pushdown.pdf
>
>
> I think we should create a SARG (http://en.wikipedia.org/wiki/Sargable) interface for
RecordReaders. For a first pass, I'll create an API that uses the value stored in hive.io.filter.expr.serialized.
> The desire is to define an simpler interface that the direct AST expression that is provided
by hive.io.filter.expr.serialized so that the code to evaluate expressions can be generalized
instead of put inside a particular RecordReader.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message