pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-4093) Predicate pushdown to support removing filters from pig plan
Date Mon, 25 Apr 2016 19:07:13 GMT

     [ https://issues.apache.org/jira/browse/PIG-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rohini Palaniswamy updated PIG-4093:
------------------------------------
    Fix Version/s:     (was: 0.16.0)
                   0.17.0

> Predicate pushdown to support removing filters from pig plan
> ------------------------------------------------------------
>
>                 Key: PIG-4093
>                 URL: https://issues.apache.org/jira/browse/PIG-4093
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Rohini Palaniswamy
>             Fix For: 0.17.0
>
>
>    It is possible for the loaders to evaluate the pushed filter conditions. In that case
it is not necessary to retain the filter conditions in the pig plan. So need to support two
modes :
>     1) filter conditions are pushed into loader but also retained in pig plan as loader
might do only best effort filtering based on block metadata
>     2) filter conditions are pushed into loader and removed from pig plan when the loader
can evaluate the expression itself and filter out records. In this case, loader can do lazy
deserialization adn avoid deserialization of the full record.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message