Aniket Mokashi created PIG-3410:
-----------------------------------
Summary: LimitOptimizer is applied before PartitionFilterOptimizer
Key: PIG-3410
URL: https://issues.apache.org/jira/browse/PIG-3410
Project: Pig
Issue Type: Bug
Affects Versions: 0.11.1
Reporter: Aniket Mokashi
Consider following script-
{code}
hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
hcat_filter = FILTER hcat_load BY (part='Y');
hcat_limited = limit hcat_filter 5;
dump hcat_limited;
{code}
This script is not benefited from LimitOptimizer (pushing limit to loadfunc) because LimitOptimizer
is applied before PartitionFilterOptimizer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
|