pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitriy Ryaboy <dvrya...@gmail.com>
Subject Re: How to change execution when extra information is available?
Date Mon, 14 Nov 2011 22:26:33 GMT
There isn't an optimizer yet that knows how to use this information.
It would probably live at the Logical Optimizer level.
There's an interface for loaders to provide statistics about their
data, you can start by making sure your loaders implement it, and go
from there.


On Mon, Nov 14, 2011 at 1:36 PM, Patryk Mastela
<patrick.mastela@gmail.com> wrote:
> Hi,
> If there is information available about the data (e.g. computed averages
> over a certain column) where in the code should we start looking to to get
> this information and actually use it for the execution?
> Thanks,
> Patryk

View raw message