hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harish Butani (JIRA)" <>
Subject [jira] [Commented] (HIVE-896) Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.
Date Wed, 23 Jan 2013 17:43:15 GMT


Harish Butani commented on HIVE-896:


I have attached a document describing the PTF & Windowing Specification classes. This
is a formal description of the changes I was describing above. The output of Phase 1 will
be Windowing & PTFInvocation objects attached to the QB.

The thought process is:
- Phase 1 generates Specification that doesn't tie PTFs and Windowing
- We alter the PTFTranslator to handle both Windowing & PTFInvocations; for now we keep
the PTFDef classes mostly intact.
- in the future we:
  - build a separate Operator for Windowing, based on the Spec classes.
  - tbd: we refactor the PTFTranslator and Definition classes to share more translation code
with the Windowing Operator.
> Add LEAD/LAG/FIRST/LAST analytical windowing functions to Hive.
> ---------------------------------------------------------------
>                 Key: HIVE-896
>                 URL:
>             Project: Hive
>          Issue Type: New Feature
>          Components: OLAP, UDF
>            Reporter: Amr Awadallah
>            Priority: Minor
>         Attachments: DataStructs.html, HIVE-896.1.patch.txt
> Windowing functions are very useful for click stream processing and similar time-series/sliding-window
> More details at:
> -- amr

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message