hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Laljo John Pullokkaran (JIRA)" <>
Subject [jira] [Commented] (HIVE-11752) Pre-materializing complex CTE queries
Date Fri, 12 Feb 2016 18:08:18 GMT


Laljo John Pullokkaran commented on HIVE-11752:

We need subsequent work to 
1. link the top select in CTE with multiple down stream consumers
    Calcite needs to handle this; within hive the wiring shouldn't be hard.

2. We need to enhance ColPruning/ PPD logic to work for multiple down stream op pipeline

> Pre-materializing complex CTE queries
> -------------------------------------
>                 Key: HIVE-11752
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 2.1.0
>            Reporter: Navis
>            Assignee: Jesus Camacho Rodriguez
>            Priority: Minor
>         Attachments: HIVE-11752.03.patch, HIVE-11752.04.patch, HIVE-11752.05.patch, HIVE-11752.1.patch.txt,
> Currently, hive regards CTE clauses as a simple alias to the query block, which makes
redundant works if it's used multiple times in a query. This introduces a reference threshold
for pre-materializing the CTE clause as a volatile table (which is not exists in any form
of metastore and just accessible from QB).

This message was sent by Atlassian JIRA

View raw message