hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chao Sun (JIRA)" <>
Subject [jira] [Commented] (HIVE-13873) Support column pruning for struct fields in select statement
Date Tue, 25 Oct 2016 17:13:58 GMT


Chao Sun commented on HIVE-13873:


> Support column pruning for struct fields in select statement
> ------------------------------------------------------------
>                 Key: HIVE-13873
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Logical Optimizer
>            Reporter: Xuefu Zhang
>            Assignee: Ferdinand Xu
>         Attachments: HIVE-13873.1.patch, HIVE-13873.2.patch, HIVE-13873.3.patch, HIVE-13873.4.patch,
HIVE-13873.5.patch, HIVE-13873.6.patch, HIVE-13873.patch, HIVE-13873.wip.patch
> This is the grounding work for the nested column pruning in Hive, for Parquet format.
In this patch, we address the case for struct type in select statements. In particular, for
queries such as:
> {code}
> select s.a from tbl
> {code}
> where {{tbl}} has schema:
> {code}
> s:struct<a:int, b:boolean, c:array<int>>
> {code}
> then only the field {{a}} should have been scanned in the Parquet reader, while field
{{b}} and {{c}} can be ignored.
> Future work includes support other types of statements, as well as more combinations
of types (e.g., selecting fields of array type inside a struct type).

This message was sent by Atlassian JIRA

View raw message