hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled
Date Wed, 19 Jul 2017 09:04:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16092818#comment-16092818
] 

Rajesh Balamohan commented on HIVE-17125:
-----------------------------------------

RB: https://reviews.apache.org/r/60962/diff/1/

> Lineage: Generate lineage information on need basis when atlas hook is enabled
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-17125
>                 URL: https://issues.apache.org/jira/browse/HIVE-17125
>             Project: Hive
>          Issue Type: Improvement
>          Components: lineage
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-17125.1.patch
>
>
> When atlas hook is enabled, it would be good to generate lineage information only for
insert/create/view statements and skip for select statements. Currently, in some of the complex
select queries, generating lineage information turns out to in 100s of seconds, which can
be avoided with this change.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message