atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-1824) Cannot create hive lineage when using query "insert into table X select A.Y, B.Z from A,B"
Date Wed, 31 May 2017 03:12:04 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030557#comment-16030557
] 

ASF GitHub Bot commented on ATLAS-1824:
---------------------------------------

GitHub user developersLxz opened a pull request:

    https://github.com/apache/incubator-atlas/pull/29

    fix ATLAS-1824

    fix bug  
    https://issues.apache.org/jira/browse/ATLAS-1824

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/developersLxz/incubator-atlas fix-ATLAS-1824

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-atlas/pull/29.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #29
    
----
commit 30fc8ebe28b5d2c5d3c747ffcdd59ba0a0c938b4
Author: Linzs <850589345@qq.com>
Date:   2017-05-31T02:11:27Z

    fix ATLAS-1824

----


> Cannot create hive lineage when using query "insert into table X select A.Y, B.Z from
A,B"
> ------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-1824
>                 URL: https://issues.apache.org/jira/browse/ATLAS-1824
>             Project: Atlas
>          Issue Type: Bug
>          Components:  atlas-core
>    Affects Versions: 0.7-incubating, 0.8-incubating, 0.7.1-incubating, 0.9-incubating,
0.8.1-incubating
>            Reporter: qinglin,xia
>              Labels: atlas
>         Attachments: 0001-fix-ATLAS-1824.patch, failed_lineage_input_output.png, failed_lineage.png
>
>
> Problem: 
> I am using atlas to create hive lineage, I found that when using the hive query "insert
into table A select B.name ,C.name from B, C", the lineage between A, B and C cannot be created.

> Steps to reproduce: 
> 1. log in to the hive shell
> 2. create hive table a, b,c and insert into data into a,b and c
> 3. using query "insert into table datalake_demo.d9 select a.id as key, a.id, a.aname
,b.bname,c.cname from datalake_demo.a,datalake_demo.b,datalake_demo.c where a.id = b.id and
b.id = c.id" to create hive table d9
> Expected Result:
> hive_process is created , input of the process is a, b, c, output of the process is datalake_demo.d9,
and the process could be shown on atlas UI
> Actual Result: 
> hive_process is created, input of the process is a, b, b, d9, output of the process is
null, and the process could not be shown on atlas UI, according to the attached pic "failed_lineage.png"
and "failed_lineage_input_output.png"
> PS: We are working on fixing the issue!



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message