atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suma Shivaprasad (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-641) Lineage for a view created from a view seems to be confusing(from user's perspective).
Date Thu, 09 Jun 2016 02:31:20 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suma Shivaprasad updated ATLAS-641:
-----------------------------------
    Fix Version/s:     (was: trunk)

> Lineage for a view created from a view seems to be confusing(from user's perspective).
> --------------------------------------------------------------------------------------
>
>                 Key: ATLAS-641
>                 URL: https://issues.apache.org/jira/browse/ATLAS-641
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk
>            Reporter: Ayub Khan
>
> Lineage for a table created from the view seems to be confusing(from user's perspective).
> Steps to reproduce:
> {noformat}
> 0: jdbc:hive2://localhost:10000/default>
> 0: jdbc:hive2://localhost:10000/default> create table src (x int, y int, s string);
> No rows affected (0.384 seconds)
> 0: jdbc:hive2://localhost:10000/default> create view view1 as select * from src;
> No rows affected (0.225 seconds)
> 0: jdbc:hive2://localhost:10000/default> create table view_table as select * from
view1;
> INFO  : Number of reduce tasks is set to 0 since there's no reduce operator
> INFO  : number of splits:1
> INFO  : Submitting tokens for job: job_local1883260823_0021
> INFO  : The url to track the job: http://localhost:8080/
> INFO  : Job running in-process (local Hadoop)
> INFO  : 2016-04-06 18:15:02,538 Stage-1 map = 100%,  reduce = 0%
> INFO  : Ended Job = job_local1883260823_0021
> INFO  : Stage-4 is selected by condition resolver.
> INFO  : Stage-3 is filtered out by condition resolver.
> INFO  : Stage-5 is filtered out by condition resolver.
> INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001
from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10003
> INFO  : Moving data to: hdfs://localhost:9000/user/hive/warehouse/view_table from hdfs://localhost:9000/user/hive/warehouse/.hive-staging_hive_2016-04-06_18-14-59_156_3909183228338665119-12/-ext-10001
> INFO  : Table default.view_table stats: [numFiles=1, numRows=0, totalSize=0, rawDataSize=0]
> No rows affected (3.8 seconds)
> 0: jdbc:hive2://localhost:10000/default> alter view view1 as select * from t2;
> No rows affected (0.602 seconds)
> 0: jdbc:hive2://localhost:10000/default>
> {noformat}
> Check the lineage of the resultant table(view_table).
> Link showing confusing lineage: https://monosnap.com/file/qaYZcJRQnNX5BsyM12hkryv70RZK1I



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message