atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suma Shivaprasad (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (ATLAS-653) insert into local dir, load from local dir does not show up in lineage
Date Tue, 19 Apr 2016 01:57:25 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15246962#comment-15246962
] 

Suma Shivaprasad edited comment on ATLAS-653 at 4/19/16 1:56 AM:
-----------------------------------------------------------------

The challenge here with modelling as local FS paths is , if local paths are captured w/o any
host/ip and ownership info(owner, group etc), they  would be useless information in any lineage.
It is not possible to capture this on the hook from HiveServer since this information is not
captured by hive. 


was (Author: suma.shivaprasad):
The challenge here with modelling as local FS paths is , if local paths are captured w/o any
host/ip and ownership info(owner, group etc), they  would be useless information in any lineage.
It is not possible to do this on the hook from HiveServer since this information is not captured
by hive server and can only be done when captured through hive client.

> insert into local dir, load from local dir does not show up in lineage
> ----------------------------------------------------------------------
>
>                 Key: ATLAS-653
>                 URL: https://issues.apache.org/jira/browse/ATLAS-653
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: 0.7-incubating
>            Reporter: Suma Shivaprasad
>            Assignee: Suma Shivaprasad
>             Fix For: 0.7-incubating
>
>
> All the above commands do not show up in lineage since they dont have any input entities
registered.
> Local FS Paths can be modelled without any unique paths/attributes and can be displayed
in lineage



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message