atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nixon Rodrigues (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-2276) Path value for hdfs_path type entity is set to lower case from hive-bridge.
Date Thu, 23 Nov 2017 10:11:00 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nixon Rodrigues updated ATLAS-2276:
-----------------------------------
    Description: 
Steps to reproduce:- 
* Create hive table with external file location
{code}
create external table hive_atlas_bug_test1 ( column1 int )
 LOCATION ‘/store/Hive_Atlas_Bug_Test1'
{code}

* Check the hdfs_path type entity created on hive, the path is set with lowercase.

While hive objects are case insensitive and hdfs paths are case sensitive.  
When hive table is created, the Atlas-hook's hive-bridge creates hdfs_path entities and sends
entity to Atlas server, the path value is stored in lowercase in Metadata store.

This will cause issues when other subsystems attempt to link lineage to atlas entities using
the proper case sensitive hdfs paths



  was:
Steps to reproduce:- 
* Create hive table with external file location
{code}
create external table hive_atlas_bug_test1 ( column1 int )
 LOCATION ‘/store/Hive_Atlas_Bug_Test'
{code}

* Check the hdfs_path type entity created on hive, the path is set with lowercase.

While hive objects are case insensitive and hdfs paths are case sensitive.  
When hive table is created, the Atlas-hook's hive-bridge creates hdfs_path entities and sends
entity to Atlas server, the path value is stored in lowercase in Metadata store.

This will cause issues when other subsystems attempt to link lineage to atlas entities using
the proper case sensitive hdfs paths




> Path value for hdfs_path type entity is set to lower case from hive-bridge.
> ---------------------------------------------------------------------------
>
>                 Key: ATLAS-2276
>                 URL: https://issues.apache.org/jira/browse/ATLAS-2276
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: 0.8-incubating
>            Reporter: Nixon Rodrigues
>            Assignee: Nixon Rodrigues
>             Fix For: trunk, 0.8.2
>
>         Attachments: upload.png
>
>
> Steps to reproduce:- 
> * Create hive table with external file location
> {code}
> create external table hive_atlas_bug_test1 ( column1 int )
>  LOCATION ‘/store/Hive_Atlas_Bug_Test1'
> {code}
> * Check the hdfs_path type entity created on hive, the path is set with lowercase.
> While hive objects are case insensitive and hdfs paths are case sensitive.  
> When hive table is created, the Atlas-hook's hive-bridge creates hdfs_path entities and
sends entity to Atlas server, the path value is stored in lowercase in Metadata store.
> This will cause issues when other subsystems attempt to link lineage to atlas entities
using the proper case sensitive hdfs paths



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message