atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ramesh Mani <rm...@hortonworks.com>
Subject Re: Review Request 67071: ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create hbase tables via hive
Date Thu, 10 May 2018 21:34:56 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67071/
-----------------------------------------------------------

(Updated May 10, 2018, 9:34 p.m.)


Review request for atlas, Madhan Neethiraj, Sarath Subramanian, and Sharmadha Sainath.


Bugs: ATLAS-2649
    https://issues.apache.org/jira/browse/ATLAS-2649


Repository: atlas


Description
-------

ATLAS-2649:Hive Hook should create lineage entities when storage handler mechanism to create
hbase tables via hive


Diffs
-----

  addons/hive-bridge/pom.xml 0d4ab2c 
  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java ca13812

  addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateTable.java 1c072e9



Diff: https://reviews.apache.org/r/67071/diff/1/


Testing
-------

Verify the lineage creation for
1) Hive Managed table without namespace (default)
2) Hive Managed table with namesapce
3) Hive External table from hbase table

CREATE TABLE hbase_table_emp19(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" =  "demo:emp19");

CREATE TABLE hbase_table_emp20(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" =  "emp20");

CREATE EXTERNAL TABLE hbase_table_empext2(id int, name string, role string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name,cf1:role")
TBLPROPERTIES ("hbase.table.name" =  "demo:emp17");


Thanks,

Ramesh Mani


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message