atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramesh Mani (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-2525) Atlas Hbase/Hive hook improvement to provide import from file
Date Fri, 30 Mar 2018 18:53:00 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ramesh Mani updated ATLAS-2525:
-------------------------------
    Description: 
Atlas Hbase/Hive hook improvement to provide import from file

Hook script should have another option -f to accept a file which contains the database/table
in hive or namespace/table in hbase and import it into Atlas

Format can be JSON or CSV.

HIVE CASE:

 import-hive.sh -f <filename>: This can be JSON or CSV file 
{code:java}
{code:java}
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
database1,tbl1,tbl2,tbl3,..
database2,tbl1,tbl2,tbl3,..
JSON format:
{
"database1" :["tbl1","tbl2","tbl3",..]
"database2" :["tbl1","tbl2","tbl3",..]
}{code}
JSON format:

{ "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }

HBASE CASE:
{code:java}
import-hbase.sh [-t <filename>] : This can be JSON or CSV file
 cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
 JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
 {code}

  was:
Atlas Hbase/Hive hook improvement to provide import from file

Hook script should have another option -f to accept a file which contains the database/table
in hive or namespace/table in hbase and import it into Atlas

Format can be JSON or CSV.

HIVE CASE:


 import-hive.sh -f <filename>: This can be JSON or CSV file Imports all databases and
tables in the file... cvs format: namespace1,tbl1,tbl2,tbl3,.. namespace2,tbl1,tbl2,tbl3,..

{code:java}
{code:java}
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
database1,tbl1,tbl2,tbl3,..
database2,tbl1,tbl2,tbl3,..
JSON format:
{
"database1" :["tbl1","tbl2","tbl3",..]
"database2" :["tbl1","tbl2","tbl3",..]
}{code}

 JSON format:

{ "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }

HBASE CASE:
{code:java}
import-hbase.sh [-t <filename>] : This can be JSON or CSV file
 cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
 JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
 {code}


> Atlas Hbase/Hive hook improvement to provide import from file
> -------------------------------------------------------------
>
>                 Key: ATLAS-2525
>                 URL: https://issues.apache.org/jira/browse/ATLAS-2525
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk, 0.8.2
>            Reporter: Ramesh Mani
>            Assignee: Ramesh Mani
>            Priority: Major
>             Fix For: trunk, 0.8.2
>
>         Attachments: 0001-ATLAS-2525-Atlas-Hbase-Hive-hook-improvement-to-prov.patch
>
>
> Atlas Hbase/Hive hook improvement to provide import from file
> Hook script should have another option -f to accept a file which contains the database/table
in hive or namespace/table in hbase and import it into Atlas
> Format can be JSON or CSV.
> HIVE CASE:
>  import-hive.sh -f <filename>: This can be JSON or CSV file 
> {code:java}
> {code:java}
> import-hive.sh -f <filename>: This can be JSON or CSV file
> Imports all databases and tables in the file...
> cvs format:
> database1,tbl1,tbl2,tbl3,..
> database2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "database1" :["tbl1","tbl2","tbl3",..]
> "database2" :["tbl1","tbl2","tbl3",..]
> }{code}
> JSON format:
> { "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }
> HBASE CASE:
> {code:java}
> import-hbase.sh [-t <filename>] : This can be JSON or CSV file
>  cvs format:
> namespace1,tbl1,tbl2,tbl3,..
> namespace2,tbl1,tbl2,tbl3,..
>  JSON format:
> {
> "namespace1" :["tbl1","tbl2","tbl3",..]
> "namespace2" :["tbl1","tbl2","tbl3",..]
> }
> {code:java}
>  {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message