atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramesh Mani (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ATLAS-2525) Atlas Hbase/Hive hook improvement to provide import from file
Date Fri, 30 Mar 2018 01:27:00 GMT

     [ https://issues.apache.org/jira/browse/ATLAS-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ramesh Mani updated ATLAS-2525:
-------------------------------
    Affects Version/s: trunk
                       0.8.2

> Atlas Hbase/Hive hook improvement to provide import from file
> -------------------------------------------------------------
>
>                 Key: ATLAS-2525
>                 URL: https://issues.apache.org/jira/browse/ATLAS-2525
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk, 0.8.2
>            Reporter: Ramesh Mani
>            Assignee: Ramesh Mani
>            Priority: Major
>             Fix For: trunk, 0.8.2
>
>
> Atlas Hbase/Hive hook improvement to provide import from file
> Hook script should have another option -f to accept a file which contains the database/table
in hive or namespace/table in hbase and import it into Atlas
> Format can be JSON or CSV.
> HIVE CASE:
>  import-hive.sh -f <filename>: This can be JSON or CSV file Imports all databases
and tables in the file... cvs format: namespace1,tbl1,tbl2,tbl3,.. namespace2,tbl1,tbl2,tbl3,..
> {code:java}
> {code:java}
> import-hive.sh -f <filename>: This can be JSON or CSV file
> Imports all databases and tables in the file...
> cvs format:
> database1,tbl1,tbl2,tbl3,..
> database2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "database1" :["tbl1","tbl2","tbl3",..]
> "database2" :["tbl1","tbl2","tbl3",..]
> }{code}
>  JSON format:
> { "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2" :["tbl1","tbl2","tbl3",..] }
> HBASE CASE:
> {code:java}
> import-hbase.sh [-t <filename>] : This can be JSON or CSV file
>  cvs format:
> namespace1,tbl1,tbl2,tbl3,..
> namespace2,tbl1,tbl2,tbl3,..
>  JSON format:
> {
> "namespace1" :["tbl1","tbl2","tbl3",..]
> "namespace2" :["tbl1","tbl2","tbl3",..]
> }
> {code:java}
>  {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message