ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Beerbower <tbeerbo...@hortonworks.com>
Subject Review Request 43291: Atlas Integration : Support Atlas / Sqoop integration
Date Sat, 06 Feb 2016 21:42:07 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43291/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, John Speidel, and Robert Levas.


Bugs: AMBARI-14921
    https://issues.apache.org/jira/browse/AMBARI-14921


Repository: ambari


Description
-------

Follow these instructions in your sqoop set-up to add sqoop hook for Atlas.

1 In sqoop-site.xml:
 - Sqoop Job publisher class.  Currently only one publishing class is supported
  - sqoop.job.data.publish.class:org.apache.atlas.sqoop.hook.SqoopHook
 - Atlas cluster name
  - atlas.cluster.name:<clustername>

2 Copy <atlas-conf>/atlas-application.properties and <atlas-conf>/client.properties
to to the sqoop conf directory <sqoop-conf>/
3 Link <atlas-home>/hook/sqoop/*.jar in sqoop lib

Also documented here: https://github.com/apache/incubator-atlas/blob/master/docs/src/site/twiki/Bridge-Sqoop.twiki


Diffs
-----

  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/configuration/sqoop-site.xml
PRE-CREATION 
  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/metainfo.xml b5db91b 
  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py
3a3f93e 
  ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/sqoop.py
66a5ee4 
  ambari-server/src/test/python/stacks/2.0.6/SQOOP/test_sqoop.py 5a10305 
  ambari-server/src/test/python/stacks/2.0.6/configs/default.json cb34098 
  ambari-server/src/test/python/stacks/2.0.6/configs/secured.json d673973 
  ambari-server/src/test/python/stacks/2.3/configs/default.json a36455c 

Diff: https://reviews.apache.org/r/43291/diff/


Testing
-------

Manual test install Atlas and Sqoop.  Confirm configuration and dependencies.

mvn clean test


Thanks,

Tom Beerbower


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message