ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Beerbower <tbeerbo...@hortonworks.com>
Subject Re: Review Request 43820: Atlas Integration: Support Atlas / Falcon integration
Date Thu, 25 Feb 2016 01:16:26 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43820/
-----------------------------------------------------------

(Updated Feb. 25, 2016, 1:16 a.m.)


Review request for Ambari, Alejandro Fernandez, John Speidel, and Robert Levas.


Bugs: AMBARI-14922
    https://issues.apache.org/jira/browse/AMBARI-14922


Repository: ambari


Description
-------

Update Falcon configurations 

1.Add 'org.apache.falcon.atlas.service.AtlasService' to application.services in <falcon-conf>/startup.properties
2.Link falcon hook jars in falcon classpath - 'ln -s <atlas-home>/hook/falcon/* <falcon-home>/server/webapp/falcon/WEB-INF/lib/'
3.Copy <atlas-conf>/atlas-client.properties and <atlas-conf>/atlas-application.properties
to the falcon conf directory.

The following properties in <atlas-conf>/client.properties control the thread pool and
notification details:

1. atlas.hook.falcon.synchronous - boolean, true to run the hook synchronously. default false
2. atlas.hook.falcon.numRetries - number of retries for notification failure. default 3
3. atlas.hook.falcon.minThreads - core number of threads. default 5
4. atlas.hook.falcon.maxThreads - maximum number of threads. default 5
5. atlas.hook.falcon.keepAliveTime - keep alive time in msecs. default 10
6. atlas.hook.falcon.queueSize - queue size for the threadpool. default 10000

Also documented here: https://github.com/apache/incubator-atlas/blob/master/docs/src/site/twiki/Bridge-Falcon.twiki


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/configuration/application-properties.xml
ed9f1bc 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py
81ea39e 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
6b37451 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/FALCON/configuration/falcon-startup.properties.xml
4e4ec67 

Diff: https://reviews.apache.org/r/43820/diff/


Testing
-------

Manual test install of Atlas with Falcon through Ambari.

mvn clean test (pending)


Thanks,

Tom Beerbower


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message