ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Beerbower <tbeerbo...@hortonworks.com>
Subject Re: Review Request 43820: Atlas Integration: Support Atlas / Falcon integration
Date Mon, 22 Feb 2016 19:18:08 GMT


> On Feb. 22, 2016, 6:26 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py,
line 73
> > <https://reviews.apache.org/r/43820/diff/1/?file=1263868#file1263868line73>
> >
> >     Is this file new? If not, which versions of HDP does it affect?
> >     This may impact RU/EU.

Thanks for the review.

The Atlas configuration file has been renamed from application.properties to atlas-application.properties.
 I guess that this means that Ambari should really only apply this change for any new HDP
version (although Atlas isn't actually being used in production yet). 

Are you suggesting that this change should be made in a new stack definition?  If so, do I
simply copy this script with the change to the next HDP stack definition so that it overrides
the existing one in common-services?


- Tom


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43820/#review120169
-----------------------------------------------------------


On Feb. 22, 2016, 3:38 a.m., Tom Beerbower wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43820/
> -----------------------------------------------------------
> 
> (Updated Feb. 22, 2016, 3:38 a.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, John Speidel, and Robert Levas.
> 
> 
> Bugs: AMBARI-14922
>     https://issues.apache.org/jira/browse/AMBARI-14922
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Update Falcon configurations 
> 
> 1.Add 'org.apache.falcon.atlas.service.AtlasService' to application.services in <falcon-conf>/startup.properties
> 2.Link falcon hook jars in falcon classpath - 'ln -s <atlas-home>/hook/falcon/*
<falcon-home>/server/webapp/falcon/WEB-INF/lib/'
> 3.Copy <atlas-conf>/atlas-client.properties and <atlas-conf>/atlas-application.properties
to the falcon conf directory.
> 
> The following properties in <atlas-conf>/client.properties control the thread pool
and notification details:
> 
> 1. atlas.hook.falcon.synchronous - boolean, true to run the hook synchronously. default
false
> 2. atlas.hook.falcon.numRetries - number of retries for notification failure. default
3
> 3. atlas.hook.falcon.minThreads - core number of threads. default 5
> 4. atlas.hook.falcon.maxThreads - maximum number of threads. default 5
> 5. atlas.hook.falcon.keepAliveTime - keep alive time in msecs. default 10
> 6. atlas.hook.falcon.queueSize - queue size for the threadpool. default 10000
> 
> Also documented here: https://github.com/apache/incubator-atlas/blob/master/docs/src/site/twiki/Bridge-Falcon.twiki
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/configuration/application-properties.xml
ed9f1bc 
>   ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/metainfo.xml 719f92c

>   ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
6df47b0 
>   ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
9ba519f 
>   ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py
81ea39e 
>   ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
6b37451 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/FALCON/configuration/falcon-startup.properties.xml
4e4ec67 
> 
> Diff: https://reviews.apache.org/r/43820/diff/
> 
> 
> Testing
> -------
> 
> Manual test install of Atlas with Falcon through Ambari.
> 
> mvn clean test (pending)
> 
> 
> Thanks,
> 
> Tom Beerbower
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message