atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ayub Khan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ATLAS-536) Falcon hook loads incorrect configuration when -Datlas.conf is not given when falcon server startup. this needs to be documented.
Date Fri, 26 Feb 2016 09:26:18 GMT
Ayub Khan created ATLAS-536:
-------------------------------

             Summary: Falcon hook loads incorrect configuration when -Datlas.conf is not given
when falcon server startup. this needs to be documented.
                 Key: ATLAS-536
                 URL: https://issues.apache.org/jira/browse/ATLAS-536
             Project: Atlas
          Issue Type: Bug
    Affects Versions: trunk
            Reporter: Ayub Khan
            Priority: Critical
             Fix For: trunk


Problem:
Falcon server startup expects "-Datlas.conf=<path to atlas conf dir>" to read the atlas
configuration file(application.properties), if this is not provided, then falcon hook tries
to read the default values from the atlas-typesystem jar file. 

*Basically falcon hook depends on "atlas.rest.address" config option present in application.properties
to post the entity create/update to atlas. But in the above the scenario, when "atlas.conf"
option is not provided at falcon server startup, this will read the atlas.rest.address as
localhost which is incorrect and all the subsequent falcon hook updates will fail.*

This also needs to be documented.

Falcon applicaiton log showing the conf file is read from jar file which has default values
{noformat}
2016-02-25 08:29:13,131 INFO  - [main:] ~ Initiated backend operations thread pool of size
2 (Backend:148)
2016-02-25 08:29:13,510 INFO  - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
2016-02-25 08:29:13,510 INFO  - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
(MetadataMappingService:88)
2016-02-25 08:29:13,511 INFO  - [main:] ~ Init vertex property keys: [name, type, version,
timestamp] (MetadataMappingService:91)
2016-02-25 08:29:13,511 INFO  - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
2016-02-25 08:29:13,515 INFO  - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService
(ServiceInitializer:52)
2016-02-25 08:29:13,517 INFO  - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:45)
2016-02-25 08:29:13,522 INFO  - [main:] ~ Loading application.properties from jar:file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/lib/atlas-typesystem-0.6.0.2.3.99.0-196.jar!/application.properties
(ApplicationProperties:62)
2016-02-25 08:29:13,539 INFO  - [main:] ~ Loading client.properties from file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/classes/client.properties
(ApplicationProperties:62)
2016-02-25 08:29:13,914 INFO  - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket
cache? false (SecureClientUtils:90)
2016-02-25 08:29:13,915 INFO  - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
2016-02-25 08:29:14,780 INFO  - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
2016-02-25 08:29:14,780 INFO  - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:52)
2016-02-25 08:29:14,782 INFO  - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
2016-02-25 08:29:14,785 INFO  - [main:] ~ FalconAuthenticationFilter initialization started
(FalconAuthenticationFilter:83)
2016-02-25 08:29:14,802 INFO  - [main:] ~ Falcon is running with authorization enabled (FalconAuthorizationFilter:62)
{noformat}



Falcon application log showing conf file read from /etc/atlas/conf when -Datlas.conf is provided
{noformat}
2016-02-25 11:36:52,605 INFO  - [main:] ~ Initiated backend operations thread pool of size
2 (Backend:148)
2016-02-25 11:36:53,119 INFO  - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
2016-02-25 11:36:53,120 INFO  - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
(MetadataMappingService:88)
2016-02-25 11:36:53,122 INFO  - [main:] ~ Init vertex property keys: [name, type, version,
timestamp] (MetadataMappingService:91)
2016-02-25 11:36:53,123 INFO  - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
2016-02-25 11:36:53,128 INFO  - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService
(ServiceInitializer:52)
2016-02-25 11:36:53,130 INFO  - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:45)
2016-02-25 11:36:53,135 INFO  - [main:] ~ Loading application.properties from file:/etc/atlas/conf/application.properties
(ApplicationProperties:62)
2016-02-25 11:36:53,163 INFO  - [main:] ~ Loading client.properties from file:/etc/atlas/conf/client.properties
(ApplicationProperties:62)
2016-02-25 11:36:53,396 INFO  - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket
cache? false (SecureClientUtils:90)
2016-02-25 11:36:53,396 INFO  - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
2016-02-25 11:36:54,178 INFO  - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
2016-02-25 11:36:54,178 INFO  - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:52)
2016-02-25 11:36:54,180 INFO  - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
2016-02-25 11:36:54,184 INFO  - [main:] ~ FalconAuthenticationFilter initialization started
(FalconAuthenticationFilter:83)
2016-02-25 11:36:54,214 INFO  - [main:] ~ Falcon is running with authorization enabled (FalconAuthorizationFilter:62)
2016-02-25 11:36:55,389 INFO  - [main:] ~ Started SocketConnector@0.0.0.0:15000 (log:67)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message