atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-536) Falcon hook loads incorrect configuration when -Datlas.conf is not given when falcon server startup. this needs to be documented.
Date Mon, 29 Feb 2016 05:37:18 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171430#comment-15171430
] 

Shwetha G S commented on ATLAS-536:
-----------------------------------

Looking at patch Adding_atlas_conf_path_to_falcon_server_opts.patch,
{quote}
 +   * <falcon_home>conf/falcon-env.sh, set an environment variable as follows:
{quote}
change to <falcon-conf>/falcon-env.sh as the conf may not be in home directory

{quote}
+     FALCON_SERVER_OPTS:"-Datlas.conf=<atlas_home>/conf/"
{quote}
change to exact export command. export FALCON_SERVER_OPTS="$FALCON_SERVER_OPTS -Datlas.conf=<atlas-conf>"



> Falcon hook loads incorrect configuration when -Datlas.conf is not given when falcon
server startup. this needs to be documented.
> ---------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-536
>                 URL: https://issues.apache.org/jira/browse/ATLAS-536
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk
>            Reporter: Ayub Khan
>            Assignee: Ayub Khan
>            Priority: Critical
>              Labels: patch
>             Fix For: trunk
>
>         Attachments: Adding_atlas_conf_path_to_falcon_server_opts-2.patch, Adding_atlas_conf_path_to_falcon_server_opts.patch
>
>
> Problem:
> Falcon server startup expects "-Datlas.conf=<path to atlas conf dir>" to read the
atlas configuration file(application.properties), if this is not provided, then falcon hook
tries to read the default values from the atlas-typesystem jar file. 
> *Basically falcon hook depends on "atlas.rest.address" config option present in application.properties
to post the entity create/update to atlas. But in the above the scenario, when "atlas.conf"
option is not provided at falcon server startup, this will read the atlas.rest.address as
localhost which is incorrect and all the subsequent falcon hook updates will fail.*
> This also needs to be documented.
> Falcon applicaiton log showing the conf file is read from jar file which has default
values
> {noformat}
> 2016-02-25 08:29:13,131 INFO  - [main:] ~ Initiated backend operations thread pool of
size 2 (Backend:148)
> 2016-02-25 08:29:13,510 INFO  - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
> 2016-02-25 08:29:13,510 INFO  - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
(MetadataMappingService:88)
> 2016-02-25 08:29:13,511 INFO  - [main:] ~ Init vertex property keys: [name, type, version,
timestamp] (MetadataMappingService:91)
> 2016-02-25 08:29:13,511 INFO  - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
> 2016-02-25 08:29:13,515 INFO  - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService
(ServiceInitializer:52)
> 2016-02-25 08:29:13,517 INFO  - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:45)
> 2016-02-25 08:29:13,522 INFO  - [main:] ~ Loading application.properties from jar:file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/lib/atlas-typesystem-0.6.0.2.3.99.0-196.jar!/application.properties
(ApplicationProperties:62)
> 2016-02-25 08:29:13,539 INFO  - [main:] ~ Loading client.properties from file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/classes/client.properties
(ApplicationProperties:62)
> 2016-02-25 08:29:13,914 INFO  - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket
cache? false (SecureClientUtils:90)
> 2016-02-25 08:29:13,915 INFO  - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
> 2016-02-25 08:29:14,780 INFO  - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
> 2016-02-25 08:29:14,780 INFO  - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:52)
> 2016-02-25 08:29:14,782 INFO  - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
> 2016-02-25 08:29:14,785 INFO  - [main:] ~ FalconAuthenticationFilter initialization started
(FalconAuthenticationFilter:83)
> 2016-02-25 08:29:14,802 INFO  - [main:] ~ Falcon is running with authorization enabled
(FalconAuthorizationFilter:62)
> {noformat}
> Falcon application log showing conf file read from /etc/atlas/conf when -Datlas.conf
is provided
> {noformat}
> 2016-02-25 11:36:52,605 INFO  - [main:] ~ Initiated backend operations thread pool of
size 2 (Backend:148)
> 2016-02-25 11:36:53,119 INFO  - [main:] ~ Indexes already exist for graph (MetadataMappingService:143)
> 2016-02-25 11:36:53,120 INFO  - [main:] ~ Initialized graph db: titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
(MetadataMappingService:88)
> 2016-02-25 11:36:53,122 INFO  - [main:] ~ Init vertex property keys: [name, type, version,
timestamp] (MetadataMappingService:91)
> 2016-02-25 11:36:53,123 INFO  - [main:] ~ Init edge property keys: [name] (MetadataMappingService:94)
> 2016-02-25 11:36:53,128 INFO  - [main:] ~ Service initialized: org.apache.falcon.metadata.MetadataMappingService
(ServiceInitializer:52)
> 2016-02-25 11:36:53,130 INFO  - [main:] ~ Initializing service: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:45)
> 2016-02-25 11:36:53,135 INFO  - [main:] ~ Loading application.properties from file:/etc/atlas/conf/application.properties
(ApplicationProperties:62)
> 2016-02-25 11:36:53,163 INFO  - [main:] ~ Loading client.properties from file:/etc/atlas/conf/client.properties
(ApplicationProperties:62)
> 2016-02-25 11:36:53,396 INFO  - [main:] ~ Real User: falcon (auth:SIMPLE), is from ticket
cache? false (SecureClientUtils:90)
> 2016-02-25 11:36:53,396 INFO  - [main:] ~ doAsUser: falcon (SecureClientUtils:93)
> 2016-02-25 11:36:54,178 INFO  - [main:] ~ Created Atlas Hook for Falcon (FalconHook:144)
> 2016-02-25 11:36:54,178 INFO  - [main:] ~ Service initialized: org.apache.falcon.atlas.service.AtlasService
(ServiceInitializer:52)
> 2016-02-25 11:36:54,180 INFO  - [main:] ~ FalconAuditFilter initialization started (FalconAuditFilter:49)
> 2016-02-25 11:36:54,184 INFO  - [main:] ~ FalconAuthenticationFilter initialization started
(FalconAuthenticationFilter:83)
> 2016-02-25 11:36:54,214 INFO  - [main:] ~ Falcon is running with authorization enabled
(FalconAuthorizationFilter:62)
> 2016-02-25 11:36:55,389 INFO  - [main:] ~ Started SocketConnector@0.0.0.0:15000 (log:67)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message