flume-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avinash Kumar (Jira)" <j...@apache.org>
Subject [jira] [Updated] (FLUME-3361) Environment variables are not substituted/resolved if agent is configured via ZooKeeper
Date Thu, 26 Mar 2020 19:35:00 GMT

     [ https://issues.apache.org/jira/browse/FLUME-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Avinash Kumar updated FLUME-3361:
---------------------------------
    Description: 
Environment variables are not substituted/resolved during agent (re-)configuration if agent
is configured via ZooKeeper.

Steps to replicate the issue
 1) Create a znode having agent conf in the ZooKeeper path /flume/a1 . Relevant part of the
conf is shown below

{{cia.sources = accessLog}}
 {{cia.channels = channel}}
 {{cia.sinks = kafka}}
 {{cia.sources.accessLog.type = com.xyz.agent.LogSource}}
 {{cia.sources.accessLog.cid = $\{CUSTOMER_ID}}}

 

2) Add environment variable in _conf/flume-env.sh_ as shown below

{{export CUSTOMER_ID="AB123"}}

 

{{3) Start the agent}}
 {{./flume-ng agent -n a1 -c ../conf -z localhost:2182 -p /flume -DpropertiesImplementation=org.apache.flume.node.EnvVarResolverProperties}}

 

  was:
Environment variables are not substituted/resolved during agent (re-)configuration if agent
is configured via ZooKeeper.

Steps to replicate the issue
 1) Create a znode having agent conf in the ZooKeeper path /flume/a1 . Relevant part of the
conf is shown below

{{cia.sources = accessLog}}
{{cia.channels = channel}}
{{cia.sinks = kafka}}
{{cia.sources.accessLog.type = com.xyz.agent.LogSource}}
{{cia.sources.accessLog.cid = ${CUSTOMER_ID}}}

 

2) Add environment variable in _conf/flume-env.sh_ as shown below

{{{{export CUSTOMER_ID="AB123"}}}}

 

{{3) Start the agent}}
{{./flume-ng agent -n a1 -c ../conf -z localhost:2182 -p /flume -DpropertiesImplementation=org.apache.flume.node.EnvVarResolverProperties}}

 


> Environment variables are not substituted/resolved if agent is configured via ZooKeeper
> ---------------------------------------------------------------------------------------
>
>                 Key: FLUME-3361
>                 URL: https://issues.apache.org/jira/browse/FLUME-3361
>             Project: Flume
>          Issue Type: Bug
>          Components: Configuration
>    Affects Versions: 1.9.0
>            Reporter: Avinash Kumar
>            Priority: Major
>   Original Estimate: 10h
>  Remaining Estimate: 10h
>
> Environment variables are not substituted/resolved during agent (re-)configuration if
agent is configured via ZooKeeper.
> Steps to replicate the issue
>  1) Create a znode having agent conf in the ZooKeeper path /flume/a1 . Relevant part
of the conf is shown below
> {{cia.sources = accessLog}}
>  {{cia.channels = channel}}
>  {{cia.sinks = kafka}}
>  {{cia.sources.accessLog.type = com.xyz.agent.LogSource}}
>  {{cia.sources.accessLog.cid = $\{CUSTOMER_ID}}}
>  
> 2) Add environment variable in _conf/flume-env.sh_ as shown below
> {{export CUSTOMER_ID="AB123"}}
>  
> {{3) Start the agent}}
>  {{./flume-ng agent -n a1 -c ../conf -z localhost:2182 -p /flume -DpropertiesImplementation=org.apache.flume.node.EnvVarResolverProperties}}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org


Mime
View raw message