ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-19847) Improve Log Feeder simulation to help scale testing
Date Fri, 03 Feb 2017 09:29:51 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851259#comment-15851259
] 

Hudson commented on AMBARI-19847:
---------------------------------

FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #894 (See [https://builds.apache.org/job/Ambari-branch-2.5/894/])
AMBARI-19847 Improve Log Feeder simulation to help scale testing (mgergely: [http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=25499712d21c9c1f3f4e20308fe1a0bad5d8de51])
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/util/LogFeederUtil.java
* (edit) ambari-logsearch/ambari-logsearch-logfeeder/src/main/java/org/apache/ambari/logfeeder/input/InputSimulate.java


> Improve Log Feeder simulation to help scale testing
> ---------------------------------------------------
>
>                 Key: AMBARI-19847
>                 URL: https://issues.apache.org/jira/browse/AMBARI-19847
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-logsearch
>    Affects Versions: 2.5.0
>            Reporter: Miklos Gergely
>            Assignee: Miklos Gergely
>             Fix For: 2.5.0
>
>
> Simulated Log Feeder input writes almost identical log messages, which is not really
simulates real logs.
> Instead of the logfeeder.simulate.log_message_size property there will be 3 new properties
(the simulated Log Feeders would enforce a minimum, and a maximum value, and also set a default
for them, if they are not specified):
> logfeeder.simulate.number_of_words - the number of different words that may appear in
the simulated logs (50 / 1000000, default 1000)
> logfeeder.simulate.min_log_words - the minimum number of words in a simulated log message
(1 / 10, default 5)
> logfeeder.simulate.max_log_words - the maximum number of words in a log message (10 /
20, default 10)
> After the parameters are set each logfeeder will start to load messages like this. In
each message all the words are different:
> Word000912 Word000903 Word000940 Word000760 Word000564 Word000762 Word000955 Word000553
> Word000320 Word000218 Word000872 Word000204 Word000120 Word000298 Word000727 Word000720
Word000475
> Word000413 Word000642 Word000872 Word000464 Word000746 Word000250
> The rest of the properties remain the same:
> logfeeder.simulate.input_number - number of paralell inputs (threads) loading the logs,
if it is set and not 0 then all the rest of the configured inputs are ignored (running in
simulation mode)!!
> logfeeder.simulate.log_ids - comma separated list of the log ids to propagate at random,
if not set by default all the available logs are propagated at random, example: storm_drpc,storm_logviewer,storm_nimbus
> logfeeder.simulate.log_level - the level of the simulated log messages, by default WARN
> logfeeder.simulate.sleep_milliseconds - the time interval at which each simulated inputs
writes one log message at random



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message