ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Miklos Gergely (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-19847) Improve Log Feeder simulation to help scale testing
Date Fri, 03 Feb 2017 08:59:51 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-19847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851239#comment-15851239
] 

Miklos Gergely commented on AMBARI-19847:
-----------------------------------------

committed to trunk:
{code:java}
commit 61f8f6d56937996ea7ca2f64b8961e83b72422fd
Author: Miklos Gergely <mgergely@hortonworks.com>
Date:   Fri Feb 3 09:56:10 2017 +0100

    AMBARI-19847 Improve Log Feeder simulation to help scale testing (mgergely)
    
    Change-Id: I8a53b3285b919523a929656c10d4d1215169fbab
{code}

committed to branch-2.5:
{code:java}
commit 25499712d21c9c1f3f4e20308fe1a0bad5d8de51
Author: Miklos Gergely <mgergely@hortonworks.com>
Date:   Fri Feb 3 09:57:22 2017 +0100

    AMBARI-19847 Improve Log Feeder simulation to help scale testing (mgergely)
    
    Change-Id: I7dd15fc114eb651d1e8b9d7182e853cc30828b2f
{code}


> Improve Log Feeder simulation to help scale testing
> ---------------------------------------------------
>
>                 Key: AMBARI-19847
>                 URL: https://issues.apache.org/jira/browse/AMBARI-19847
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-logsearch
>    Affects Versions: 2.5.0
>            Reporter: Miklos Gergely
>            Assignee: Miklos Gergely
>             Fix For: 2.5.0
>
>
> Simulated Log Feeder input writes almost identical log messages, which is not really
simulates real logs.
> Instead of the logfeeder.simulate.log_message_size property there will be 3 new properties
(the simulated Log Feeders would enforce a minimum, and a maximum value, and also set a default
for them, if they are not specified):
> logfeeder.simulate.number_of_words - the number of different words that may appear in
the simulated logs (50 / 1000000, default 1000)
> logfeeder.simulate.min_log_words - the minimum number of words in a simulated log message
(1 / 10, default 5)
> logfeeder.simulate.max_log_words - the maximum number of words in a log message (10 /
20, default 10)
> After the parameters are set each logfeeder will start to load messages like this. In
each message all the words are different:
> Word000912 Word000903 Word000940 Word000760 Word000564 Word000762 Word000955 Word000553
> Word000320 Word000218 Word000872 Word000204 Word000120 Word000298 Word000727 Word000720
Word000475
> Word000413 Word000642 Word000872 Word000464 Word000746 Word000250
> The rest of the properties remain the same:
> logfeeder.simulate.input_number - number of paralell inputs (threads) loading the logs,
if it is set and not 0 then all the rest of the configured inputs are ignored (running in
simulation mode)!!
> logfeeder.simulate.log_ids - comma separated list of the log ids to propagate at random,
if not set by default all the available logs are propagated at random, example: storm_drpc,storm_logviewer,storm_nimbus
> logfeeder.simulate.log_level - the level of the simulated log messages, by default WARN
> logfeeder.simulate.sleep_milliseconds - the time interval at which each simulated inputs
writes one log message at random



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message