Mailing-List: contact dev-help@commons.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Commons Developers List" <dev@commons.apache.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 8bit
Date: Sun, 04 Sep 2016 16:55:12 +0200
From: Gilles <gilles@harfang.homelinux.org>
To: <dev@commons.apache.org>
Subject: Re: [rng] Usefulness of benchmarks
In-Reply-To: <CAG3-T378rzpmiHoH7VVQLAZTRS=rDy_PDQiFLQ0mmbimvnVg2w@mail.gmail.com>
References: <5b81b5f61ad0f5a5cae8729e4f625c93@scarlet.be>
 <CAG3-T37082KX73CdXdOxUERdK=6gT=nDY3wSArcn6ZG5mAvaCw@mail.gmail.com>
 <cf02722afb928bc4c05f2a5a3dbe9f4f@scarlet.be>
 <76b550b1ea736639adc1f0f12e6b454b@scarlet.be>
 <CAG3-T37u+YN3NZ29KEWSpbjf2bkne=xUdJLcV73SJiNRZE4uGQ@mail.gmail.com>
 <7d20e446c588ac7c41e3f58fe875dd22@scarlet.be>
 <CAG3-T378rzpmiHoH7VVQLAZTRS=rDy_PDQiFLQ0mmbimvnVg2w@mail.gmail.com>
Message-ID: <92bf2a570d851a3edbdae55b35a33df2@scarlet.be>
User-Agent: Scarlet Webmail
X-DCC-scarlet.be-Metrics: eir; whitelist
X-Virus-Scanned: clamav-milter 0.98.1-exp at eir
X-Virus-Status: Clean
archived-at: Sun, 04 Sep 2016 14:49:03 -0000

Hi.

On Sun, 4 Sep 2016 15:20:39 +0300, Artem Barger wrote:
> On Sun, Sep 4, 2016 at 3:01 PM, Gilles <gilles@harfang.homelinux.org> 
> wrote:
>
>> "RandomStressTester" is in Commons _Rng_ "src/userguide" example
>> code, while I've just committed "RandomNumberGeneratorBenchmark"
>> in Commons _Math_ userguide examples (branch "develop").
>>
>> There is a README in "src/userguide"; basically, you'd run with a
>> command similar to:
>>
>>   $ mvn -q exec:java \
>>    
>> -Dexec.mainClass=org.apache.commons.math4.userguide.rng.RandomNumberGeneratorBenchmark
>> \
>>    -Dexec.args="MT ISAAC JDK"
>>
>> where the "exec.args" contains a list of "RandomSource" identifiers.
>>
>>
> ​I've ​got following results and they look similar to ones you have 
> in the
> table :/
>
> [...]
>

It seems that the behaviour changes with the number of generators
being tested. I don't know what to make out of that...

Personally, I think that these codes are so small/fast (wrt to
common use of Java) that such micro-benchmarking measurements
border to an exercise in futility.

Concerning the subject of this thread, I guess that we are back to
square one, i.e. no more knowledge about it was gathered here than
we had in December 2015, even though back then the benchmark score
was the sole argument put forward for constraining the design.

:-(


Regards,
Gilles


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org
For additional commands, e-mail: dev-help@commons.apache.org