mxnet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sheng Zha <szha....@gmail.com>
Subject Re: Release blocker: non-determinstic forward in gluon
Date Fri, 27 Jul 2018 00:33:02 GMT
Dear users and developers of Apache MXNet (Incubating),

Thanks to Tong's dedication, the root cause for this issue was identified
to be instability in OpenBLAS's latest stable version 0.3.1. For details,
see Tong's comment
<https://github.com/apache/incubator-mxnet/issues/11853#issuecomment-408272772>
.

Since both the nightly build and the 1.2.1 wheels are affected, we
recommend that we stay on OpenBLAS last known stable version 0.2.20 that
we've been using. I will assume lazy consensus and prepare the fix
(1.2.1.post0).

-sz

On Tue, Jul 24, 2018 at 3:35 PM, Tong He <the@apache.org> wrote:

> Recently there's an issue regarding the inconsistent result from gluon
> forward:
>
> https://github.com/apache/incubator-mxnet/issues/11853
>
> Given a constant input image and loaded pretrained parameters, we expect a
> deterministic output from arbitrary repeats of forwards. However from the
> issue I see that the forwarded result is non-determinstic. It is harmful as
> it makes the results from experments/benchmarks/inference meaningless.
>
> Therefore I propose to block the 1.3 release before it gets resolved.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message