mxnet-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-mxnet] bgawrych commented on pull request #19308: [BUGFIX][1.8.x] Temporary fix for RNN with oneDNN seg faults/core dumps
Date Thu, 08 Oct 2020 06:26:54 GMT

bgawrych commented on pull request #19308:
URL: https://github.com/apache/incubator-mxnet/pull/19308#issuecomment-705359422


   Hey @szha @samskalicky Do you know what's wrong with unix-gpu CI on 1.8 branch ?
   This test is not related to my change and it's failing
   ```
   [2020-10-07T22:09:54.644Z] 
   [2020-10-07T22:09:54.644Z] ======================================================================
   [2020-10-07T22:09:54.644Z] FAIL: test_operator_gpu.test_np_mixed_precision_binary_funcs
   [2020-10-07T22:09:54.644Z] ----------------------------------------------------------------------
   [2020-10-07T22:09:54.644Z] Traceback (most recent call last):
   [2020-10-07T22:09:54.644Z]   File "/usr/local/lib/python3.5/dist-packages/nose/case.py",
line 198, in runTest
   [2020-10-07T22:09:54.644Z]     self.test(*self.arg)
   [2020-10-07T22:09:54.644Z]   File "/usr/local/lib/python3.5/dist-packages/nose/util.py",
line 620, in newfunc
   [2020-10-07T22:09:54.644Z]     return func(*arg, **kw)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/tests/python/gpu/../unittest/common.py",
line 218, in test_new
   [2020-10-07T22:09:54.644Z]     orig_test(*args, **kwargs)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/python/mxnet/util.py", line 297, in _with_np_shape
   [2020-10-07T22:09:54.644Z]     return func(*args, **kwargs)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/python/mxnet/util.py", line 481, in _with_np_array
   [2020-10-07T22:09:54.644Z]     return func(*args, **kwargs)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/tests/python/gpu/../unittest/test_numpy_op.py",
line 2607, in test_np_mixed_precision_binary_funcs
   [2020-10-07T22:09:54.644Z]     check_mixed_precision_binary_func(func, low, high, lshape,
rshape, lgrad, rgrad, type1, type2)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/tests/python/gpu/../unittest/test_numpy_op.py",
line 2550, in check_mixed_precision_binary_func
   [2020-10-07T22:09:54.644Z]     use_broadcast=False, equal_nan=True)
   [2020-10-07T22:09:54.644Z]   File "/work/mxnet/python/mxnet/test_utils.py", line 749, in
assert_almost_equal
   [2020-10-07T22:09:54.644Z]     raise AssertionError(msg)
   [2020-10-07T22:09:54.644Z] AssertionError: 
   [2020-10-07T22:09:54.644Z] Items are not equal:
   [2020-10-07T22:09:54.644Z] Error 1.732774 exceeds tolerance rtol=1.000000e-02, atol=1.000000e-03
(mismatch 16.666667%).
   [2020-10-07T22:09:54.644Z] Location of maximum error: (1, 1), a=0.00978292, b=0.01171875
   [2020-10-07T22:09:54.644Z]  ACTUAL: array([[0.77931417, 0.14845479, 0.22072042],
   [2020-10-07T22:09:54.644Z]        [1.27150167, 0.00978292, 1.49220479]])
   [2020-10-07T22:09:54.644Z]  DESIRED: array([[0.78125   , 0.15039062, 0.22265625],
   [2020-10-07T22:09:54.644Z]        [1.2734375 , 0.01171875, 1.49414062]])
   [2020-10-07T22:09:54.645Z] -------------------- >> begin captured stdout <<
---------------------
   [2020-10-07T22:09:54.645Z] 
   [2020-10-07T22:09:54.645Z] *** Maximum errors for vector of size 6:  rtol=0.01, atol=0.001
   [2020-10-07T22:09:54.645Z] 
   [2020-10-07T22:09:54.645Z]   1: Error 1.732774  Location of error: (1, 1), a=0.00978292,
b=0.01171875
   [2020-10-07T22:09:54.645Z] 
   [2020-10-07T22:09:54.645Z] --------------------- >> end captured stdout <<
----------------------
   [2020-10-07T22:09:54.645Z] -------------------- >> begin captured logging <<
--------------------
   [2020-10-07T22:09:54.645Z] common: WARNING: Error seen with seeded test, use MXNET_TEST_SEED=694743356
to reproduce.
   [2020-10-07T22:09:54.645Z] --------------------- >> end captured logging <<
---------------------
   [2020-10-07T22:09:54.645Z] 
   [2020-10-07T22:09:54.645Z] ----------------------------------------------------------------------
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



Mime
View raw message