TestStatelessRecurrentSequential.test_n_step_forward_gpu is flaky

[muupan]

2019-09-17 15:58:06.381228 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py .F... [100%]
-- | --
2019-09-17 15:58:06.381228 STDOUT 2012] |  
2019-09-17 15:58:06.381229 STDOUT 2012] | =================================== FAILURES ===================================
2019-09-17 15:58:06.381230 STDOUT 2012] | ___________ TestStatelessRecurrentSequential.test_n_step_forward_gpu ___________
2019-09-17 15:58:06.381230 STDOUT 2012] |  
2019-09-17 15:58:06.381231 STDOUT 2012] | self = <test_stateless_recurrent_sequential.TestStatelessRecurrentSequential testMethod=test_n_step_forward_gpu>
2019-09-17 15:58:06.381232 STDOUT 2012] |  
2019-09-17 15:58:06.381232 STDOUT 2012] | @testing.attr.gpu
2019-09-17 15:58:06.381401 STDOUT 2012] | def test_n_step_forward_gpu(self):
2019-09-17 15:58:06.381470 STDOUT 2012] | >       self._test_n_step_forward(gpu=0)
2019-09-17 15:58:06.381472 STDOUT 2012] |  
2019-09-17 15:58:06.381561 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py:156:
2019-09-17 15:58:06.381563 STDOUT 2012] | _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2019-09-17 15:58:06.381565 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py:141: in _test_n_step_forward
2019-09-17 15:58:06.381566 STDOUT 2012] | man_seq_out.array, seq_out.array, rtol=1e-5)
2019-09-17 15:58:06.381575 STDOUT 2012] | _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2019-09-17 15:58:06.381576 STDOUT 2012] |  
2019-09-17 15:58:06.381577 STDOUT 2012] | actual = array([[ 2.2617858e-03,  6.3543685e-02,  4.2259894e-02,  1.5353611e-04,
2019-09-17 15:58:06.381578 STDOUT 2012] | 2.1527605e-03, -2.3726197e-02],
2019-09-17 15:58:06.381580 STDOUT 2012] | ...1.9148204e-01, -4.0073488e-02, -2.4744363e-01, -3.5417024e-03,
2019-09-17 15:58:06.381581 STDOUT 2012] | 9.9237107e-02,  2.0066814e-01]], dtype=float32)
2019-09-17 15:58:06.381668 STDOUT 2012] | desired = array([[ 2.2617877e-03,  6.3543677e-02,  4.2259891e-02,  1.5353378e-04,
2019-09-17 15:58:06.381670 STDOUT 2012] | 2.1527568e-03, -2.3726203e-02],
2019-09-17 15:58:06.381671 STDOUT 2012] | ...1.9148204e-01, -4.0073480e-02, -2.4744360e-01, -3.5416987e-03,
2019-09-17 15:58:06.381672 STDOUT 2012] | 9.9237107e-02,  2.0066817e-01]], dtype=float32)
2019-09-17 15:58:06.381674 STDOUT 2012] | rtol = 1e-05, atol = 0, err_msg = '', verbose = True
2019-09-17 15:58:06.381674 STDOUT 2012] |  
2019-09-17 15:58:06.381677 STDOUT 2012] | def assert_allclose(actual, desired, rtol=1e-7, atol=0, err_msg='',
2019-09-17 15:58:06.381679 STDOUT 2012] | verbose=True):
2019-09-17 15:58:06.381680 STDOUT 2012] | """Raises an AssertionError if objects are not equal up to desired tolerance.
2019-09-17 15:58:06.381681 STDOUT 2012] |  
2019-09-17 15:58:06.381682 STDOUT 2012] | Args:
2019-09-17 15:58:06.381703 STDOUT 2012] | actual(numpy.ndarray or cupy.ndarray): The actual object to check.
2019-09-17 15:58:06.381705 STDOUT 2012] | desired(numpy.ndarray or cupy.ndarray): The desired, expected object.
2019-09-17 15:58:06.381705 STDOUT 2012] | rtol(float): Relative tolerance.
2019-09-17 15:58:06.381768 STDOUT 2012] | atol(float): Absolute tolerance.
2019-09-17 15:58:06.381769 STDOUT 2012] | err_msg(str): The error message to be printed in case of failure.
2019-09-17 15:58:06.381770 STDOUT 2012] | verbose(bool): If ``True``, the conflicting
2019-09-17 15:58:06.381771 STDOUT 2012] | values are appended to the error message.
2019-09-17 15:58:06.381773 STDOUT 2012] |  
2019-09-17 15:58:06.381774 STDOUT 2012] | .. seealso:: :func:`numpy.testing.assert_allclose`
2019-09-17 15:58:06.381854 STDOUT 2012] |  
2019-09-17 15:58:06.381855 STDOUT 2012] | """  # NOQA
2019-09-17 15:58:06.381856 STDOUT 2012] | numpy.testing.assert_allclose(
2019-09-17 15:58:06.381857 STDOUT 2012] | cupy.asnumpy(actual), cupy.asnumpy(desired),
2019-09-17 15:58:06.381858 STDOUT 2012] | >           rtol=rtol, atol=atol, err_msg=err_msg, verbose=verbose)
2019-09-17 15:58:06.381860 STDOUT 2012] | E       AssertionError:
2019-09-17 15:58:06.381861 STDOUT 2012] | E       Not equal to tolerance rtol=1e-05, atol=0
2019-09-17 15:58:06.381862 STDOUT 2012] | E
2019-09-17 15:58:06.381891 STDOUT 2012] | E       Mismatch: 5.56%
2019-09-17 15:58:06.716341 STDOUT 2012] | E       Max absolute difference: 2.9802322e-08
2019-09-17 15:58:06.716346 STDOUT 2012] | E       Max relative difference: 1.5164783e-05
2019-09-17 15:58:06.716347 STDOUT 2012] | E        x: array([[ 2.261786e-03,  6.354368e-02,  4.225989e-02,  1.535361e-04,
2019-09-17 15:58:06.716349 STDOUT 2012] | E                2.152761e-03, -2.372620e-02],
2019-09-17 15:58:06.716350 STDOUT 2012] | E              [-1.342301e-02, -8.628035e-02,  2.457377e-02,  2.508903e-02,...
2019-09-17 15:58:06.716351 STDOUT 2012] | E        y: array([[ 2.261788e-03,  6.354368e-02,  4.225989e-02,  1.535338e-04,
2019-09-17 15:58:06.716353 STDOUT 2012] | E                2.152757e-03, -2.372620e-02],
2019-09-17 15:58:06.716354 STDOUT 2012] | E              [-1.342301e-02, -8.628035e-02,  2.457377e-02,  2.508903e-02,...
2019-09-17 15:58:06.716355 STDOUT 2012] |  
2019-09-17 15:58:06.716356 STDOUT 2012] | usr/local/lib/python3.5/dist-packages/cupy/testing/array.py:26: AssertionError