This repository was archived by the owner on Nov 17, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 6.8k
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
Two C++ unit test failing ACTIVATION_PERF.ExecuteBidirectional ACTIVATION_PERF.TimingCPU #13333
Copy link
Copy link
Closed
Labels
Description
Description
C++ unit tests failing on CPU without MKL
ACTIVATION_PERF.ExecuteBidirectional ACTIVATION_PERF.TimingCPU
ACTIVATION_PERF.TimingCPU
Environment info (Required)
----------Python Info----------
Version : 3.5.2
Compiler : GCC 5.4.0 20160609
Build : ('default', 'Nov 23 2017 16:37:01')
Arch : ('32bit', 'ELF')
------------Pip Info-----------
Version : 18.1
Directory : /home/piotr/devel/mxnet/mxnet_py3/lib/python3.5/site-packages/pip
----------MXNet Info-----------
Version : 1.3.1
Directory : /home/piotr/devel/mxnet/python/mxnet
Hashtag not found. Not installed from pre-built package.
----------System Info----------
Platform : Linux-3.4.113-sun7i-armv7l-with-Ubuntu-16.04-xenial
system : Linux
node : bananapipro
release : 3.4.113-sun7i
version : #16 SMP PREEMPT Wed Jan 24 19:20:59 CET 2018
----------Hardware Info----------
machine : armv7l
processor : armv7l
Architecture: armv7l
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
CPU max MHz: 1008.0000
CPU min MHz: 60.0000
Hypervisor vendor: (null)
Virtualization type: full
----------Network Test----------
Setting timeout: 10
Timing for Gluon Tutorial(cn): https://zh.gluon.ai, DNS: 0.2887 sec, LOAD: 1.0031 sec.
Timing for FashionMNIST: https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0704 sec, LOAD: 1.3277 sec.
Timing for Gluon Tutorial(en): http://gluon.mxnet.io, DNS: 0.0747 sec, LOAD: 1.0667 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0291 sec, LOAD: 0.8247 sec.
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0304 sec, LOAD: 0.8775 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0290 sec, LOAD: 0.5141 sec.
Package used (Python/R/Scala/Julia):
sef compiled
Build info (Required if built from source)
#!/bin/bash
set -ex
mkdir -p build && cd build
cmake \
-DUSE_SSE=OFF \
-DUSE_CUDA=OFF \
-DUSE_OPENCV=ON \
-DUSE_OPENMP=ON \
-DCMAKE_CXX_COMPILER_LAUNCHER=ccache \
-DCMAKE_C_COMPILER_LAUNCHER=ccache \
-DCMAKE_C_COMPILER=gcc-5 \
-DCMAKE_CXX_COMPILER=g++-5 \
-DUSE_MKL_IF_AVAILABLE=OFF \
-DUSE_SIGNAL_HANDLER=ON \
-DCMAKE_BUILD_TYPE=Debug \
-GNinja ..
ninja -j1
MXNet commit hash:
64657c2
Error Message:
[ PASSED ] 80 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] ACTIVATION_PERF.ExecuteBidirectional
[ FAILED ] ACTIVATION_PERF.TimingCPU
[ RUN ] ACTIVATION_PERF.ExecuteBidirectional
unknown file: Failure
C++ exception with description "[00:14:32] ../src/operator/nn/./activation-inl.h:207: Check failed: inputs.size() == softsign ? 3U : 2U (3 vs. 2)
Stack trace returned 10 entries:
[bt] (0) tests/mxnet_unit_tests(dmlc::StackTrace[abi:cxx11](unsigned int)+0x63) [0x13939f8]
[bt] (1) tests/mxnet_unit_tests(dmlc::LogMessageFatal::~LogMessageFatal()+0x2f) [0x1393c60]
[bt] (2) tests/mxnet_unit_tests(void mxnet::op::ActivationGradCompute<mshadow::cpu>(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::v
ector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)+0xcb) [0x4665ec4]
[bt] (3) tests/mxnet_unit_tests(std::_Function_handler<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType,
std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&), void (*)(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::alloc
ator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::_M_invoke(std::_Any_data const&, nn
vm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::
TBlob, std::allocator<mxnet::TBlob> > const&)+0x4d) [0x1757386]
[bt] (4) tests/mxnet_unit_tests(std::function<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::all
ocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::operator()(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<m
xnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&) const+0x5d) [0x13a016a]
[bt] (5) tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::Execute()+0x14f) [0x13a47a0]
[bt] (6) tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::ExecuteBackward()+0x14f) [0x13a4b7c]
[bt] (7) tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::backward(unsigned int)+0x99) [0x13bac0a]
[bt] (8) tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunGenericOperatorBackward(mxnet::test::op::OpInfo<mxnet::test::op
::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >*, unsigned int)+0xa9) [0x13ad7ae]
[bt] (9) tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunBidirectional(bool, std::vector<nnvm::TShape, std::allocator<nn
vm::TShape> > const&, std::vector<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >
>, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > > const&,
unsigned int)+0x5b) [0x13a4db8]
Minimum reproducible example
(mxnet_py3) piotr@bananapipro:0:~/devel/mxnet (master)+$ build/tests/mxnet_unit_tests --gtest_filter="ACTIVATION_PERF.ExecuteBidirectional"
Note: Google Test filter = ACTIVATION_PERF.ExecuteBidirectional
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from ACTIVATION_PERF
[ RUN ] ACTIVATION_PERF.ExecuteBidirectional
unknown file: Failure
C++ exception with description "[09:30:57] ../src/operator/nn/./activation-inl.h:207: Check failed: inputs.size() == softsign ? 3U : 2U (3 vs. 2)
Stack trace returned 10 entries:
[bt] (0) build/tests/mxnet_unit_tests(dmlc::StackTrace[abi:cxx11](unsigned int)+0x63) [0x13939f8]
[bt] (1) build/tests/mxnet_unit_tests(dmlc::LogMessageFatal::~LogMessageFatal()+0x2f) [0x1393c60]
[bt] (2) build/tests/mxnet_unit_tests(void mxnet::op::ActivationGradCompute<mshadow::cpu>(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)+0xcb) [0x4665ec4]
[bt] (3) build/tests/mxnet_unit_tests(std::_Function_handler<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&), void (*)(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::_M_invoke(std::_Any_data const&, nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)+0x4d) [0x1757386]
[bt] (4) build/tests/mxnet_unit_tests(std::function<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::operator()(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&) const+0x5d) [0x13a016a]
[bt] (5) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::Execute()+0x14f) [0x13a47a0]
[bt] (6) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::ExecuteBackward()+0x14f) [0x13a4b7c]
[bt] (7) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::backward(unsigned int)+0x99) [0x13bac0a]
[bt] (8) build/tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunGenericOperatorBackward(mxnet::test::op::OpInfo<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >*, unsigned int)+0xa9) [0x13ad7ae]
[bt] (9) build/tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunBidirectional(bool, std::vector<nnvm::TShape, std::allocator<nnvm::TShape> > const&, std::vector<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > > const&, unsigned int)+0x5b) [0x13a4db8]
" thrown in the test body.
[ FAILED ] ACTIVATION_PERF.ExecuteBidirectional (294 ms)
[----------] 1 test from ACTIVATION_PERF (294 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (296 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ACTIVATION_PERF.ExecuteBidirectional
1 FAILED TEST
(mxnet_py3) piotr@bananapipro:1:~/devel/mxnet (master)+$ build/tests/mxnet_unit_tests --gtest_filter="ACTIVATION_PERF.TimingCPU"
Note: Google Test filter = ACTIVATION_PERF.TimingCPU
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from ACTIVATION_PERF
[ RUN ] ACTIVATION_PERF.TimingCPU
unknown file: Failure
C++ exception with description "[09:31:32] ../src/operator/nn/./activation-inl.h:207: Check failed: inputs.size() == softsign ? 3U : 2U (3 vs. 2)
Stack trace returned 10 entries:
[bt] (0) build/tests/mxnet_unit_tests(dmlc::StackTrace[abi:cxx11](unsigned int)+0x63) [0x13939f8]
[bt] (1) build/tests/mxnet_unit_tests(dmlc::LogMessageFatal::~LogMessageFatal()+0x2f) [0x1393c60]
[bt] (2) build/tests/mxnet_unit_tests(void mxnet::op::ActivationGradCompute<mshadow::cpu>(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)+0xcb) [0x4665ec4]
[bt] (3) build/tests/mxnet_unit_tests(std::_Function_handler<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&), void (*)(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::_M_invoke(std::_Any_data const&, nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)+0x4d) [0x1757386]
[bt] (4) build/tests/mxnet_unit_tests(std::function<void (nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&)>::operator()(nnvm::NodeAttrs const&, mxnet::OpContext const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&, std::vector<mxnet::OpReqType, std::allocator<mxnet::OpReqType> > const&, std::vector<mxnet::TBlob, std::allocator<mxnet::TBlob> > const&) const+0x5d) [0x13a016a]
[bt] (5) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::Execute()+0x14f) [0x13a47a0]
[bt] (6) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::ExecuteBackward()+0x14f) [0x13a4b7c]
[bt] (7) build/tests/mxnet_unit_tests(mxnet::test::op::CoreOpExecutor<float, float>::backward(unsigned int)+0x99) [0x13bac0a]
[bt] (8) build/tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunGenericOperatorBackward(mxnet::test::op::OpInfo<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >*, unsigned int)+0xa9) [0x13ad7ae]
[bt] (9) build/tests/mxnet_unit_tests(mxnet::test::OperatorRunner<mxnet::test::op::CoreOpProp, mxnet::test::op::CoreOpExecutor<float, float> >::RunBidirectional(bool, std::vector<nnvm::TShape, std::allocator<nnvm::TShape> > const&, std::vector<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > > const&, unsigned int)+0x5b) [0x13a4db8]
" thrown in the test body.
[ FAILED ] ACTIVATION_PERF.TimingCPU (385 ms)
[----------] 1 test from ACTIVATION_PERF (386 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (388 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ACTIVATION_PERF.TimingCPU
1 FAILED TEST
Steps to reproduce
Can be reproduced in QEMU:
ci/build.py -p armv7
ci/build.py -p test.arm_qemu -b && docker run -p2222:2222 -ti mxnetci/build.test.arm_qemu
# In another terminal
rsync -e 'ssh -p2222' -vaP build/mxnet-1.3.1-py2.py3-none-any.whl build/tests/mxnet_unit_tests qemu@localhost:
ssh -p2222 qemu@localhost
$ ./mxnet_unit_tests --gtest_filter="ACTIVATION_PERF.ExecuteBidirectional"