singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-singa] chrishkchris commented on a change in pull request #468: Distributted module
Date Thu, 01 Aug 2019 05:32:49 GMT
chrishkchris commented on a change in pull request #468: Distributted module
URL: https://github.com/apache/incubator-singa/pull/468#discussion_r309496476
 
 

 ##########
 File path: src/CMakeLists.txt
 ##########
 @@ -36,6 +36,9 @@ AUX_SOURCE_DIRECTORY(core/scheduler core_source)
 AUX_SOURCE_DIRECTORY(core/tensor core_source)
 LIST(APPEND singa_sources ${core_source})
 
 
 Review comment:
   ```
   The build log is here:
   
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ rm -rf *
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ cmake -D CMAKE_PREFIX_PATH="/usr/local/cuda/lib64;/usr/local/cuda/"
-DENABLE_TEST=OFF -DUSE_CUDA=ON -DUSE_PYTHON3=ON -DUSE_MKLDNN=ON -DUSE_MODULES=OFF -DUSE_DIST=ON
..
   -- The C compiler identification is GNU 5.4.0
   -- The CXX compiler identification is GNU 5.4.0
   -- Check for working C compiler: /usr/bin/cc
   -- Check for working C compiler: /usr/bin/cc -- works
   -- Detecting C compiler ABI info
   -- Detecting C compiler ABI info - done
   -- Detecting C compile features
   -- Detecting C compile features - done
   -- Check for working CXX compiler: /usr/bin/c++
   -- Check for working CXX compiler: /usr/bin/c++ -- works
   -- Detecting CXX compiler ABI info
   -- Detecting CXX compiler ABI info - done
   -- Detecting CXX compile features
   -- Detecting CXX compile features - done
   -- Looking for pthread.h
   -- Looking for pthread.h - found
   -- Looking for pthread_create
   -- Looking for pthread_create - not found
   -- Looking for pthread_create in pthreads
   -- Looking for pthread_create in pthreads - not found
   -- Looking for pthread_create in pthread
   -- Looking for pthread_create in pthread - found
   -- Found Threads: TRUE
   -- Found Protobuf: /usr/local/lib/libprotobuf.so;-lpthread (found suitable version "3.0.0",
minimum required is "3.0")
   -- Found CBLAS: /usr/local/include
   -- Found GLOG: /usr/include
   -- Found cuda_v10.0
   -- Found CUDNN: /usr/local/cuda/include
   -- Found Cudnn_7401 at /usr/local/cuda/include /usr/local/cuda/lib64/libcudnn.so
   -- Found PythonInterp: /usr/bin/python3 (found suitable version "3.5.2", minimum required
is "3")
   -- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.5m.so (found suitable version
"3.5.2", minimum required is "3")
   -- Found SWIG: /usr/local/bin/swig (found suitable version "3.0.12", minimum required is
"3.0.10")
   -- Found MKLDNN at /usr/local/include
   -- Found MPI at /home/ubuntu/mpich-3.3/build/include
   -- Found MPI lib at /home/ubuntu/mpich-3.3/build/lib/libmpi.so
   -- Found all lib at /usr/local/lib/libprotobuf.so;/usr/local/lib/libopenblas.so;/usr/lib/x86_64-linux-gnu/libglog.so;/usr/local/cuda/lib64/libcudnn.so;/usr/local/cuda/lib64/libcudart.so;/usr/local/cuda/lib64/libcurand.so;/usr/local/cuda/lib64/libcublas.so;/home/ubuntu/incubator-singa/build/lib/libcnmem.a;/usr/local/lib/libmkldnn.so;/home/ubuntu/mpich-3.3/build/lib/libmpi.so;/home/ubuntu/mpich-3.3/build/lib/libmpicxx.so
   -- Found NCCL at /usr/local/cuda/include
   -- Found NCCL lib at /usr/local/cuda/lib/libnccl.so
   -- Configuring done
   -- Generating done
   -- Build files have been written to: /home/ubuntu/incubator-singa/build
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ make -j2
   Scanning dependencies of target cnmem
   Scanning dependencies of target copy_protobuf
   [  1%] Creating directories for 'cnmem'
   [  2%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/model.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: model.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [  3%] Performing download step (git clone) for 'cnmem'
   Cloning into 'cnmem'...
   [  4%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/caffe.proto
   [  5%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/core.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: core.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [  6%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/io.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: io.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a
syntax version. (Defaulted to proto2 syntax.)
   [  7%] Copying Protobuf headers
   [  7%] Built target copy_protobuf
   [  8%] Building NVCC (Device) object src/CMakeFiles/cuda_compile_1.dir/core/tensor/cuda_compile_1_generated_math_kernel.cu.o
   Scanning dependencies of target singa_objects
   [  9%] Building CXX object src/CMakeFiles/singa_objects.dir/caffe.pb.cc.o
   Already on 'master'
   Your branch is up-to-date with 'origin/master'.
   [ 10%] No patch step for 'cnmem'
   [ 11%] Performing update step for 'cnmem'
   Current branch master is up to date.
   [ 12%] Performing configure step for 'cnmem'
   -- The C compiler identification is GNU 5.4.0
   -- The CXX compiler identification is GNU 5.4.0
   -- Check for working C compiler: /usr/bin/cc
   -- Check for working C compiler: /usr/bin/cc -- works
   -- Detecting C compiler ABI info
   -- Detecting C compiler ABI info - done
   -- Detecting C compile features
   -- Detecting C compile features - done
   -- Check for working CXX compiler: /usr/bin/c++
   -- Check for working CXX compiler: /usr/bin/c++ -- works
   -- Detecting CXX compiler ABI info
   -- Detecting CXX compiler ABI info - done
   -- Detecting CXX compile features
   -- Detecting CXX compile features - done
   -- Looking for pthread.h
   -- Looking for pthread.h - found
   -- Looking for pthread_create
   -- Looking for pthread_create - not found
   -- Looking for pthread_create in pthreads
   -- Looking for pthread_create in pthreads - not found
   -- Looking for pthread_create in pthread
   -- Looking for pthread_create in pthread - found
   -- Found Threads: TRUE
   -- Configuring done
   -- Generating done
   -- Build files have been written to: /home/ubuntu/incubator-singa/build/cnmem-prefix/src/cnmem-build
   [ 13%] Performing build step for 'cnmem'
   Scanning dependencies of target cnmem
   [ 50%] Building CXX object CMakeFiles/cnmem.dir/src/cnmem.cpp.o
   [100%] Linking CXX static library libcnmem.a
   [100%] Built target cnmem
   [ 14%] Performing install step for 'cnmem'
   [100%] Built target cnmem
   Install the project...
   -- Install configuration: ""
   -- Installing: /home/ubuntu/incubator-singa/build/lib/libcnmem.a
   -- Installing: /home/ubuntu/incubator-singa/build/include/cnmem.h
   [ 15%] Completed 'cnmem'
   [ 15%] Built target cnmem
   [ 16%] Building CXX object src/CMakeFiles/singa_objects.dir/core.pb.cc.o
   [ 17%] Building CXX object src/CMakeFiles/singa_objects.dir/io.pb.cc.o
   [ 18%] Building CXX object src/CMakeFiles/singa_objects.dir/model.pb.cc.o
   [ 19%] Building CXX object src/CMakeFiles/singa_objects.dir/utils/channel.cc.o
   [ 20%] Building CXX object src/CMakeFiles/singa_objects.dir/utils/logging.cc.o
   [ 21%] Building CXX object src/CMakeFiles/singa_objects.dir/io/binfile_reader.cc.o
   [ 22%] Building CXX object src/CMakeFiles/singa_objects.dir/io/binfile_writer.cc.o
   [ 23%] Building CXX object src/CMakeFiles/singa_objects.dir/io/csv_decoder.cc.o
   [ 24%] Building CXX object src/CMakeFiles/singa_objects.dir/io/csv_encoder.cc.o
   [ 26%] Building CXX object src/CMakeFiles/singa_objects.dir/io/image_transformer.cc.o
   [ 26%] Building CXX object src/CMakeFiles/singa_objects.dir/io/jpg_decoder.cc.o
   [ 27%] Building CXX object src/CMakeFiles/singa_objects.dir/io/jpg_encoder.cc.o
   [ 28%] Building CXX object src/CMakeFiles/singa_objects.dir/io/lmdb_reader.cc.o
   [ 29%] Building CXX object src/CMakeFiles/singa_objects.dir/io/lmdb_writer.cc.o
   [ 30%] Building CXX object src/CMakeFiles/singa_objects.dir/io/snapshot.cc.o
   [ 31%] Building CXX object src/CMakeFiles/singa_objects.dir/io/textfile_reader.cc.o
   [ 32%] Building CXX object src/CMakeFiles/singa_objects.dir/io/textfile_writer.cc.o
   [ 34%] Building CXX object src/CMakeFiles/singa_objects.dir/io/network/endpoint.cc.o
   [ 35%] Building CXX object src/CMakeFiles/singa_objects.dir/io/network/message.cc.o
   [ 36%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/cpp_cpu.cc.o
   [ 37%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/cuda_gpu.cc.o
   [ 38%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/device.cc.o
   [ 39%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/opencl_device.cc.o
   [ 40%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/platform.cc.o
   [ 41%] Building CXX object src/CMakeFiles/singa_objects.dir/core/memory/memory.cc.o
   [ 42%] Building CXX object src/CMakeFiles/singa_objects.dir/core/scheduler/scheduler.cc.o
   [ 43%] Building CXX object src/CMakeFiles/singa_objects.dir/core/tensor/sparse_tensor.cc.o
   [ 44%] Building CXX object src/CMakeFiles/singa_objects.dir/core/tensor/tensor.cc.o
   [ 45%] Building CXX object src/CMakeFiles/singa_objects.dir/dist/communicator.cc.o
   In file included from /home/ubuntu/incubator-singa/src/dist/communicator.cc:6:0:
   /home/ubuntu/incubator-singa/include/singa/dist/communicator.h:28:1: warning: multi-line
comment [-Wcomment]
    // #define CUDACHECK(cmd) do {                         \
    ^
   [ 46%] Building CXX object src/CMakeFiles/singa_objects.dir/model/feed_forward_net.cc.o
   [ 47%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/activation.cc.o
   [ 48%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/batchnorm.cc.o
   [ 49%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/concat.cc.o
   [ 50%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/convolution.cc.o
   [ 51%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_activation.cc.o
   [ 52%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_batchnorm.cc.o
   [ 53%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_convolution.cc.o
   [ 54%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_dropout.cc.o
   [ 55%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_lrn.cc.o
   [ 56%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_pooling.cc.o
   [ 57%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_rnn.cc.o
   [ 58%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_softmax.cc.o
   [ 59%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/dense.cc.o
   [ 60%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/dropout.cc.o
   [ 61%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/flatten.cc.o
   [ 62%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/lrn.cc.o
   [ 63%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/merge.cc.o
   [ 64%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/opencl_convolution.cc.o
   [ 65%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/opencl_pooling.cc.o
   [ 67%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/pooling.cc.o
   [ 68%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/prelu.cc.o
   [ 69%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/rnn.cc.o
   [ 70%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/slice.cc.o
   [ 71%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/softmax.cc.o
   [ 72%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/split.cc.o
   [ 73%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/adagrad.cc.o
   [ 74%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/local_all_reduce.cc.o
   [ 75%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/nesterov.cc.o
   [ 76%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/optimizer.cc.o
   [ 77%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/rmsprop.cc.o
   [ 78%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/sgd.cc.o
   [ 79%] Building CXX object src/CMakeFiles/singa_objects.dir/model/loss/mse.cc.o
   [ 80%] Building CXX object src/CMakeFiles/singa_objects.dir/model/loss/softmax_cross_entropy.cc.o
   [ 81%] Building CXX object src/CMakeFiles/singa_objects.dir/model/metric/accuracy.cc.o
   [ 82%] Building CXX object src/CMakeFiles/singa_objects.dir/model/updater/local_updater.cc.o
   [ 83%] Building CXX object src/CMakeFiles/singa_objects.dir/model/updater/updater.cc.o
   [ 84%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/batchnorm.cc.o
   [ 85%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/convolution.cc.o
   [ 86%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/pooling.cc.o
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc: In function ‘singa::Tensor
singa::GpuPoolingForward(const singa::CudnnPoolingHandle&, const singa::Tensor&)’:
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::batchsize’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:31: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::batchsize’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                  ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::channels’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:46: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::channels’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                 ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_height’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:60: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_height’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                               ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_width’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:79: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_width’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                                                  ^
   [ 90%] Built target singa_objects
   Scanning dependencies of target singa
   [ 91%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/caffe.proto
   [ 92%] Linking CXX shared library ../lib/libsinga.so
   [ 93%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/core.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: core.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [ 94%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/io.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: io.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a
syntax version. (Defaulted to proto2 syntax.)
   [ 95%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/model.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: model.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   Scanning dependencies of target _singa_wrap
   [ 96%] Building CXX object python/CMakeFiles/_singa_wrap.dir/__/src/api/singa_wrap.cxx.o
   [ 97%] Built target singa
   In file included from /home/ubuntu/incubator-singa/build/src/api/singa_wrap.cxx:6920:0:
   /home/ubuntu/incubator-singa/include/singa/dist/communicator.h:28:1: warning: multi-line
comment [-Wcomment]
    // #define CUDACHECK(cmd) do {                         \
    ^
   [ 98%] Linking CXX shared library singa/_singa_wrap.so
   [100%] Built target _singa_wrap
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ cd python
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$ sudo pip3 uninstall singa
   The directory '/home/ubuntu/.cache/pip/http' or its parent directory is not owned by the
current user and the cache has been disabled. Please check the permissions and owner of that
directory. If executing pip with sudo, you may want sudo's -H flag.
   Uninstalling singa-1.2.0:
     Would remove:
       /usr/local/bin/singa
       /usr/local/lib/python3.5/dist-packages/rafiki/*
       /usr/local/lib/python3.5/dist-packages/singa-1.2.0-py3.5.egg-info
       /usr/local/lib/python3.5/dist-packages/singa/*
   Proceed (y/n)? y
     Successfully uninstalled singa-1.2.0
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$ sudo pip3 install .
   The directory '/home/ubuntu/.cache/pip/http' or its parent directory is not owned by the
current user and the cache has been disabled. Please check the permissions and owner of that
directory. If executing pip with sudo, you may want sudo's -H flag.
   The directory '/home/ubuntu/.cache/pip' or its parent directory is not owned by the current
user and caching wheels has been disabled. check the permissions and owner of that directory.
If executing pip with sudo, you may want sudo's -H flag.
   Processing /home/ubuntu/incubator-singa/build/python
   Installing collected packages: singa
     Running setup.py install for singa ... done
   Successfully installed singa-2.0.0
   You are using pip version 19.0.3, however version 19.2.1 is available.
   You should consider upgrading via the 'pip install --upgrade pip' command.
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$ sudo pip3 uninstall singa
   The directory '/home/ubuntu/.cache/pip/http' or its parent directory is not owned by the
current user and the cache has been disabled. Please check the permissions and owner of that
directory. If executing pip with sudo, you may want sudo's -H flag.
   Uninstalling singa-2.0.0:
     Would remove:
       /usr/local/bin/singa
       /usr/local/lib/python3.5/dist-packages/rafiki/*
       /usr/local/lib/python3.5/dist-packages/singa-2.0.0-py3.5.egg-info
       /usr/local/lib/python3.5/dist-packages/singa/*
   Proceed (y/n)? y
     Successfully uninstalled singa-2.0.0
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$ cd ..
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ rm -rf *
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ cmake -D CMAKE_PREFIX_PATH="/usr/local/cuda/lib64;/usr/local/cuda/"
-DENABLE_TEST=OFF -DUSE_CUDA=ON -DUSE_PYTHON3=ON -DUSE_MKLDNN=ON -DUSE_MODULES=OFF ..
   -- The C compiler identification is GNU 5.4.0
   -- The CXX compiler identification is GNU 5.4.0
   -- Check for working C compiler: /usr/bin/cc
   -- Check for working C compiler: /usr/bin/cc -- works
   -- Detecting C compiler ABI info
   -- Detecting C compiler ABI info - done
   -- Detecting C compile features
   -- Detecting C compile features - done
   -- Check for working CXX compiler: /usr/bin/c++
   -- Check for working CXX compiler: /usr/bin/c++ -- works
   -- Detecting CXX compiler ABI info
   -- Detecting CXX compiler ABI info - done
   -- Detecting CXX compile features
   -- Detecting CXX compile features - done
   -- Looking for pthread.h
   -- Looking for pthread.h - found
   -- Looking for pthread_create
   -- Looking for pthread_create - not found
   -- Looking for pthread_create in pthreads
   -- Looking for pthread_create in pthreads - not found
   -- Looking for pthread_create in pthread
   -- Looking for pthread_create in pthread - found
   -- Found Threads: TRUE
   -- Found Protobuf: /usr/local/lib/libprotobuf.so;-lpthread (found suitable version "3.0.0",
minimum required is "3.0")
   -- Found CBLAS: /usr/local/include
   -- Found GLOG: /usr/include
   -- Found cuda_v10.0
   -- Found CUDNN: /usr/local/cuda/include
   -- Found Cudnn_7401 at /usr/local/cuda/include /usr/local/cuda/lib64/libcudnn.so
   -- Found PythonInterp: /usr/bin/python3 (found suitable version "3.5.2", minimum required
is "3")
   -- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.5m.so (found suitable version
"3.5.2", minimum required is "3")
   -- Found SWIG: /usr/local/bin/swig (found suitable version "3.0.12", minimum required is
"3.0.10")
   -- Found MKLDNN at /usr/local/include
   -- Configuring done
   -- Generating done
   -- Build files have been written to: /home/ubuntu/incubator-singa/build
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ make -j2
   Scanning dependencies of target cnmem
   Scanning dependencies of target copy_protobuf
   [  2%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/model.proto
   [  2%] Creating directories for 'cnmem'
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: model.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [  3%] Performing download step (git clone) for 'cnmem'
   Cloning into 'cnmem'...
   [  4%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/caffe.proto
   [  5%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/core.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: core.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [  6%] Running C++ protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/io.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: io.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a
syntax version. (Defaulted to proto2 syntax.)
   [  7%] Copying Protobuf headers
   [  7%] Built target copy_protobuf
   [  8%] Building NVCC (Device) object src/CMakeFiles/cuda_compile_1.dir/core/tensor/cuda_compile_1_generated_math_kernel.cu.o
   Scanning dependencies of target singa_objects
   [  9%] Building CXX object src/CMakeFiles/singa_objects.dir/caffe.pb.cc.o
   Already on 'master'
   Your branch is up-to-date with 'origin/master'.
   [ 10%] No patch step for 'cnmem'
   [ 11%] Performing update step for 'cnmem'
   Current branch master is up to date.
   [ 12%] Performing configure step for 'cnmem'
   -- The C compiler identification is GNU 5.4.0
   -- The CXX compiler identification is GNU 5.4.0
   -- Check for working C compiler: /usr/bin/cc
   -- Check for working C compiler: /usr/bin/cc -- works
   -- Detecting C compiler ABI info
   -- Detecting C compiler ABI info - done
   -- Detecting C compile features
   -- Detecting C compile features - done
   -- Check for working CXX compiler: /usr/bin/c++
   -- Check for working CXX compiler: /usr/bin/c++ -- works
   -- Detecting CXX compiler ABI info
   -- Detecting CXX compiler ABI info - done
   -- Detecting CXX compile features
   -- Detecting CXX compile features - done
   -- Looking for pthread.h
   -- Looking for pthread.h - found
   -- Looking for pthread_create
   -- Looking for pthread_create - not found
   -- Looking for pthread_create in pthreads
   -- Looking for pthread_create in pthreads - not found
   -- Looking for pthread_create in pthread
   -- Looking for pthread_create in pthread - found
   -- Found Threads: TRUE
   -- Configuring done
   -- Generating done
   -- Build files have been written to: /home/ubuntu/incubator-singa/build/cnmem-prefix/src/cnmem-build
   [ 13%] Performing build step for 'cnmem'
   Scanning dependencies of target cnmem
   [ 50%] Building CXX object CMakeFiles/cnmem.dir/src/cnmem.cpp.o
   [100%] Linking CXX static library libcnmem.a
   [100%] Built target cnmem
   [ 14%] Performing install step for 'cnmem'
   [100%] Built target cnmem
   Install the project...
   -- Install configuration: ""
   -- Installing: /home/ubuntu/incubator-singa/build/lib/libcnmem.a
   -- Installing: /home/ubuntu/incubator-singa/build/include/cnmem.h
   [ 15%] Completed 'cnmem'
   [ 15%] Built target cnmem
   [ 16%] Building CXX object src/CMakeFiles/singa_objects.dir/core.pb.cc.o
   [ 17%] Building CXX object src/CMakeFiles/singa_objects.dir/io.pb.cc.o
   [ 18%] Building CXX object src/CMakeFiles/singa_objects.dir/model.pb.cc.o
   [ 19%] Building CXX object src/CMakeFiles/singa_objects.dir/utils/channel.cc.o
   [ 20%] Building CXX object src/CMakeFiles/singa_objects.dir/utils/logging.cc.o
   [ 21%] Building CXX object src/CMakeFiles/singa_objects.dir/io/binfile_reader.cc.o
   [ 22%] Building CXX object src/CMakeFiles/singa_objects.dir/io/binfile_writer.cc.o
   [ 23%] Building CXX object src/CMakeFiles/singa_objects.dir/io/csv_decoder.cc.o
   [ 25%] Building CXX object src/CMakeFiles/singa_objects.dir/io/csv_encoder.cc.o
   [ 26%] Building CXX object src/CMakeFiles/singa_objects.dir/io/image_transformer.cc.o
   [ 27%] Building CXX object src/CMakeFiles/singa_objects.dir/io/jpg_decoder.cc.o
   [ 28%] Building CXX object src/CMakeFiles/singa_objects.dir/io/jpg_encoder.cc.o
   [ 29%] Building CXX object src/CMakeFiles/singa_objects.dir/io/lmdb_reader.cc.o
   [ 30%] Building CXX object src/CMakeFiles/singa_objects.dir/io/lmdb_writer.cc.o
   [ 31%] Building CXX object src/CMakeFiles/singa_objects.dir/io/snapshot.cc.o
   [ 32%] Building CXX object src/CMakeFiles/singa_objects.dir/io/textfile_reader.cc.o
   [ 33%] Building CXX object src/CMakeFiles/singa_objects.dir/io/textfile_writer.cc.o
   [ 34%] Building CXX object src/CMakeFiles/singa_objects.dir/io/network/endpoint.cc.o
   [ 35%] Building CXX object src/CMakeFiles/singa_objects.dir/io/network/message.cc.o
   [ 36%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/cpp_cpu.cc.o
   [ 37%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/cuda_gpu.cc.o
   [ 38%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/device.cc.o
   [ 39%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/opencl_device.cc.o
   [ 40%] Building CXX object src/CMakeFiles/singa_objects.dir/core/device/platform.cc.o
   [ 41%] Building CXX object src/CMakeFiles/singa_objects.dir/core/memory/memory.cc.o
   [ 42%] Building CXX object src/CMakeFiles/singa_objects.dir/core/scheduler/scheduler.cc.o
   [ 43%] Building CXX object src/CMakeFiles/singa_objects.dir/core/tensor/sparse_tensor.cc.o
   [ 44%] Building CXX object src/CMakeFiles/singa_objects.dir/core/tensor/tensor.cc.o
   [ 45%] Building CXX object src/CMakeFiles/singa_objects.dir/model/feed_forward_net.cc.o
   [ 46%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/activation.cc.o
   [ 47%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/batchnorm.cc.o
   [ 48%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/concat.cc.o
   [ 50%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/convolution.cc.o
   [ 51%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_activation.cc.o
   [ 52%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_batchnorm.cc.o
   [ 53%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_convolution.cc.o
   [ 54%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_dropout.cc.o
   [ 55%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_lrn.cc.o
   [ 56%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_pooling.cc.o
   [ 57%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_rnn.cc.o
   [ 58%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/cudnn_softmax.cc.o
   [ 59%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/dense.cc.o
   [ 60%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/dropout.cc.o
   [ 61%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/flatten.cc.o
   [ 62%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/lrn.cc.o
   [ 63%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/merge.cc.o
   [ 64%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/opencl_convolution.cc.o
   [ 65%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/opencl_pooling.cc.o
   [ 66%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/pooling.cc.o
   [ 67%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/prelu.cc.o
   [ 68%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/rnn.cc.o
   [ 69%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/slice.cc.o
   [ 70%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/softmax.cc.o
   [ 71%] Building CXX object src/CMakeFiles/singa_objects.dir/model/layer/split.cc.o
   [ 72%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/adagrad.cc.o
   [ 73%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/local_all_reduce.cc.o
   [ 75%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/nesterov.cc.o
   [ 76%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/optimizer.cc.o
   [ 77%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/rmsprop.cc.o
   [ 78%] Building CXX object src/CMakeFiles/singa_objects.dir/model/optimizer/sgd.cc.o
   [ 79%] Building CXX object src/CMakeFiles/singa_objects.dir/model/loss/mse.cc.o
   [ 80%] Building CXX object src/CMakeFiles/singa_objects.dir/model/loss/softmax_cross_entropy.cc.o
   [ 81%] Building CXX object src/CMakeFiles/singa_objects.dir/model/metric/accuracy.cc.o
   [ 82%] Building CXX object src/CMakeFiles/singa_objects.dir/model/updater/local_updater.cc.o
   [ 83%] Building CXX object src/CMakeFiles/singa_objects.dir/model/updater/updater.cc.o
   [ 84%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/batchnorm.cc.o
   [ 85%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/convolution.cc.o
   [ 86%] Building CXX object src/CMakeFiles/singa_objects.dir/model/operation/pooling.cc.o
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc: In function ‘singa::Tensor
singa::GpuPoolingForward(const singa::CudnnPoolingHandle&, const singa::Tensor&)’:
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::batchsize’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:31: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::batchsize’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                  ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::channels’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:46: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::channels’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                 ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_height’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:60: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_height’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                               ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:220:51: warning: narrowing
conversion of ‘(int)(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_width’
from ‘int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
                             x.device(), x.data_type());
                                                      ^
   /home/ubuntu/incubator-singa/src/model/operation/pooling.cc:219:79: warning: narrowing
conversion of ‘(& cph)->singa::CudnnPoolingHandle::<anonymous>.singa::PoolingHandle::pooled_width’
from ‘const int’ to ‘long unsigned int’ inside { } [-Wnarrowing]
      Tensor output = Tensor({cph.batchsize, cph.channels, cph.pooled_height, cph.pooled_width},
                                                                                  ^
   [ 90%] Built target singa_objects
   [ 91%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/caffe.proto
   Scanning dependencies of target singa
   [ 92%] Linking CXX shared library ../lib/libsinga.so
   [ 93%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/core.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: core.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   [ 94%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/io.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: io.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a
syntax version. (Defaulted to proto2 syntax.)
   [ 95%] Running Python protocol buffer compiler on /home/ubuntu/incubator-singa/src/proto/model.proto
   [libprotobuf WARNING google/protobuf/compiler/parser.cc:547] No syntax specified for the
proto file: model.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify
a syntax version. (Defaulted to proto2 syntax.)
   Scanning dependencies of target _singa_wrap
   [ 96%] Building CXX object python/CMakeFiles/_singa_wrap.dir/__/src/api/singa_wrap.cxx.o
   [ 97%] Built target singa
   In file included from /home/ubuntu/incubator-singa/build/src/api/singa_wrap.cxx:6919:0:
   /home/ubuntu/incubator-singa/include/singa/dist/communicator.h:28:1: warning: multi-line
comment [-Wcomment]
    // #define CUDACHECK(cmd) do {                         \
    ^
   [ 98%] Linking CXX shared library singa/_singa_wrap.so
   [100%] Built target _singa_wrap
   ubuntu@ip-172-31-18-113:~/incubator-singa/build$ cd python
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$ sudo pip3 install .
   The directory '/home/ubuntu/.cache/pip/http' or its parent directory is not owned by the
current user and the cache has been disabled. Please check the permissions and owner of that
directory. If executing pip with sudo, you may want sudo's -H flag.
   The directory '/home/ubuntu/.cache/pip' or its parent directory is not owned by the current
user and caching wheels has been disabled. check the permissions and owner of that directory.
If executing pip with sudo, you may want sudo's -H flag.
   Processing /home/ubuntu/incubator-singa/build/python
   Installing collected packages: singa
     Running setup.py install for singa ... done
   Successfully installed singa-2.0.0
   You are using pip version 19.0.3, however version 19.2.1 is available.
   You should consider upgrading via the 'pip install --upgrade pip' command.
   ubuntu@ip-172-31-18-113:~/incubator-singa/build/python$
   
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message