mxnet-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [incubator-mxnet] IvyBazan commented on a change in pull request #15517: Tensor Inspector Tutorial
Date Fri, 19 Jul 2019 00:55:55 GMT
IvyBazan commented on a change in pull request #15517: Tensor Inspector Tutorial

 File path: docs/faq/
 @@ -0,0 +1,168 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements.  See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership.  The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License.  You may obtain a copy of the License at -->
+<!--- -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- KIND, either express or implied.  See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+# Use TensorInspector to Help Debug Operators
+## Introduction
+When developing new operators, developers need to deal with tensor objects extensively. This
new utility, Tensor Inspector, mainly aims to help developers debug by providing unified interfaces
to print, check, and dump the tensor value. To developers' convenience, this utility works
for all the three data types: Tensors, TBlobs, and NDArrays. Also, it supports both CPU and
GPU tensors.
+## Usage 
+This utility is located in `src/common/tensor_inspector.h`. To use it in any operator code,
just include `tensor_inspector`, construct an `TensorInspector` object, and call the APIs
on that object. You can run any script that uses the operator you just modified then.
+The screenshot below shows a sample usage in `src/operator/nn/convolution-inl.h`.
+![Screen Shot 2019-07-08 at 5 03 46 PM](
+## Functionalities/APIs
+### Create a TensorInspector Object from Tensor, TBlob, and NDArray Objects
+You can create a `TensorInspector` object by passing in two things: 1) an object of type
`Tensor`, `Tbob`, or `NDArray`, and 2) an `RunContext` object.
+Essentially, `TensorInspector` can be understood as a wrapper class around `TBlob`. Internally,
the `Tensor`, `Tbob`, or `NDArray` object that you passed in will be converted to a `TBlob`
object. The `RunContext` object is used when the the tensor is a GPU tensor; in such a case,
we need to use the context information to copy the data from GPU memory to CPU/main memory.
+Below are the three constructors:
+// Construct from Tensor object
+template<typename Device, int dimension, typename DType MSHADOW_DEFAULT_DTYPE>
+TensorInspector(const  mshadow::Tensor<Device, dimension, DType>& ts, const RunContext&
+// Construct from TBlob object
+TensorInspector(const TBlob& tb, const RunContext& ctx);
+// Construct from NDArray object
+TensorInspector(const NDArray& arr, const RunContext& ctx):
+### Print Tensor Value (Static) 
+To print out the tensor value in a nicely structured way,  you can use this API:
+void print_string();
+This API will print the entire tensor to `std::cout` and preserve the shape (it supports
all dimensions from 1 and up). You can copy the output and interpret it with any `JSON` loader.
Also, on the last line of the output you can find some useful information about the tensor.
Refer to the case below, we are able to know that this is a float-typed tensor with shape
 Review comment:
   Suggested edit for clarity and flow: "You can find some useful information about the tensor
on the last line of the output."

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

View raw message