singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ng Yi Sen (JIRA)" <>
Subject [jira] [Commented] (SINGA-341) Add stride field to Tensor class
Date Wed, 07 Mar 2018 07:20:00 GMT


Ng Yi Sen commented on SINGA-341:

Yi Sen is working on this issue.

> Add stride field to Tensor class
> --------------------------------
>                 Key: SINGA-341
>                 URL:
>             Project: Singa
>          Issue Type: Improvement
>            Reporter: wangwei
>            Priority: Major
> The current Tensor class stores data in a contiguous chunk of memory. It is a very simple
implementation. However, it is difficult to support some operations. For example,
> {code}
> Tensor a = b.transpose()
> Tensor d = a + c
> {code}
> Like other tensor implementation (e.g. numpy), Tensor a and b shares memory. The addition
operation has to do real transpose, which incurs some overhead. With stride, we can avoid
the transpose operation. Instead, we enumerate each element of a and c using the index, shape
and stride information.
> More over, stride is necessary for broadcasting operations. []
> Code in src/core/ tensor_math_cpp.h tensor_math_cuda.h needs modification when
stride is added as a field/member of Tensor.

This message was sent by Atlassian JIRA

View raw message