singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <>
Subject [jira] [Commented] (SINGA-324) Extend RNN layer to accept variant seq length across batches
Date Thu, 29 Jun 2017 11:16:00 GMT


ASF subversion and git services commented on SINGA-324:

Commit 9eea5b53f25319c0649138fc3059253f7c2efa38 in incubator-singa's branch refs/heads/master
from [~zhaojing]
[;h=9eea5b5 ]

Merge branch 'SINGA-324'

> Extend RNN layer to accept variant seq length across batches
> ------------------------------------------------------------
>                 Key: SINGA-324
>                 URL:
>             Project: Singa
>          Issue Type: Improvement
>            Reporter: wangwei
> The current RNN layer can accept samples with different length within one mini-batch,
however, it assumes that the longest samples of each mini-batch is the same, i.e. seq_length
is fixed.
> To make it more flexible, this ticket will extend the RNN layer to accept mini-batches
with different longest samples.
> In particular, we will set two variables, max_length_ and seq_length_, where the first
one is for the max seq length over all mini-batches, and the seq_length_ is the effective
seq length for the current mini-batch, which is updated based on the input data for every
iteration (mini-batch). The max_length_ is updated when max_length_ < seq_length_.

This message was sent by Atlassian JIRA

View raw message