singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wang Wei <wang...@comp.nus.edu.sg>
Subject Re: Contribute
Date Mon, 28 Sep 2015 10:46:54 GMT
Hi Mohit,

On Mon, Sep 28, 2015 at 6:29 PM, Mohit Singh <mohit1007@gmail.com> wrote:

> Hi Wang Wei,
>       Thanks for quick response and sharing with the next release cycle.
> I  would be interested in:
> 1) Getting up to speed on machine learning algorithms part ( so feed
> forward networks or RNN etc)
>
For feed forward networks, SINGA has provided layers for implementing
AlexNet (imagene2012 paper), VGG (http://arxiv.org/pdf/1409.1556.pdf).
We need to implement some other layers to support the training of GoogleNet
(http://arxiv.org/abs/1409.4842).
For RNN, http://karpathy.github.io/2015/05/21/rnn-effectiveness/ is a good
application to work on. Both LSTM and GRU are on our plan.

I would suggest you to work on GRU and GoogleNet firstly.
You can follow the vanilla rnn example http://singa.apache.org/docs/rnn.html
to implement GRU.

2) Maybe looking into hdfs as input or output sources
>
We are going to use HDFS for storing large training datasets.
It has not yet been decided. Maybe some in-memory storage would be
considered.

> 3) Python bindings?
>
This is to create some wrappers for the Layer, NeuralNet, etc classes. Then
users can use python scripts to run the SINGA functions.
For example, after training, you can load the model parameters to extract
features by passing the data through the network using python scripts.

But right now, want to start by taking something very simple.
> So far, I have been able to build singa and run CIFAR example locally.
>
> Thanks
>
>
> On Mon, Sep 28, 2015 at 3:13 AM, Wang Wei <wangwei@comp.nus.edu.sg> wrote:
>
> > Hi Mohit,
> >
> > Thanks for your interest in SINGA.
> >
> > Attached is a schedule for our second release.
> > If you are interested in any topic/feature, then we can discuss in detail
> > on the development.
> >
> > Cheers,
> > Wei Wang
> >
> > On Mon, Sep 28, 2015 at 5:31 PM, Mohit Singh <mohit1007@gmail.com>
> wrote:
> >
> >> Hi,
> >>   I am new to C++ and deep learning..
> >> But want to learn both.
> >> How do I get started in contributing to singa.
> >>
> >> --
> >> Mohit
> >>
> >> "When you want success as badly as you want the air, then you will get
> it.
> >> There is no other secret of success."
> >> -Socrates
> >>
> >
> >
>
>
> --
> Mohit
>
> "When you want success as badly as you want the air, then you will get it.
> There is no other secret of success."
> -Socrates
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message