singa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wang Wei <wang...@comp.nus.edu.sg>
Subject Re: Caffe con Troll and SINGA?
Date Thu, 23 Jul 2015 03:49:14 GMT
On Thu, Jul 23, 2015 at 11:47 AM, Wang Wei <wangwei@comp.nus.edu.sg> wrote:

> Hi Ce,
>
> Thanks for starting the discussion.
>
> We are preparing documentations and test for our first Apache Incubator
> release.
> I planed to contact Stefan after the first release. Because the first
> release does not support GPU.
> There are some developers in NetEase working on GPU implementation, which
> will be integrated for the second release.
>
> It is a good time to discuss the integration now. We can consider this new
> feature while implementing the GPU version.
> Currently, we use Blob (from caffe) to manage memory and Mshadow for
> computation.
> To integerate Caffe on Troll, the ideal case is making Cafee on Troll a
> library like Mshadow.
> I think at least the convolution optimization techniques (lowering,
> multiply, lifting) could be compiled as a library (correct?).
>
> How do you manage the memory across CPU and GPU?
> How do you synchronize the parameters trained on CPU and GPU, using the
> implementation of Hogwild from Caffe?
> Which part of Caffe you have changed (we also borrow some code from Caffe,
> thus know its structure)?
>
> Thank you.
> (I cc'ed our dev-mailing list to notify the developers on GPU)
>
> Regards,
> Wei Wang
>
>
>
> On Thu, Jul 23, 2015 at 9:47 AM, Ce Zhang <czhang@cs.wisc.edu> wrote:
>
>> Hi Wei,
>>
>> I am Ce from Wisconsin and Chris Re's group.
>> I am one of the developer of Caffe con Troll
>> (the CNN system that is faster than Caffe on
>> CPU and can run hybrid between CPU and GPU)
>>
>> I think you and Stefan (CC'ed) chat at SIGMOD
>> about the possibility of integrating Caffe con Troll into
>> Apache SINGA. We are very excited about this!
>>
>> We are very curious about how to make this happen,
>> e.g., what information do you need from us to do
>> such an integration. This email aims at starting this
>> discussion, and we'd love to hear your opinions.
>>
>> Thanks!
>>
>> Ce
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message