horn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Google Tensor Flow now Open Source
Date Wed, 11 Nov 2015 03:37:14 GMT
Note that I just realized that large neural network model can be
partitioned into sub-graphs by layer (horizontal partitioning) and
executed in a serial way (DAG).

On Wed, Nov 11, 2015 at 12:13 PM, Edward J. Yoon <edwardyoon@apache.org> wrote:
> The docker or hadoop connectors is not fully solve the issue. Because
> there're many things like data locality and cluster topology
> management. If they let user to handle the data and model parallel
> based on remote session, it will be quite difficult to develop the
> distributed applications I guess.
>
> On Tue, Nov 10, 2015 at 7:29 PM, Thomas Jungblut
> <thomas.jungblut@gmail.com> wrote:
>> I'm pretty sure they will release a docker image or hadoop connectors to
>> push their cloud offering soon.
>>
>> I agree that the scope of the project blows several other (already
>> established) projects off the market lol.
>> I still see two interesting opportunities :)
>>
>> 1. We could build a plain Java connector like they did for python.
>> 2. We could build our neuron centric API on top of that (no idea about the
>> integration story, probably needs to be cpp)
>>
>>
>> On 10 November 2015 at 07:30, Edward J. Yoon <edwardyoon@apache.org> wrote:
>>
>>> I've dropped the question about model parallelism plan of TF
>>> https://github.com/tensorflow/tensorflow/issues/23#issuecomment-155340811
>>>
>>> On Tue, Nov 10, 2015 at 4:08 PM, Zachary Jaffee <zij@case.edu> wrote:
>>> > I don't see anything on their site that addresses running on top of
>>> > existing hadoop clusters, although I'm sure anyone actually using this
>>> api
>>> > will haven no problem figuring out how to make that work. Lets figure out
>>> > what we can do different and better than tensor as to focus how the horn
>>> > API is designed.
>>> >
>>> > On Tue, Nov 10, 2015 at 12:11 AM, Edward J. Yoon <
>>> edward.yoon@samsung.com>
>>> > wrote:
>>> >
>>> >> There tensor is like a blow to Caffe, Theano, Singa, and Horn too.
>>> >>
>>> >> Once they releases fully distributed version, it'll very difficult game
>>> :/
>>> >>
>>> >> --
>>> >> Best Regards, Edward J. Yoon
>>> >>
>>> >>
>>> >> -----Original Message-----
>>> >> From: Edward J. Yoon [mailto:edward.yoon@samsung.com]
>>> >> Sent: Tuesday, November 10, 2015 12:20 PM
>>> >> To: dev@horn.incubator.apache.org
>>> >> Subject: RE: Google Tensor Flow now Open Source
>>> >>
>>> >> It seems a goal of TensorFlow to accelerate research and innovation
>>> >> something
>>> >> like github, using open-sourcing beyond company in-sourcing. So, I
>>> >> personally
>>> >> guess they won't open the large-scale distributed version.
>>> >>
>>> >> By the way, do you think we can bring TensorFlow into our project?
>>> >>
>>> >> --
>>> >> Best Regards, Edward J. Yoon
>>> >>
>>> >>
>>> >> -----Original Message-----
>>> >> From: Cazen Lee [mailto:cazen.lee@gmail.com]
>>> >> Sent: Tuesday, November 10, 2015 11:46 AM
>>> >> To: dev@horn.incubator.apache.org
>>> >> Subject: Re: Google Tensor Flow now Open Source
>>> >>
>>> >> Looks good!
>>> >>
>>> >> Thank you
>>> >>
>>> >> 2015년 11월 10일 화요일, Edward J. Yoon<edwardyoon@apache.org>님이
작성한
>>> >> 메시지:
>>> >>
>>> >> > Interesting! thanks.
>>> >> >
>>> >> > On Tue, Nov 10, 2015 at 2:23 AM, Zachary Jaffee <zij@case.edu
>>> >> > <javascript:;>> wrote:
>>> >> > > http://tensorflow.org/
>>> >> > >
>>> >> > > Something interesting to take a look at.
>>> >> > >
>>> >> > > --
>>> >> > > Zach Jaffee
>>> >> > > B.S. Computer Science
>>> >> > > Case Western Reserve University Class of 2017
>>> >> > > Operations Director | WRUW FM 91.1 Cleveland
>>> >> > > Secretary | Recruitment Chair | Phi Kappa Theta Fraternity
>>> >> > > (917) 881-0646
>>> >> > > zjaffee.com
>>> >> > > github.com/ZJaffee
>>> >> >
>>> >> >
>>> >> >
>>> >> > --
>>> >> > Best Regards, Edward J. Yoon
>>> >> >
>>> >>
>>> >>
>>> >> --
>>> >> Cazen@korea.com
>>> >> Cazen.lee@samsung.com
>>> >> http://www.Cazen.co.kr <http://www.cazen.co.kr/>
>>> >>
>>> >>
>>> >>
>>> >>
>>> >
>>> >
>>> > --
>>> > Zach Jaffee
>>> > B.S. Computer Science
>>> > Case Western Reserve University Class of 2017
>>> > Operations Director | WRUW FM 91.1 Cleveland
>>> > Secretary | Recruitment Chair | Phi Kappa Theta Fraternity
>>> > (917) 881-0646
>>> > zjaffee.com
>>> > github.com/ZJaffee
>>>
>>>
>>>
>>> --
>>> Best Regards, Edward J. Yoon
>>>
>
>
>
> --
> Best Regards, Edward J. Yoon



-- 
Best Regards, Edward J. Yoon

Mime
View raw message