incubator-giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claudio Martella <claudio.marte...@gmail.com>
Subject Re: [jira] [Commented] (GIRAPH-108) Refactor code to run independently of Map/Reduce
Date Tue, 20 Dec 2011 01:58:56 GMT
I agree, I think this might be a good sub-task of the general
re-factoring/abstraction from the mapreduceV1 framework.
What about this patch? does it run on mesos? does it break on MRv1?
infos about the tests?

On Tue, Dec 20, 2011 at 2:11 AM, Ed Kohlwey (Commented) (JIRA)
<jira@apache.org> wrote:
>
>    [ https://issues.apache.org/jira/browse/GIRAPH-108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172813#comment-13172813
]
>
> Ed Kohlwey commented on GIRAPH-108:
> -----------------------------------
>
> Hi Claudio,
> Thanks for pointing me that way. It seems like this might be appropriate to call a sub-task
for GIRAPH-13? My eventual goal with this patch is actually to target Mesos, and 13 seems
to be targeting YARN.
>
> It seems like it shouldn't be too hard to maintain a few drivers, one for M/R, one for
YARN, and one for Mesos - most of the daemon code is pretty well abstracted and shouldn't
take a lot of work to port to the other frameworks.
>
>> Refactor code to run independently of Map/Reduce
>> ------------------------------------------------
>>
>>                 Key: GIRAPH-108
>>                 URL: https://issues.apache.org/jira/browse/GIRAPH-108
>>             Project: Giraph
>>          Issue Type: Improvement
>>          Components: graph
>>            Reporter: Ed Kohlwey
>>         Attachments: GIRAPH-108
>>
>>
>> It would be nice for Giraph to be refactored such that the code could eventually
be run outside of map/reduce. This will allow people to write drivers that can run in the
cool new resource manager frameworks like Mesos and YARN, and eventually let the application's
code base evolve to be independent of map/reduce.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>



-- 
   Claudio Martella
   claudio.martella@gmail.com

Mime
View raw message