reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (REEF-1763) Replace interop call to StartHandlerOnNext() between Java/C# bridges
Date Mon, 05 Jun 2017 19:25:04 GMT

    [ https://issues.apache.org/jira/browse/REEF-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037432#comment-16037432
] 

Julia commented on REEF-1763:
-----------------------------

Discussed with Beysim this morning as he was the one who did original design a few years ago.
The advantage to use interop as I mentioned above are:
* The calls are in the same process therefore performance is higher
* Synchronized calls just like normal method calls and we do update values in variables cross
languages inside the method calls. 

With the proposed approach, looks like 
* It would be more flexible as Avro schema is language neutral

However, we need to
* simulate the synchronized method calls
* simulate input and return of the methods
* Do some perf comparison to check how much performance downgrade and if scaleability is going
to be an issue when thousands of events coming at the same time. 

Current contract is pretty much defined in javabridge. To move to Avro, I would think we should
start to define Avro schema for all the contracts and have a doc for review.  StartHandler
is too simple to represent all cases. Define the schema for all the cases would help us to
think through all the cases. 

> Replace interop call to StartHandlerOnNext() between Java/C# bridges
> --------------------------------------------------------------------
>
>                 Key: REEF-1763
>                 URL: https://issues.apache.org/jira/browse/REEF-1763
>             Project: REEF
>          Issue Type: Sub-task
>          Components: REEF Bridge, REEF Driver
>            Reporter: Doug Service
>            Assignee: Doug Service
>
> Currently bridge communication from Java to C# is performed via managed C++ interop which
is not supported on Linux. This is the first of a number of changes to replace all of the
interop calls between Java and C# with Avro messages carried by the REEF Wake networking classes.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message