From dev-return-16282-archive-asf-public=cust-asf.ponee.io@reef.apache.org Mon Apr 16 23:01:19 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id D72DD180608 for ; Mon, 16 Apr 2018 23:01:18 +0200 (CEST) Received: (qmail 17850 invoked by uid 500); 16 Apr 2018 21:01:18 -0000 Mailing-List: contact dev-help@reef.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@reef.apache.org Delivered-To: mailing list dev@reef.apache.org Received: (qmail 17828 invoked by uid 99); 16 Apr 2018 21:01:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Apr 2018 21:01:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D2C13C0161 for ; Mon, 16 Apr 2018 21:01:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id UA9M7BkbHl8m for ; Mon, 16 Apr 2018 21:01:15 +0000 (UTC) Received: from mail-qt0-f182.google.com (mail-qt0-f182.google.com [209.85.216.182]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CD9515F54E for ; Mon, 16 Apr 2018 21:01:14 +0000 (UTC) Received: by mail-qt0-f182.google.com with SMTP id l8so13095687qtp.6 for ; Mon, 16 Apr 2018 14:01:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=Q68bmOXfFTElR/nvTUGDmxFBROI2tjzbJZtLfm2JD1c=; b=O5E9RSQyD5CoOdYMf4+r6wn5BKd49vLI10ks0IrQDAxCgXbWfGNVHKu2W3bM7Lr2u/ 7Sd5khGedbc9WzpajxrNULy57du6P6h2/eK3H+YCON2cyvMFXbc2ezGZRVDH0tqkHj6j /fZCFSzFSn/JH68T8Fji1ZucHH9tVhoYe9ET+TwMkfqBPTEKuXZcs/LQmL6t0xlRLn1X QdIQUsaJGSsxOvrXF0wPxdc5SVdntU0uqBZsmwpevQprSUEQjLmGx4TUKZ3/+YOsYWvP caTejZTGb9dczt6rszHu2vPoWjBVMVnhc8OZZp8qJbp9Pz7fd832XBKKr9WMykSkos1R zn/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=Q68bmOXfFTElR/nvTUGDmxFBROI2tjzbJZtLfm2JD1c=; b=TvZd46QQLJ4Y7TJUxWYZURnMi0mzvxcmpLS24rJyRoj4uf2r0c5MwOuNtTsRUOqa+V 5J7CwX+NzKTiSdD0XLZRbNos3UV/JZkcaTozCD9gsn7Rg17WVPUXp0Qn89fRg5k0atJK cOUr+WgLUwWkAD5qk81wLEHzjCI9oD4RplvBL8BJJSLqj2YXn825VJ347J7sKJpiEEpV Ol44Z5rCDWccVh5isDi8CxZQMhPeXFO2IgccRLrbw1WYDq15/1UJYGt08ml/1efNwTZ4 sl7YnqFCzycwZBFLE1SMHGnmQVWre6B/+rRpc4Mx12UOQ+FFAYNQodvvWu6Elvu4MrgS iPgw== X-Gm-Message-State: ALQs6tDe4H0e2uIwFoUO6+X9mhlxngzt2jf2SFF70y4NU/RWAdnYg6zJ z6n9l2IkvyBbKFk0w0rGuKf5H1caTr+8uR6esh4= X-Google-Smtp-Source: AIpwx491ETdD5/MRBcUCKpRg9TRI2t2oxI6wYDn9TX9pXXNRC32535tkaKAzeld8/GwE+e/llB00+I+9yVRkUMduSas= X-Received: by 10.237.45.67 with SMTP id h61mr408960qtd.31.1523912467660; Mon, 16 Apr 2018 14:01:07 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.176.35 with HTTP; Mon, 16 Apr 2018 14:01:07 -0700 (PDT) Reply-To: tcondie@apache.org In-Reply-To: References: From: Tyson Condie Date: Mon, 16 Apr 2018 14:01:07 -0700 Message-ID: Subject: Re: gRPC based Java Bridge To: Byung-Gon Chun Cc: dev@reef.apache.org Content-Type: multipart/alternative; boundary="94eb2c124a884dc2980569fd85ef" --94eb2c124a884dc2980569fd85ef Content-Type: text/plain; charset="UTF-8" The key solution that the new bridge will take on involves a dual process design, where the core java driver is in one process, and the application driver is in the other process. From there, we need to communicate information between these two worlds. gRPC+protocol buffers is one way of doing that communication. Since protocol buffers are already used between driver and evaluator, I felt the same would be best between driver-to-driver, and gRPC seems to be a well tested/supported RPC layer for protocol buffers. -Tyson On Tue, Apr 10, 2018 at 4:08 PM, Byung-Gon Chun wrote: > Tyson, thanks for the update! > Could you give us a background on why a gRPC-based solution's introduced? > > Thanks! > -Gon > > On Wed, Apr 11, 2018 at 1:59 AM, Tyson Condie > wrote: > >> Hello, >> >> We (myself, Doug Service and Scott Inglis) are in the process of >> developing >> a new REEF Java Bridge that will use a two process solution to communicate >> between the core Java Driver and an application Driver, which could be >> implemented in an alternative language e.g., C#. >> >> Communication between these two worlds will occur over gRPC using protocol >> buffers 3.5 as the data format. However, the code will be structured in a >> way that minimizes such dependencies in the case that an >> alternative/better >> communication medium presents itself. >> >> Current status: the core Java Driver is nearly code complete and I am >> working on an application (client) Driver in Java (as well) that can be >> used as a template for the C# application Driver, and for authoring unit >> tests. Please expect a pull request with these changes in the coming days. >> Concurrently, Doug Service and Scott Inglis will be developing a C# based >> application Driver. >> >> The core Java Driver and Java client/application Driver changes can be >> tracked via Jira 2002 (https://issues.apache.org/jira/browse/REEF-2002), >> which is a subtask to Jira 335 for removing the managed C++ Java bridge. >> >> Your feedback would be most welcome! >> >> Thanks >> Tyson >> > > > > -- > Byung-Gon Chun > --94eb2c124a884dc2980569fd85ef--