From dev-return-15770-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Fri Nov 1 02:58:33 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 588C3180629 for ; Fri, 1 Nov 2019 03:58:33 +0100 (CET) Received: (qmail 80609 invoked by uid 500); 1 Nov 2019 02:58:31 -0000 Mailing-List: contact dev-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@arrow.apache.org Delivered-To: mailing list dev@arrow.apache.org Received: (qmail 80443 invoked by uid 99); 1 Nov 2019 02:58:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Nov 2019 02:58:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 56F0BC1E2A; Fri, 1 Nov 2019 02:58:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.201 X-Spam-Level: X-Spam-Status: No, score=-0.201 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id u4ZV_eUqMtIO; Fri, 1 Nov 2019 02:58:29 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.222.175; helo=mail-qk1-f175.google.com; envelope-from=samratbatth@gmail.com; receiver= Received: from mail-qk1-f175.google.com (mail-qk1-f175.google.com [209.85.222.175]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 65BE3BC83D; Fri, 1 Nov 2019 02:58:29 +0000 (UTC) Received: by mail-qk1-f175.google.com with SMTP id u184so9289256qkd.4; Thu, 31 Oct 2019 19:58:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=content-transfer-encoding:from:mime-version:date:subject:message-id :to; bh=WUsYszqhUXqirINtlQLeM8yr6WSdqP4i9Z11W2RT3DA=; b=lgaMQuRvInNLvaJVkSsUOEcPQ5NkTRWGGr8Uwi5PCxiVvqRbQVJVSnufAxqkonMY6F NGbF+HMSMGrsyTewGHkd8Gv/ENIbPg+2rZiVgJy6NX+aVgkLRtox1Bz1CCGsoKBSDLge 1rO5Fy17NuYJOoyUD0dEehkX0aE+zpZO2tng6xBEy5ZgeqilYAczzyfzl3mheEvnYPiF H2/j1rMls5NYDEx2FvIkRKzYFdvRf97x1EKIpL9xTOyfOHUVhV8CIw3YtakpDKRSkZvj kHBPbanacBjhrjKo4vlf8iQYkfCd8MlEw67C9g7vCi9noGdKWGTGptCcxbukDm31rRdU QA1A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:content-transfer-encoding:from:mime-version:date :subject:message-id:to; bh=WUsYszqhUXqirINtlQLeM8yr6WSdqP4i9Z11W2RT3DA=; b=LYdXgmGGYcsByeqq8X32A1Bfo7z0McV7GRLkf8mzBspdDJWM6DV6larEET/VWAYoGy 5IUJL7EgZzatG+6adxpuaaYfjUrXbPL6fwz3+d9rNPqIM4WhvO+Pfb8bVSfcOByf29qM vTGHMRPn1LUqgjryJXE5GKNF1oVAvf5r7hQVVaNTKlkjEQ9pppYrwTJDqZB4GhNNLPl0 bExORyAMLezF6BP80PZwWU8is3RVUnKnn6zmMf25KxO+VL7c3hN6BoiOIgaWNHo42sUx 6c8GK5ZnEzG9jqsOF2R9fUYiDk0EtO6NSq2+yRCnK8hvT2T+NEkYk5RaP7c4M0maOjXt sNzA== X-Gm-Message-State: APjAAAUnTWAiEgVTLayqOE/X50HcvVp2Gu9tGfggTuRGeNjNUICn+olP +KmkUb5lNkioxmWMigqjXm88q9ET X-Google-Smtp-Source: APXvYqxnQM3zJG8WZNYQSe9mdaKCzFD7DRitPlWXWI1yOcwhr2i63+tJCsSm6mAiY767MoNVpcpPaA== X-Received: by 2002:a05:620a:12a3:: with SMTP id x3mr4838255qki.336.1572577108525; Thu, 31 Oct 2019 19:58:28 -0700 (PDT) Received: from [192.168.1.6] (c-76-117-134-207.hsd1.nj.comcast.net. [76.117.134.207]) by smtp.gmail.com with ESMTPSA id l15sm3296226qkj.16.2019.10.31.19.58.27 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 31 Oct 2019 19:58:27 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable From: Samrat Batth Mime-Version: 1.0 (1.0) Date: Thu, 31 Oct 2019 22:58:27 -0400 Subject: re: Arrow for low latency IPC Message-Id: To: user@arrow.apache.org, dev@arrow.apache.org X-Mailer: iPhone Mail (17A861) Hi, I am new to Apache Arrow and want to consider it for low latency IPC stream.= I want to see if I can use Arrow for low latency IPC via processes written i= n multiple languages. As far as what I can understand about current version of Arrow, the messages= are passed in a batch via IPC, ie the RX will get the msgs in batch and not= as soon as they are sent by the TX. Any pointers to examples / code for this? Or any benchmarks on IPC? Thanks, Sam=