From user-return-736-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Mon Nov 2 14:20:06 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id EB629180658 for ; Mon, 2 Nov 2020 15:20:05 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id 6C397642F9 for ; Mon, 2 Nov 2020 14:20:05 +0000 (UTC) Received: (qmail 11219 invoked by uid 500); 2 Nov 2020 14:20:04 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 11182 invoked by uid 99); 2 Nov 2020 14:20:04 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Nov 2020 14:20:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id E95431FF39C for ; Mon, 2 Nov 2020 14:20:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: -0.202 X-Spam-Level: X-Spam-Status: No, score=-0.202 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id krfnZbmfNmpc for ; Mon, 2 Nov 2020 14:20:03 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.169; helo=mail-lj1-f169.google.com; envelope-from=wesmckinn@gmail.com; receiver= Received: from mail-lj1-f169.google.com (mail-lj1-f169.google.com [209.85.208.169]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 0F3BBBC284 for ; Mon, 2 Nov 2020 14:20:03 +0000 (UTC) Received: by mail-lj1-f169.google.com with SMTP id x16so15208459ljh.2 for ; Mon, 02 Nov 2020 06:20:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=2bD3nCpnOzumPxpl/cVFKaInWx+1PGgNoOM9CIt/Jgw=; b=KnBs9asF9Q0bZ5eLVsTF0478GSxeHjouHmwgk1pwGxRlJy1ZNLS2F6W9FQZn2S2b9m OfJgu5Aq/mH5uzEvMujWfYA6BuEE5fKdGP4+/wlQ3xohK/6e8kFkS+fe/wiYdt1jkqEw nx2qEDJe14SNXSsWGGGcHcjU9Ca7BM8xJ6Jg0OQrT7NlimRhEv2ZKQmLVUoJ5s7osJeS /Pa69gJI+yZBtxL8NU5pCwjV885qKtO7t2PoomWh/BjiAVjjOIeK7IJHhSt6Iq6eYE6R dYpu1QgddZjXW1RIGExTjjyWo7AnDEATAdBnnTfdWOUevtOlMQl+EfmbG7l0KkFW2bOT 8lEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=2bD3nCpnOzumPxpl/cVFKaInWx+1PGgNoOM9CIt/Jgw=; b=DD3NS4GtKQvy0n402Y+ZGb7I6izUnyncgnL3jUK/5d+uHpkt1cJt/rXfZFoDuvO1MB xYa1mWT4TX4AxJIkZ+/UOUr/w3XcxieU5sPMhusC62ah5MOS12j3KDbMgi+Gz/DPH0V/ 6ndcCB98xznfaVZpV1OdIs0O81tfi3j/daQGmgzbphtPWEXffGjzuV3Om12sY83egDWf ZoVpFlrCzKo+D23+HbPDAzOHGXiL8rJ/Ai+50I3coyyZ6B0a62wWQd+IbPvVVx0yrJy5 i83tg808pUXcUjx3ht99hlPHESHOvD0+OT+JqMBLNpTX9epqtC7wGJl3gavM7Km7KDcQ Czjw== X-Gm-Message-State: AOAM532jRnPfyI6pAuqzNjKze01TlT52RwMNiY+ACz7tbvgbEJ+8XOJ+ tHC5Qdzx8Brdx4nnG8MtIsbJZMRTthQox9cx30/DQnV+oHw= X-Google-Smtp-Source: ABdhPJxq26oad83V9VRt6zA21UJrZJ/GY/Rq1Rpsfv8w2rFbD7OJHPUywHrHJQPB6t0OHReeCyLyqBmudNlzsI3Ger8= X-Received: by 2002:a2e:8041:: with SMTP id p1mr2222211ljg.460.1604326796188; Mon, 02 Nov 2020 06:19:56 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Wes McKinney Date: Mon, 2 Nov 2020 08:19:20 -0600 Message-ID: Subject: Re: Pyarrow join/ merge capabilities To: user@arrow.apache.org Content-Type: text/plain; charset="UTF-8" Right, it doesn't, but this work is in scope for the Apache project and I expect that we will eventually have this functionality within pyarrow. On Mon, Nov 2, 2020 at 8:12 AM Niranda Perera wrote: > > Hi, > > Arrow itself doesn't provide these capabilities AFAIK. But there are other frameworks that do joins/ merges on arrow data structures such as BlazingSQL, Cylon etc. > > Best > > On Sun, Nov 1, 2020 at 12:23 PM Harshit Gupta wrote: >> >> Does pyarrow Allow for join or merge capabilities on the columns or indexes? > > > > -- > Niranda Perera > @n1r44 > +1 812 558 8884 / +94 71 554 8430 > https://www.linkedin.com/in/niranda