From user-return-1023-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Sat Feb 27 04:51:01 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 6F50B180607 for ; Sat, 27 Feb 2021 05:51:01 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 96AD842402 for ; Sat, 27 Feb 2021 04:51:00 +0000 (UTC) Received: (qmail 1825 invoked by uid 500); 27 Feb 2021 04:50:57 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 1814 invoked by uid 99); 27 Feb 2021 04:50:56 -0000 Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 27 Feb 2021 04:50:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id 29393C033A for ; Sat, 27 Feb 2021 04:50:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: -0.001 X-Spam-Level: X-Spam-Status: No, score=-0.001 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id 3zouIoQjU31J for ; Sat, 27 Feb 2021 04:50:54 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::536; helo=mail-ed1-x536.google.com; envelope-from=emkornfield@gmail.com; receiver= Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 53DA67FC9B for ; Sat, 27 Feb 2021 04:50:54 +0000 (UTC) Received: by mail-ed1-x536.google.com with SMTP id p2so13362928edm.12 for ; Fri, 26 Feb 2021 20:50:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:reply-to:from:date:message-id :subject:to; bh=6uKLPt2zYdXpUVR0XMUh0dVYEWQR46q5BPIMFsgvvmk=; b=FCwNVGXjlkePw2WnnSRLjhG+NV1/PMWgyfp+kgiHegSf76msH7HgKxcOmo76+pXHsZ rsUwgGnDS8IIc4tLwpMP/i9Nm1X/sfxt4Q5qruSLn2/VPT5Yb7wgx7fSV1ciAR5rKk/D ivP7GTfxvZhURpFQ3XxwUZG1NyR3h0iSkwk9afIbLlEknTvDP54qkz1b9QM4wHC4eCtp WjGx/ojQPg1s9fJysmZpkAWvzF2pgmEhtJcWVt5bQC/iZfCxnHy/3BRY+F+SILNom6sj b+0uousfnIk4ORSQC0UkgneDBP6KHB4rTEGcuMQvtYWGPn3x3OmehsvXYdxOtysjyfXd BNGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:reply-to :from:date:message-id:subject:to; bh=6uKLPt2zYdXpUVR0XMUh0dVYEWQR46q5BPIMFsgvvmk=; b=YB1L/cLsGRgORQB/S3OIRr9obmd0LTF3Qw7Qi9+6yTkM1FpE4HKP882fNIYGdWkvgm NsszqvuJJ9fxmjHxclYHGe3q18zZAaHc5980jfPMaeopefjQjaCRU2D2vgbRiE/H/25t 4cdB2YAEDC7Uj287FYfNSDYcfofS1fi080jYcK8PMvlmpMLszCdP+Pu+WAqpUuu4YIWu TGmOPLj8Myxx6p1yJSGi/HcfOB0RkF4qDeJJMvfTkJysZPf5wgNc23jblsF7EdItoaW3 Mzr2j7qNJHmlwljt5BIkjyCRIIH/CQ1bpWyadDkFF4LEfdpsjiJKQ5VsGEVBCZtz8lhn MJnA== X-Gm-Message-State: AOAM530fe+YCxEvMTwcAdmFmLZa79pntdHh+Hds1+7Pl81JOCCTpNI6E VvRkU1Gsmx4LFjO/RlxvT2vkCPGGYtwCCmlVB5+sw5vuysOppw== X-Google-Smtp-Source: ABdhPJxguVHUu/gsAwMJs1dHuUq/17SRjJ+oipSHqYWFlx6Uo4YxuUN+x6pO+uic79xny/WI1OVt3zok2EfvvzuDu/M= X-Received: by 2002:a05:6402:34c4:: with SMTP id w4mr6564241edc.153.1614401453672; Fri, 26 Feb 2021 20:50:53 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: Reply-To: emkornfield@gmail.com From: Micah Kornfield Date: Fri, 26 Feb 2021 20:50:42 -0800 Message-ID: Subject: Re: How to connect arrow flights to spark clusters To: user@arrow.apache.org Content-Type: multipart/alternative; boundary="0000000000002bcd1c05bc4a21e7" --0000000000002bcd1c05bc4a21e7 Content-Type: text/plain; charset="UTF-8" Ryan Murray prototyped something like this a while ago [1]. I'm not sure what the current state of this is. [1] https://github.com/rymurr/flight-spark-source On Thu, Feb 18, 2021 at 10:15 PM Priyanshu Mittal wrote: > Hi, > I want to connect my arrow flight with apache spark clusters so that I can > transfer my data between spark clusters and arrow flights. Basically, I > have to transfer my arrow data to spark clusters using arrow flights. So, > How can I do that? > Any help or resources would be appreciated. > > Thanks, > Priyanshu > --0000000000002bcd1c05bc4a21e7 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Ryan Murray prototyped something like this a while ago [1]= .=C2=A0 I'm not sure what the current state of this is.

<= div>[1]=C2=A0http= s://github.com/rymurr/flight-spark-source

On Thu, Feb 18, 2021 at = 10:15 PM Priyanshu Mittal <prm= ittal.nch@gmail.com> wrote:
Hi,
I want to connect= my arrow flight with apache spark clusters so that I can transfer my data = between spark clusters and arrow flights. Basically, I have to transfer my = arrow data to spark clusters using arrow flights. So, How can I do that?
Any help or resources would be appreciated.

Thanks,
Pri= yanshu
--0000000000002bcd1c05bc4a21e7--