From user-return-896-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Mon Jan 4 23:13:02 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id D8498180654 for ; Tue, 5 Jan 2021 00:13:01 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 204E441E4A for ; Mon, 4 Jan 2021 23:13:01 +0000 (UTC) Received: (qmail 47778 invoked by uid 500); 4 Jan 2021 23:13:00 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 47767 invoked by uid 99); 4 Jan 2021 23:13:00 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Jan 2021 23:13:00 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 3C08A1FF3A3 for ; Mon, 4 Jan 2021 23:13:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: 2.199 X-Spam-Level: ** X-Spam-Status: No, score=2.199 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, ENA_SUBJ_ONLY_RE=2.2, HTML_MESSAGE=0.2, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=twitter.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id DCTTlZLPUw1S for ; Mon, 4 Jan 2021 23:12:58 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::733; helo=mail-qk1-x733.google.com; envelope-from=cmcmullen@twitter.com; receiver= Received: from mail-qk1-x733.google.com (mail-qk1-x733.google.com [IPv6:2607:f8b0:4864:20::733]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id CEF9C7FBF3 for ; Mon, 4 Jan 2021 23:12:54 +0000 (UTC) Received: by mail-qk1-x733.google.com with SMTP id f26so25118907qka.0 for ; Mon, 04 Jan 2021 15:12:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=twitter.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ZjJ/giHKHNU3NjOWJobwHx03ekWvL11qXUCkNC5HxSA=; b=i45etCTecff+IEQYNq1qDqNyWutpjd01+D34vqG8BvOHXxlk/w+a6B75nSokPMAW77 HoDeOQv9Mq+xFOQZF71wo+oXlwDtEcHH7j1hXHMhW2/mIrfZxC85pDDX02XKOWDClcOm JZZzCCTK4i2cHyXSgiaq7F+sasM5nil9Up/vw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ZjJ/giHKHNU3NjOWJobwHx03ekWvL11qXUCkNC5HxSA=; b=HFpcp7RYKTu9E96M7KrMlJL//nvooBPgeWfP4gbwi8d1pHmUxmeE0wiqpIvyJkqnbM qHhZPgY9Y70mH3uyw+CaCzIAR1XEeFDt2z0ahCyMyOm7xzENlE87a1DMPHFkv/ksE32S NWXXFSJHYUiVu3QI1aDAyPqoTbfA5bDRsESw7iSsVkO5Ix3c0MLmEkElvg8kzFuqvlEL zRqHKm/cMeyxr63WSocrbUXF2XQ4fEGL/0mphJxlRY1leQR+zsFGTHPodSk/rMGCjTWs CTAzu1DxlCglLerO48ZgmDuiw1+4Ux6Cersyurrxs5e0oh0P1CG2SWRXJ4lnSgQODriV lZUw== X-Gm-Message-State: AOAM532U+/saQ+NiKrdJVtk56tusxukcODNwHZtstJe29NGYpgKscIDX Nc4VwlvO398spggOPaUt/bEnFYzSa9axa20n+iRz7U2llnI= X-Google-Smtp-Source: ABdhPJz/shLUc5+8DVhRffDNFab9Rk1Gwl73S1dwnsfMc+RXJWIMOvAHbJjSyFCFmG4HVqQKcOHVT10Xg1E6SKfwor8= X-Received: by 2002:ae9:f818:: with SMTP id x24mr59939634qkh.415.1609801969913; Mon, 04 Jan 2021 15:12:49 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Cindy McMullen Date: Mon, 4 Jan 2021 16:12:39 -0700 Message-ID: Subject: Re: To: user@arrow.apache.org, emkornfield@gmail.com Content-Type: multipart/alternative; boundary="00000000000093a90305b81b3a6a" --00000000000093a90305b81b3a6a Content-Type: text/plain; charset="UTF-8" Thanks! On Mon, Jan 4, 2021 at 1:42 PM Micah Kornfield wrote: > Hi Cindy, > Apologies for the late response, but I think Wes at various times has > benchmarked the Arrow/Feather format. I think [1] is the latest. > > Thanks, > Micah > > [1] https://ursalabs.org/blog/2020-feather-v2/ > > On Tue, Dec 15, 2020 at 10:00 AM Cindy McMullen > wrote: > >> Hi, >> >> Our team is evaluating various ML data formats, and Arrow is among them. >> We're looking for some Arrow benchmarks to reference. Do you have any >> public read/write benchmarks you could share with us? >> >> Thanks - >> >> - Cindy >> > --00000000000093a90305b81b3a6a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thanks!

On Mon, Jan 4, 2021 at 1:42 PM Micah Kornfield <= emkornfield@gmail.com> wrot= e:
Hi Cindy,
Apologies for the late response, but I think Wes at vario= us times has benchmarked the Arrow/Feather format.=C2=A0 I think [1] is the= latest.

Thanks,
Micah
On Tue, = Dec 15, 2020 at 10:00 AM Cindy McMullen <cmcmullen@twitter.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-l= eft:1px solid rgb(204,204,204);padding-left:1ex">
Hi,=C2=A0=

Our team is evaluating various ML data formats, and Arr= ow is among them.=C2=A0 We're looking for some Arrow benchmarks to refe= rence.=C2=A0 =C2=A0Do you have any public read/write benchmarks you could s= hare with us?=C2=A0=C2=A0

Thanks -
<= br>
- Cindy
--00000000000093a90305b81b3a6a--