From user-return-630-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Thu Aug 20 17:12:49 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id F170918063F for ; Thu, 20 Aug 2020 19:12:48 +0200 (CEST) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id 2EB1A1268C8 for ; Thu, 20 Aug 2020 17:12:46 +0000 (UTC) Received: (qmail 80724 invoked by uid 500); 20 Aug 2020 17:12:41 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 80526 invoked by uid 99); 20 Aug 2020 17:12:40 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Aug 2020 17:12:40 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 2D8A0C0253 for ; Thu, 20 Aug 2020 17:12:40 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.002 X-Spam-Level: X-Spam-Status: No, score=0.002 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id S0Qr1n6rVycW for ; Thu, 20 Aug 2020 17:12:39 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.218.42; helo=mail-ej1-f42.google.com; envelope-from=niranda.perera@gmail.com; receiver= Received: from mail-ej1-f42.google.com (mail-ej1-f42.google.com [209.85.218.42]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id C046EC181D for ; Thu, 20 Aug 2020 17:12:38 +0000 (UTC) Received: by mail-ej1-f42.google.com with SMTP id f24so3404812ejx.6 for ; Thu, 20 Aug 2020 10:12:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=WkwW4I2+UpnZ/bf7fXrY5DYou1bktBeb4Xb0IouzMFA=; b=i6AMO30n/q8c/L4QaGYj+Aj/1wWMyY0foze6/L6WEGCXe8S6frU2p/EE/VRMhjEC6D obC++6ugtMEM1GhrePu7NY6KtczGHe16lsjVatkjWFvNnUk/LxNFhSpo8H3P2htwnCzA eRSvXm6Yg+Je7I1hX5pIz5wHL1NkL8SInk0xYF6g6pe/+7K5IER69OBIfak5g5c6unYU m3f4SEFJLIuYUyT3uggPQuUgHm50RkTfw6a1lqRw5IyKkd8vWKaqSWVAeJ79Ue2oSBE4 1+zE1AI428oxtN9Bx/5xBvmjwzr78LTnlAKMmRyX9OoUb2tbk+Fb7VWeitMT28MiFixU 80ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=WkwW4I2+UpnZ/bf7fXrY5DYou1bktBeb4Xb0IouzMFA=; b=UaAks3xi53mgzrA3yezrcxt/DxKsOnFhSClGVv5G0FBkK+L1FUDHTMQtJBZozhVev3 7ntnlB7XklMiYWbtR22/PCELPUy0aipWaQ4MG532DMWDtcV/uekPnY/xa3kTkp8LoaAZ B5/X1LP2Yf6X+igvEFp1+VE6Z8KZwaxehTiZZ7a3o65oopHRdGfg2LevZWSDTOY/ha0M EqiGhyMRffR7D70ru2wIuo/dHhGjjnjxjM88KcfL7O3qO58+ZH8qjG796g3g1ZxQCwqT NOgBNJvNxtcsakaoeSosQfzCXJc43wd1/xtY/vIy0i8PrTfBW5+TDERCxM8vm5bg1AWj LthA== X-Gm-Message-State: AOAM533HEdiGfFY8w2/LPF8Dt6mrww8ZW5/fY1zrHA8bFChw9PWbKz/a eky8tgOeTDtWfcdF+Wu5cassq/gnoxRYUN0GJQTju+quzpD6XA== X-Google-Smtp-Source: ABdhPJyDKkRLpfus86keRmMtoTEO48rTXmZc8QJBnyNM1rur+isRmywObHIkFe9PKiuHwQLyWOZatGF9NgSgD2O5nS4= X-Received: by 2002:a17:906:d288:: with SMTP id ay8mr4134321ejb.373.1597943557403; Thu, 20 Aug 2020 10:12:37 -0700 (PDT) MIME-Version: 1.0 From: Niranda Perera Date: Thu, 20 Aug 2020 13:12:26 -0400 Message-ID: Subject: Using arrow for sparse data To: user@arrow.apache.org Content-Type: multipart/alternative; boundary="0000000000001c398a05ad523a29" --0000000000001c398a05ad523a29 Content-Type: text/plain; charset="UTF-8" Hi, I was wondering how we could use arrow arrays for sparse matrix data representation? I felt like the arrow structure suits well for CSC (compressed sparse column) format which is used heavily in sparse matrix operations. I saw that there was a 'sparse tensor' on the arrow website. https://arrow.apache.org/docs/cpp/api/tensor.html Are there any examples of the usage of these? Best -- Niranda Perera @n1r44 +1 812 558 8884 / +94 71 554 8430 https://www.linkedin.com/in/niranda --0000000000001c398a05ad523a29 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi,=C2=A0

I was wondering how we could = use arrow arrays for sparse=C2=A0matrix data representation? I felt like th= e arrow structure suits well for CSC (compressed sparse column) format whic= h is used heavily in sparse matrix operations.=C2=A0

I saw that there was a 'sparse tensor' on the arrow website.=C2= =A0https://ar= row.apache.org/docs/cpp/api/tensor.html
Are there any example= s of the usage of these?

Best=C2=A0
-- <= br>
Niranda Perera
+1 812 558= 8884 / +94 71 554 8430
<= /div>
--0000000000001c398a05ad523a29--