From user-return-184-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Fri Aug 30 18:59:18 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 16D4818065E for ; Fri, 30 Aug 2019 20:59:17 +0200 (CEST) Received: (qmail 50562 invoked by uid 500); 30 Aug 2019 18:59:17 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 50547 invoked by uid 99); 30 Aug 2019 18:59:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Aug 2019 18:59:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id DA7F0C0B06 for ; Fri, 30 Aug 2019 18:59:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.801 X-Spam-Level: * X-Spam-Status: No, score=1.801 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=rstudio.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id OSTRLsWSys5Z for ; Fri, 30 Aug 2019 18:59:14 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.167.176; helo=mail-oi1-f176.google.com; envelope-from=ben.kietzman@rstudio.com; receiver= Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 68197BC7A9 for ; Fri, 30 Aug 2019 18:59:14 +0000 (UTC) Received: by mail-oi1-f176.google.com with SMTP id q8so6139487oij.5 for ; Fri, 30 Aug 2019 11:59:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rstudio.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=4zW6u+I9KDmeelypkShNzD/B1AX9hluwGstzbOaKz3I=; b=lqb0lsSfaNlKIf3OGXnfDHUbpA/itt8OA93qe3Hz25G2eqFmzkjgh4M6oz6abFx0OA c+ndeyyitSUJvFe1DH8CN3TC1i+WsyTjbgi/PFkmoAm7k+DFpwS9rHjzNoltdHZnjPxY 64GWCYAbde3YBtQeAqGD0DqZHtrQ5P2G4hUBU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=4zW6u+I9KDmeelypkShNzD/B1AX9hluwGstzbOaKz3I=; b=Jf5bEcBAlFYOkd2jhFvAVfByY5n0+oqfLkai6g7J0AIctmO0FoKUlkewpKEt2l+FIG u4YFZbllNylWI4ZUZHMoO76I3gsKZu9qx3VzKE0xaW6RxPhgMDhgI8Fuu93/OLWlqK+4 oLpItqyVVxfZIRnfPzqRQVYVUQ3URlVlmWL5hAauHdwGLbdwDGMO6utZUzL9EHZRDaZU 9ZBvf6yFDS62+nQUrLlD6mTWV4ak+MjdGC40tAMz+/C2NwyKQMBFQPDc+FmR1fJO0N0V 4IardX3DNmRSRD1YGIUWMB9OPmwUksw993V7xVDcAlXYW6UREmryZPrS3hGV5h5oiMP1 dsBQ== X-Gm-Message-State: APjAAAVyeq9kiDDxJN5uDXA6jvp1ezd3MrDJBBvQNtnrd3uPNBYqXMu5 qm5aKSyAUKT9AYRu82dDgyUF1/0rl41rjJ1Vh4dVlvcp X-Google-Smtp-Source: APXvYqzeiDiuXLKH6AXAvXmGqE5QsE3MOL0aSdst9RlXVJYrDJNoCJQZjiWtQmx8iZJN7afyuit0gZW8loEQLM0Upf4= X-Received: by 2002:aca:e055:: with SMTP id x82mr10773956oig.90.1567191553480; Fri, 30 Aug 2019 11:59:13 -0700 (PDT) MIME-Version: 1.0 References: <16ce1f3a1c0.27b7.727fde9afb6860196ef19c74546e60d2@ipp.mpg.de> In-Reply-To: From: Ben Kietzman Date: Fri, 30 Aug 2019 14:59:02 -0400 Message-ID: Subject: Re: Reccord-Level Access To: user@arrow.apache.org Content-Type: multipart/alternative; boundary="000000000000d72dbd05915a378f" --000000000000d72dbd05915a378f Content-Type: text/plain; charset="UTF-8" Hi Simon, If you're interested in adding a record interface, the Scalar classes might be a good place to start. They represent a value from an array slot and it should be fairly straightforward to extract a table row as a StructScalar On Fri, Aug 30, 2019 at 1:27 PM Wes McKinney wrote: > hi Simon -- I don't think there is any such Row accessor class in Java > but you are welcome to contribute one to the project. For performance > sensitive applications, using a record interface might not be the best > idea, but I can understand the convenience for some uses cases. > > - Wes > > On Fri, Aug 30, 2019 at 4:55 AM Simon Dumke > wrote: > > > > Hi all, > > > > > > > > > > I did not find anything (and so: no definite answer) in the docs, so i > > thought to ask here: > > > > > > > > > > Does Arrow (and at this point my main concern is Arrow for java) support > > any type of concept that allows a "record level access" (so, a "row") to > > data in an Arrow RecordBatch or Table? I would have thougt that even in > > column-oriented analytics etc. this would be a common last step access > > pattern over many use cases, but i could not find any references to such > a > > thing. > > > > > > > > > > Thanks and kind regards, > > Simon > > > > > --000000000000d72dbd05915a378f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Simon,

If you're inte= rested in adding a record interface, the Scalar classes might be a good pla= ce to start. They represent a value from an array slot and it should be fai= rly straightforward to extract a table row as a StructScalar

On Fr= i, Aug 30, 2019 at 1:27 PM Wes McKinney <wesmckinn@gmail.com> wrote:
hi Simon -- I don't think there is any such = Row accessor class in Java
but you are welcome to contribute one to the project. For performance
sensitive applications, using a record interface might not be the best
idea, but I can understand the convenience for some uses cases.

- Wes

On Fri, Aug 30, 2019 at 4:55 AM Simon Dumke <simon.dumke@ipp.mpg.de> wrote:
>
> Hi all,
>
>
>
>
> I did not find anything (and so: no definite answer) in the docs, so i=
> thought to ask here:
>
>
>
>
> Does Arrow (and at this point my main concern is Arrow for java) suppo= rt
> any type of concept that allows a "record level access" (so,= a "row") to
> data in an Arrow RecordBatch or Table? I would have thougt that even i= n
> column-oriented analytics etc. this would be a common last step access=
> pattern over many use cases, but i could not find any references to su= ch a
> thing.
>
>
>
>
> Thanks and kind regards,
> Simon
>
>
--000000000000d72dbd05915a378f--