From user-return-391-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Sun Apr 19 07:30:16 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id E6E19180630 for ; Sun, 19 Apr 2020 09:30:15 +0200 (CEST) Received: (qmail 90351 invoked by uid 500); 19 Apr 2020 07:30:15 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 90341 invoked by uid 99); 19 Apr 2020 07:30:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 19 Apr 2020 07:30:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 9EF8D1A342A for ; Sun, 19 Apr 2020 07:30:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.698 X-Spam-Level: X-Spam-Status: No, score=0.698 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.2, JMQ_SPF_NEUTRAL=0.5, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=cern.onmicrosoft.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id dWBw8ORMo87w for ; Sun, 19 Apr 2020 07:30:11 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=40.107.7.57; helo=eur04-he1-obe.outbound.protection.outlook.com; envelope-from=sebastien.binet@cern.ch; receiver= Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70057.outbound.protection.outlook.com [40.107.7.57]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 6E7297FB53 for ; Sun, 19 Apr 2020 07:30:10 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=j9Njl/3yvICw8MbSJs3HgrJQnYDtC+uLAI8S+GFAlFR1o+1s3bII7oRLaC/IvIrJ6Ibx2r+mr8EncgSDLvZJnzUdbS1qo7xmYDGbqBSwRLVq368ASH7rqICG++L6F+L0tQrTs27mixrYDiu6jZsQu83FqyZR+5fAyZKvlbin/b7oeazEYSy9BeYXUuMxH2d9ttwXPV3BEB2B9N6xvlljRE32vJKWgZe0cwSvXAwkxxH1DaKHoaS8f2AOvEbiu88SQSn20H+/clpHalzb3DuoVta7kiN9ucO2RDrmFAckAwa5zg+qO17l+XNZZKxtll/GvCYhNW8DL6BG6Yfk3J9ERw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7aS/iwMjr19hGURzoeVF/PNyBicJ4uGyCSKryt49Pzc=; b=no0Ustul7xRJmAiVVzqV0679vSsVHNGtWH2xkq+Zru8FMpnS3wc4WTr8hp0V/A4CPK0hMzY0xJi6Uql7/fE2bg9cOOFGP3ZplS4+t2nNBlnqgJhhobf9wa/tLhWglCviqp4mrktma/vDsrzlwCegYiUevr+c6rt8kc3O1DdWzA8zuLNgmrGFVxMAB9P0DZpHoDNxyOuHtLdaOlpP/l4xhoia3D31LWjG5aklHPqYtlg6sl3NUKxy/HQqkgnevkNXEqcmQm4lav9+VaimBRaKiJABv3YV9oEsA+w6b5vrWgXXOrmc+UxpPGsLeUQaRgZ1q6zzS1AKFjPwzXc/DKUkMQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 188.184.36.50) smtp.rcpttodomain=arrow.apache.org smtp.mailfrom=cern.ch; dmarc=bestguesspass action=none header.from=cern.ch; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cern.onmicrosoft.com; s=selector2-cern-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7aS/iwMjr19hGURzoeVF/PNyBicJ4uGyCSKryt49Pzc=; b=grj0OPW6xgUeLrl+nfvuVwZtdJZ7nS79qzg91GGS1GXL88K6nFUlxqq41dFcza2+uRnQSQ2pLe3OVLRpRmxpQGczeskCbPf3lRKrvNb1niVSE+nqtKsv42CRbi4t+x0v4szPm3RT97ChCbiXsDHYC1Ne7j7yhC5pnlvfUblqMN8= Received: from AM0PR10CA0028.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:208:17c::38) by AM6PR06MB5317.eurprd06.prod.outlook.com (2603:10a6:20b:89::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2921.29; Sun, 19 Apr 2020 07:30:03 +0000 Received: from AM5EUR02FT003.eop-EUR02.prod.protection.outlook.com (2603:10a6:208:17c:cafe::c4) by AM0PR10CA0028.outlook.office365.com (2603:10a6:208:17c::38) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2921.26 via Frontend Transport; Sun, 19 Apr 2020 07:30:03 +0000 Authentication-Results: spf=pass (sender IP is 188.184.36.50) smtp.mailfrom=cern.ch; arrow.apache.org; dkim=none (message not signed) header.d=none;arrow.apache.org; dmarc=bestguesspass action=none header.from=cern.ch; Received-SPF: Pass (protection.outlook.com: domain of cern.ch designates 188.184.36.50 as permitted sender) receiver=protection.outlook.com; client-ip=188.184.36.50; helo=cernmxgwlb4.cern.ch; Received: from cernmxgwlb4.cern.ch (188.184.36.50) by AM5EUR02FT003.mail.protection.outlook.com (10.152.8.137) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.2921.25 via Frontend Transport; Sun, 19 Apr 2020 07:30:03 +0000 Received: from cernfe05.cern.ch (188.184.36.45) by cernmxgwlb4.cern.ch (188.184.36.50) with Microsoft SMTP Server (TLS) id 14.3.487.0; Sun, 19 Apr 2020 09:29:57 +0200 Received: from mail-lj1-f180.google.com (209.85.208.180) by smtp.cern.ch (188.184.36.52) with Microsoft SMTP Server (TLS) id 14.3.487.0; Sun, 19 Apr 2020 09:29:57 +0200 Received: by mail-lj1-f180.google.com with SMTP id w20so184237ljj.0 for ; Sun, 19 Apr 2020 00:29:57 -0700 (PDT) X-Gm-Message-State: AGi0PuakRlF/ny9w0A1ECNe5+SzOsZG375WNeIl53nZafK8hdE47xEkN LRze7r/5Zp0lAuo5WUSm29YppyNY19eGt0mB9UA= X-Google-Smtp-Source: APiQypLRipdnc6zwpimANX9zLZV7RZj2Kv3QuXzhYIwaQYIpIlfFhLQhqOnYkPFuOReY4+vMMlFx0TPppTGRywoQldc= X-Received: by 2002:a2e:854e:: with SMTP id u14mr6268463ljj.182.1587281396906; Sun, 19 Apr 2020 00:29:56 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Sebastien Binet Date: Sun, 19 Apr 2020 09:29:41 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Record Batch in Go To: , Micah Kornfield Content-Type: multipart/alternative; boundary="000000000000d23ec205a39fbfcb" X-Originating-IP: [209.85.208.180] X-EOPAttributedMessage: 0 X-Forefront-Antispam-Report: CIP:188.184.36.50;CTRY:CH;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:cernmxgwlb4.cern.ch;PTR:cernmx11.cern.ch;CAT:NONE;SFTY:;SFS:(10009020)(396003)(39860400002)(376002)(346002)(136003)(46966005)(966005)(70586007)(356005)(26005)(246002)(8936002)(336012)(3480700007)(70206006)(478600001)(55446002)(82740400003)(316002)(110136005)(9686003)(8676002)(42186006)(33964004)(47076004)(6666004)(7636003)(5660300002)(186003)(2906002)(53546011);DIR:OUT;SFP:1101; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: a77a1812-00b7-4fa5-c5e6-08d7e43379be X-MS-TrafficTypeDiagnostic: AM6PR06MB5317: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6430; X-Forefront-PRVS: 0378F1E47A X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4Jsfnlb5tF8Xo/uhXdnMNLxYgkDUIhWw5jYrbdRlwTOYluFWyBVoXrHGRVMmozS/RuhhZtCoUaO1too5PcQ9wYvA6prs1UV+u7YCkQ4SMabcHBta7U1m4KFxdzzXdkc3bO+bQMADiTqG3tTvmRu4C60sQckzeuOnr39sOiWLwKEAvnfjoysfuCW96y9BPGyh+1OzqL0dMsU12n2r8w0CF94eLYhL1qSu4r0ODojt9E4y8fs66el4wYuDYjBPcwSpIKDvMnW7i12CcRZzceesLXQNa8aNAoxFQqLccceIvUhBGXNCALB/Tvw1CR9sTMGHJ1xtUFH+MUzmixP0SoSzsJHZb3gmNMaKd7vWaWICviW4Rb/xwiwbxyEGgltePI0mxi5kxe2yrV7xQolyKIiMiNFpKA63G1nrkCXpghvSitNSQ1gWdFsk0x3Om0E07KHE+TdhmVtLXcd6G+lyETmZDDItDagY7UHPqCjAad8vIzL0i7m7CB2cLFPQONZ4l1PZihNwubMmiBR3ArWHnpt+Pg1ROdvU1lTnOQaREcVqvb7sjWZrOB6l8h4R5JBSur0sF/KAX+0wztfhPuoVlpTxnA== X-OriginatorOrg: cern.ch X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Apr 2020 07:30:03.0796 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: a77a1812-00b7-4fa5-c5e6-08d7e43379be X-MS-Exchange-CrossTenant-Id: c80d3499-4a40-4a8c-986e-abce017d6b19 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=c80d3499-4a40-4a8c-986e-abce017d6b19;Ip=[188.184.36.50];Helo=[cernmxgwlb4.cern.ch] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR06MB5317 --000000000000d23ec205a39fbfcb Content-Type: text/plain; charset="UTF-8" On Sun, Apr 19, 2020 at 9:21 AM Micah Kornfield wrote: > Hi Amol, > I don't have much experience with Go, but it looks like array.Record might > be the equivalent of a RecordBatch in Go ( > https://github.com/apache/arrow/blob/master/go/arrow/array/record.go#L111) (that > is what the IPC Writer classes seems to accept). > indeed, it's called Recrod. https://godoc.org/github.com/apache/arrow/go/arrow/array#Record -s > > Cheers, > Micah > > > On Sun, Apr 19, 2020 at 12:11 AM Amol Umbarkar > wrote: > >> Hello again, >> I could not find record batch in Go Implementation. Is the chunkedArray >> same as record batch? >> >> Thanks, >> Amol >> > --000000000000d23ec205a39fbfcb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Apr 19, 2020 at 9:21 AM Micah= Kornfield <emkornfield@gmail.c= om> wrote:
Hi Amol,
I don't have much experience with= Go, but it looks like array.Record might be the equivalent of a RecordBatc= h in Go (https://github.com/apache/arrow/blob/= master/go/arrow/array/record.go#L111)=C2=A0(that is what the IPC Writer= classes seems to accept).

indeed, it= 's called Recrod.


-s
<= div>=C2=A0

Cheers,
Micah


On Sun, Apr 19, 2020 at 12:11 AM Amol Umbarkar <amolumbarkar@gmail.com> wrote:=
Hello again,
I could not find record batch in Go Implementation. Is t= he chunkedArray same as record batch?

Thanks,
Amol
--000000000000d23ec205a39fbfcb--