From user-return-755-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Mon Nov 9 14:01:44 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 4819318065C for ; Mon, 9 Nov 2020 15:01:44 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id 44B5964C86 for ; Mon, 9 Nov 2020 14:01:43 +0000 (UTC) Received: (qmail 62725 invoked by uid 500); 9 Nov 2020 14:01:42 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 62710 invoked by uid 99); 9 Nov 2020 14:01:42 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Nov 2020 14:01:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 7D56F1FF39F for ; Mon, 9 Nov 2020 14:01:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: -0.2 X-Spam-Level: X-Spam-Status: No, score=-0.2 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamproc1-he-de.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id 7pyacjHHuhLY for ; Mon, 9 Nov 2020 14:01:41 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::12a; helo=mail-lf1-x12a.google.com; envelope-from=wesmckinn@gmail.com; receiver= Received: from mail-lf1-x12a.google.com (mail-lf1-x12a.google.com [IPv6:2a00:1450:4864:20::12a]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 0B9FC7F7A0 for ; Mon, 9 Nov 2020 14:01:40 +0000 (UTC) Received: by mail-lf1-x12a.google.com with SMTP id f11so6275412lfs.3 for ; Mon, 09 Nov 2020 06:01:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=zph+ifQThtdwmP4m0X35aEcLsoNTdep5CJQo/aDOqtU=; b=SdMzstszJx07y8g57i6KaSoSMylmyL3RDydpnoYUxgmeLzi0llNAfP8AHILPFuHI2N yUgkhzpO0tVl5F+DO2svjo8KDj8eFdYtcrO2vLlIYQfOSLZm52kj/sI148zBrXDXXoJE PnqWpsECYlfct36z4SJLTCuq7Ofbcfc99/19BAZDw16bk220En39Kk1TCYoNTi/meKl9 UthzZztviEm6fuJwENcbXKaUiXq4qi3A/JNx1qwy62QQmot0mTiH1JLXrMV/uUIAbVrD bnsaxiGX/kFDXtTkUEQEV4c8DoH97XkFGDUiIvjZ1qNKHktlg5aQmekQt9lRzNP6PTwA 4fYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=zph+ifQThtdwmP4m0X35aEcLsoNTdep5CJQo/aDOqtU=; b=gRpIZIGP4iKL8tnWszAQZzv7wzpDPgcYyQZs5mBlcBIG2CUDwBrqe7E6XHrTloFDTt ZcqPY7b2V5RAvxRnRmEc5AEfRVh8SWXdm2X4YS1cJ8I65QPgw7W0JTjFxlmB0NIZ8urX hAd5oZzXb6tnP0lwvSV1MM+JhmxwQ1lYY2zQD9hgYpBLhf5dm9fXOZDA/8Hywh+6guF/ SWE3glzYKaDm6/6xwVVyX/aOq3ONiUkc86azWmA7B8QeS2+ncZ/PpCAW+4NliY52vCkT e6D0/qMrpEUxAiJxi5DshkTpEnzxqOFUVQx1yndP06At6kL/xfYPJ22S4ppPxC9r4FwK a6UA== X-Gm-Message-State: AOAM531MnsTUB+c2/uKl+bO3LzCBl29OsOJuTiqC8tXpJyYL/a4jHSBc nIEfSP2Edh25sBGBxOPRb+/8yNAr8RqcCXcTVFvuFEPVO5oTGA== X-Google-Smtp-Source: ABdhPJxx7QCETYwfZXsOkR6hp+UoNVa0+zYp+UnsG8RkpkQfL94FINVnIRJFkIhTr8xQnHHHPpdhE96eSUtZ0qXilrg= X-Received: by 2002:a19:48c2:: with SMTP id v185mr5413272lfa.429.1604930499834; Mon, 09 Nov 2020 06:01:39 -0800 (PST) MIME-Version: 1.0 References: <9219cb7c-b332-aac4-d884-d211a97423bd@gmx.com> In-Reply-To: <9219cb7c-b332-aac4-d884-d211a97423bd@gmx.com> From: Wes McKinney Date: Mon, 9 Nov 2020 08:01:03 -0600 Message-ID: Subject: Re: Arrow C++ API - memory management To: user@arrow.apache.org Content-Type: text/plain; charset="UTF-8" We'd prefer to answer questions on the mailing list or Jira (if something looks like a bug). There isn't enough detail on the SO question to understand what other things might be going on, but you are never destroying this->mArrowTable which is holding on to allocated memory. If the memory use keeps going up through repeated calls to the CSV reader that sounds like a possible leak, so we would need to see more details, including about your platform. On Mon, Nov 9, 2020 at 2:33 AM Maciej Skrzypkowski wrote: > > Hi All! > > I don't understand memory management in C++ Arrow API. I have some > memory leaks while using it. I've created Stackoverflow question, maybe > someone would answer it: > https://stackoverflow.com/questions/64742588/how-to-manage-memory-while-reading-csv-using-apache-arrow-c-api > . > > Thanks, > Maciej Skrzypkowski >