From user-return-1109-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Mon Mar 22 11:27:37 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 9A96A180621 for ; Mon, 22 Mar 2021 12:27:37 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id DDAB563AFB for ; Mon, 22 Mar 2021 11:27:36 +0000 (UTC) Received: (qmail 51607 invoked by uid 500); 22 Mar 2021 11:27:36 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 51597 invoked by uid 99); 22 Mar 2021 11:27:35 -0000 Received: from spamproc1-he-fi.apache.org (HELO spamproc1-he-fi.apache.org) (95.217.134.168) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Mar 2021 11:27:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-fi.apache.org (ASF Mail Server at spamproc1-he-fi.apache.org) with ESMTP id 2F691C02D5 for ; Mon, 22 Mar 2021 11:27:35 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-fi.apache.org X-Spam-Flag: NO X-Spam-Score: 0.199 X-Spam-Level: X-Spam-Status: No, score=0.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.2, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamproc1-he-fi.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=airmettle-com.20150623.gappssmtp.com Received: from mx1-he-de.apache.org ([116.203.227.195]) by localhost (spamproc1-he-fi.apache.org [95.217.134.168]) (amavisd-new, port 10024) with ESMTP id vxVIMqamZ-XV for ; Mon, 22 Mar 2021 11:27:34 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::233; helo=mail-oi1-x233.google.com; envelope-from=matt.youill@airmettle.com; receiver= Received: from mail-oi1-x233.google.com (mail-oi1-x233.google.com [IPv6:2607:f8b0:4864:20::233]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 3DD797FC65 for ; Mon, 22 Mar 2021 11:27:34 +0000 (UTC) Received: by mail-oi1-x233.google.com with SMTP id f9so12661313oiw.5 for ; Mon, 22 Mar 2021 04:27:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=airmettle-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=CQl2Dkw/kTwO2pvMFFxLJZ95YXQSoElOzNJc96ZZlBY=; b=JSiXAw/xcc2uk45s2W6HTt6mLzgwfUYFfS/Csa8Hy+LbP5Vw7oKfohoG7bxTMgM2aO Tmdbi1pyTpSjU4gUH0tWuJuccqgyHof8gwLsayXUcew+pgQr6mSoxbyCOpxCxvL3IyOD r9bMQUzkzq6LrvemOjNwJ5DtoMrOFoycXqnantHLo+6p8FsRyazdDfpiFSTQk19qdIod wgkA51r/GpS3K9Dp7SGzI0Z3VqNPy1cYMiCZ05abxiSco0sO1wM/9LaJczY8V2kr9WJi v6ipT7ctyewk9R/CxNKQeYSK1SXMd0ddp/00IwJVvliAY7iDu+f9t6T7Bw1dCazBtDNg Iz4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=CQl2Dkw/kTwO2pvMFFxLJZ95YXQSoElOzNJc96ZZlBY=; b=OB9TQ3kNnR39ZcaJ1foZDugn8rMALymcg+HTIOdy7dRvDkPEwo93KmUn4Yh+KENx5W FllZETKaJnB978BOxDGYu32iKesf0BHIpsJVkoTjaOVmuLb2vhFFEg+d8RyRTfebTOPt WCX0oFwBZeea7e8E065q9wp92C03+xFPLSRmarj4qugNmgofVoP1QXMUGA2g4/PgNqMP bdCjkMHOxbDnNATwwd/GaEaoR9EPpw5w0VI67fxpfni9Qt56gw0DeVhd+ONHYtU2lcZ+ M0CE7npst1qlJ40vKlfjlGr78IdyfY5AeftyT45xBGFJSzbwFfqyNWp+IvX8H8n7MDuM GYAw== X-Gm-Message-State: AOAM532HbUNi8pF9VbtCnlM/55itfZRY8KhFuVri6+Rq88tmo2PRIW7+ Z2uRd6n+WsxGK+8QSIy56hm95z40UASRO9j6FIUuSBXbKrJAVw== X-Google-Smtp-Source: ABdhPJxylY1CGN8s6IGUmQjVObzeV9DEFmtIoP5S3Xo5+W5T02U2ziiyIZZO5tq+/ot6Xs4GNGeKdl/T0yxTlsNJsW0= X-Received: by 2002:aca:d907:: with SMTP id q7mr9320459oig.17.1616412452537; Mon, 22 Mar 2021 04:27:32 -0700 (PDT) MIME-Version: 1.0 References: <20210322113538.17442986@fsol> In-Reply-To: <20210322113538.17442986@fsol> From: Matt Youill Date: Mon, 22 Mar 2021 22:27:20 +1100 Message-ID: Subject: Re: Cannot create default memory pool To: user@arrow.apache.org Content-Type: multipart/alternative; boundary="0000000000000b5f2c05be1e5af5" --0000000000000b5f2c05be1e5af5 Content-Type: text/plain; charset="UTF-8" Could be the build creating multiple Arrows I suppose. It's a mixture of quite an old Makefile calling cmake to build arrow and arrow c lib. Will double check. Thanks, Matt On Mon., 22 Mar. 2021, 9:35 pm Antoine Pitrou, wrote: > On Mon, 22 Mar 2021 19:34:19 +1100 > Matt Youill wrote: > > Hi, > > > > Not sure if anyone knows anything about this, but am getting a strange > > error when evaluating a record batch with a gandiva filter... > > > > __GI_raise 0x00007f2b8f01718b > > __GI_abort 0x00007f2b8eff6859 > > arrow::util::ArrowLog::~ArrowLog() 0x000056309fe94c12 > > arrow::default_memory_pool() 0x000056309fd6fff4 > > gandiva::Annotator::PrepareEvalBatch(arrow::RecordBatch const&, > > std::vector, > > std::allocator > > const&) > > 0x000056309facdfce > > gandiva::LLVMGenerator::Execute(arrow::RecordBatch const&, > > std::vector, > > std::allocator > > const&) > > 0x000056309faa66a2 > > gandiva::Filter::Evaluate(arrow::RecordBatch const&, > > std::shared_ptr) 0x000056309fa9ea1d > > > > > > The error reported is "Internal error: cannot create default memory pool" > > > > I'm using jemalloc > > > > Not even really sure how a call to arrow::default_memory_pool() can > > fail? This is only occurring in a release build if that helps? > > This logically should not happen. How did you compile Arrow and > Gandiva? Do you have two versions of Arrow lying around perhaps? > > > > --0000000000000b5f2c05be1e5af5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Could be the build creating multiple Arrows I suppos= e. It's a mixture of quite an old Makefile calling cmake to build arrow= and arrow c lib.

Will d= ouble check.

Thanks, Mat= t

On Mon., 22 Mar. 2021, 9:35 pm Antoine Pitr= ou, <antoine@python.org> wr= ote:
On Mon, 22 Mar 2021 19:34:19 += 1100
Matt Youill <matt.youill@airmettle.com> wrote:
> Hi,
>
> Not sure if anyone knows anything about this, but am getting a strange=
> error when evaluating a record batch with a gandiva filter...
>
> __GI_raise 0x00007f2b8f01718b
> __GI_abort 0x00007f2b8eff6859
> arrow::util::ArrowLog::~ArrowLog() 0x000056309fe94c12
> arrow::default_memory_pool() 0x000056309fd6fff4
> gandiva::Annotator::PrepareEvalBatch(arrow::RecordBatch const&, > std::vector<std::shared_ptr<arrow::ArrayData>,
> std::allocator<std::shared_ptr<arrow::ArrayData> > > co= nst&)
> 0x000056309facdfce
> gandiva::LLVMGenerator::Execute(arrow::RecordBatch const&,
> std::vector<std::shared_ptr<arrow::ArrayData>,
> std::allocator<std::shared_ptr<arrow::ArrayData> > > co= nst&)
> 0x000056309faa66a2
> gandiva::Filter::Evaluate(arrow::RecordBatch const&,
> std::shared_ptr<gandiva::SelectionVector>) 0x000056309fa9ea1d >
>
> The error reported is "Internal error: cannot create default memo= ry pool"
>
> I'm using jemalloc
>
> Not even really sure how a call to arrow::default_memory_pool() can > fail? This is only occurring in a release build if that helps?

This logically should not happen.=C2=A0 How did you compile Arrow and
Gandiva?=C2=A0 Do you have two versions of Arrow lying around perhaps?



--0000000000000b5f2c05be1e5af5--