From user-return-1115-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Wed Mar 24 10:43:57 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 5DD03180630 for ; Wed, 24 Mar 2021 11:43:57 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 996B643707 for ; Wed, 24 Mar 2021 10:43:56 +0000 (UTC) Received: (qmail 30746 invoked by uid 500); 24 Mar 2021 10:43:56 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 30736 invoked by uid 99); 24 Mar 2021 10:43:55 -0000 Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Mar 2021 10:43:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id 4B7CB1FF3AD for ; Wed, 24 Mar 2021 10:43:55 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org X-Spam-Flag: NO X-Spam-Score: 0.249 X-Spam-Level: X-Spam-Status: No, score=0.249 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.249, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-ec2-va.apache.org ([116.203.227.195]) by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024) with ESMTP id 2gm6O5HMQRm2 for ; Wed, 24 Mar 2021 10:43:53 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=116.202.254.214; helo=ciao.gmane.io; envelope-from=gcaau-arrow-user@m.gmane-mx.org; receiver= Received: from ciao.gmane.io (ciao.gmane.io [116.202.254.214]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 7EDC2BCD4E for ; Wed, 24 Mar 2021 10:43:53 +0000 (UTC) Received: from list by ciao.gmane.io with local (Exim 4.92) (envelope-from ) id 1lP0zQ-0000i4-Cj for user@arrow.apache.org; Wed, 24 Mar 2021 11:43:52 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: user@arrow.apache.org From: Antoine Pitrou Subject: Re: Cannot create default memory pool Date: Wed, 24 Mar 2021 11:43:47 +0100 Message-ID: <20210324114347.01e81a25@fsol> References: <20210322113538.17442986@fsol> <219f4c59-34a9-a273-2bcc-e587440b2910@airmettle.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Newsreader: Claws Mail 3.17.5 (GTK+ 2.24.32; x86_64-pc-linux-gnu) On Wed, 24 Mar 2021 14:04:13 +1100 Matt Youill wrote: > So this seems to be caused by the variable in memory_pool.cc: > > const util::optional user_selected_backend = > UserSelectedBackend(); > > being (or becoming) garbage. > > For some reason, after a few Gandiva batch evaluations > user_selected_backend is no longer "jemalloc" but "system" (probably > actually just null because "system" is 0) and after a while it isn't > valid at all and crashes. Hmm... perhaps you can try to set up a watchpoint on this variable under gdb? https://sourceware.org/gdb/current/onlinedocs/gdb/Set-Watchpoints.html Though I don't know if it would catch mutations due to memory corruption. Regards Antoine.