arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Youill <matt.you...@airmettle.com>
Subject Re: Cannot create default memory pool
Date Thu, 25 Mar 2021 07:12:09 GMT
In case this helps anyone, issue was with build, not Arrow. I rewrote 
the old "legacy" Makefile and everything's behaving itself now. Not sure 
exactly what the problem was.

On 24/3/21 9:43 pm, Antoine Pitrou wrote:
> On Wed, 24 Mar 2021 14:04:13 +1100
> Matt Youill <matt.youill@airmettle.com> wrote:
>> So this seems to be caused by the variable in memory_pool.cc:
>>
>> const util::optional<MemoryPoolBackend> user_selected_backend =
>> UserSelectedBackend();
>>
>> being (or becoming) garbage.
>>
>> For some reason, after a few Gandiva batch evaluations
>> user_selected_backend is no longer "jemalloc" but "system" (probably
>> actually just null because "system" is 0) and after a while it isn't
>> valid at all and crashes.
> Hmm... perhaps you can try to set up a watchpoint on this variable
> under gdb?
> https://sourceware.org/gdb/current/onlinedocs/gdb/Set-Watchpoints.html
>
> Though I don't know if it would catch mutations due to memory
> corruption.
>
> Regards
>
> Antoine.
>
>

Mime
View raw message