From dev-return-6199-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Mon Apr 2 21:34:13 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 381B2180627 for ; Mon, 2 Apr 2018 21:34:13 +0200 (CEST) Received: (qmail 17914 invoked by uid 500); 2 Apr 2018 19:34:12 -0000 Mailing-List: contact dev-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@arrow.apache.org Delivered-To: mailing list dev@arrow.apache.org Received: (qmail 17898 invoked by uid 99); 2 Apr 2018 19:34:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Apr 2018 19:34:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id DE522C184D for ; Mon, 2 Apr 2018 19:34:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.379 X-Spam-Level: X-Spam-Status: No, score=0.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id w5tOSCxJqNpc for ; Mon, 2 Apr 2018 19:34:09 +0000 (UTC) Received: from mail-it0-f46.google.com (mail-it0-f46.google.com [209.85.214.46]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id E8A555F47E for ; Mon, 2 Apr 2018 19:34:08 +0000 (UTC) Received: by mail-it0-f46.google.com with SMTP id e98-v6so19642187itd.4 for ; Mon, 02 Apr 2018 12:34:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=R3jR9Kr97ARGnyYciRcNCgCuMeInMrrogzaCEmbeygA=; b=clfvARa/vOODFwAqd/lwvO0ltuEYkjp5osgANDD20AxrTThWZZ8BrrG+Nr+hZTb86E vzQWNa7bzHNaFM3bdXwSgQnRQ7V+I/XbJEi8wLXgfbxGR6UKcr96apwSPrwOCy5EnyZF G5cDLfQF5fNViQCQVxcf+eHcWGYIV6NEoE4xbqYeBtFzuDdLlEhP1ax/VqA154ydPaM7 cVYC5RIu213RFUi2986jQdUXf3ARbGgz5BQdU774H75F7OrEzdY+r6+ZtcguS+CwnNjl UaeckwtzMvKHUVgXbQvThPpiBqGqvuMrvaTQXg/tHMPUsvoEo8Z1QLyA28BDc4tUspwV IA6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=R3jR9Kr97ARGnyYciRcNCgCuMeInMrrogzaCEmbeygA=; b=lPOUzb644cYc/9sZIDHR8mnlaiZXUc8j/kgNWcmsMZNd6cfqYfgVUe7ruPDqlGn+EV FDqcOKFxu0yvuK+3RzSbTtAcNK+GZtrKjhY/65OPm+8sK5LsTHHY/I6Vho+UR0VwHfhn GxCvjLqpsZZNzSh0VPjHKo18HsdFo/rdS7FlS7MakQuMXTnDq5Rm/PV+F0eR8P+Os5r4 VqP6gNqob8BCv72kRATux6/vyqhXAzuqn34KpGoSKFYOTuzoU7qqoJYb/GVHYWfJ/W+a 5oY4QSG7PlthIG8CzNHFHfQKpw2nDmByitKvotUhQjuuVqa8zuDKm4pRgAHazeKT65sE MbCA== X-Gm-Message-State: ALQs6tAvR6r5lyL9LQLm+fzNzZNcjh8uzalNIJNhIY8ospiVGCnXs5+x fQsk4nhjN2bVIslCWFKOHM3BkTyNENGLyd1yE2PA1A== X-Google-Smtp-Source: AIpwx4+thzyjje805AGLI9jbENIT3dsgRdpfDGU8FvwymhQJ3WIhM6jKMaKFs7AhEfrimVfUell+kcJogLGog39KFQ4= X-Received: by 2002:a24:1ad8:: with SMTP id 207-v6mr2129001iti.99.1522697647094; Mon, 02 Apr 2018 12:34:07 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.210.67 with HTTP; Mon, 2 Apr 2018 12:33:26 -0700 (PDT) In-Reply-To: References: From: Wes McKinney Date: Mon, 2 Apr 2018 15:33:26 -0400 Message-ID: Subject: Re: Upstream segmentation fault when using 0.9.0, OK with 0.8.0 To: dev@arrow.apache.org Content-Type: text/plain; charset="UTF-8" hi Rares -- does SciDB use Protocol Buffers? You may be running into a version conflict with the vendored protocol buffers libraries that's part of -DARROW_ORC=on Wes On Sun, Apr 1, 2018 at 9:48 PM, Rares Vernica wrote: > Hello, > > I'm using libarrow.so to build a simplified SciDB "plugin". The plugin gets > loaded dynamically into a running SciDB instance. The plugin just does > arrow::default_memory_pool(). With Arrow 0.8.0, the plugin gets loaded > successfully and can be used in SciDB. With Arrow 0.9.0, SciDB crashes when > it tires to load the .so file of the plugin. I'm not sure if it is an Arrow > issue or some non-Arrow issue that just pops up now. > > The example used here is highly simplified. I'm experiencing this situation > in the more complex accelerated_io_tools SciDB plugin > https://github.com/Paradigm4/accelerated_io_tools I've been using this > plugin for a while successfully with Arrow 0.8.0. > > I'm using a Ubuntu Trusty instance with Arrow packages from > red-data-tools.org. I also tried with Arrow packages compiled from source > using g++ 4.9, but the issue is still present. > > I compile the plugin like this: > > "/usr/bin/g++-4.9" -W -Wextra -Wall -Wno-unused-parameter > -Wno-variadic-macros -Wno-strict-aliasing -Wno-long-long -Wno-unused -fPIC > -D_STDC_FORMAT_MACROS -Wno-system-headers -g -DNDEBUG -D_STDC_LIMIT_MACROS > -fno-omit-frame-pointer -std=c++14 -DCPP11 -I. > -DPROJECT_ROOT="\"/opt/scidb/18.1\"" > -I"/opt/scidb/18.1/3rdparty/boost/include/" -I"/opt/scidb/18.1/include" -o > liblimit.so plugin.cpp LogicalLimit.cpp PhysicalLimit.cpp -shared > -Wl,-soname,liblimit.so -L. -L"/opt/scidb/18.1/3rdparty/boost/lib" > -L"/opt/scidb/18.1/lib" -Wl,-rpath,/opt/scidb/18.1/lib: -lm -larrow > > Here is the backtrace when I try to load the plugin: > > Program received signal SIGSEGV, Segmentation fault. > [Switching to Thread 0x7fcf89669700 (LWP 1096)] > 0x00007fcf96048240 in std::string::resize(unsigned long, char) () > from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 > (gdb) bt > #0 0x00007fcf96048240 in std::string::resize(unsigned long, char) () > from /usr/lib/x86_64-linux-gnu/libstdc++.so.6 > #1 0x00007fcf985081e8 in > google::protobuf::internal::WireFormatLite::ReadString(google::protobuf::io::CodedInputStream*, > std::string*) () > from /usr/lib/x86_64-linux-gnu/libprotobuf.so.8 > #2 0x00007fcf98545539 in > google::protobuf::FileDescriptorProto::MergePartialFromCodedStream(google::protobuf::io::CodedInputStream*) > () > from /usr/lib/x86_64-linux-gnu/libprotobuf.so.8 > #3 0x00007fcf8859b11c in ?? () from /usr/lib/x86_64-linux-gnu/libarrow.so.0 > #4 0x00007fcf885e1533 in ?? () from /usr/lib/x86_64-linux-gnu/libarrow.so.0 > #5 0x00007fcf885a278a in ?? () from /usr/lib/x86_64-linux-gnu/libarrow.so.0 > #6 0x00007fcf885808ac in ?? () from /usr/lib/x86_64-linux-gnu/libarrow.so.0 > #7 0x00007fcf998081da in ?? () from /lib64/ld-linux-x86-64.so.2 > #8 0x00007fcf998082c3 in ?? () from /lib64/ld-linux-x86-64.so.2 > #9 0x00007fcf9980cd00 in ?? () from /lib64/ld-linux-x86-64.so.2 > #10 0x00007fcf99808094 in ?? () from /lib64/ld-linux-x86-64.so.2 > #11 0x00007fcf9980c44b in ?? () from /lib64/ld-linux-x86-64.so.2 > #12 0x00007fcf991cf02b in ?? () from /lib/x86_64-linux-gnu/libdl.so.2 > #13 0x00007fcf99808094 in ?? () from /lib64/ld-linux-x86-64.so.2 > #14 0x00007fcf991cf62d in ?? () from /lib/x86_64-linux-gnu/libdl.so.2 > #15 0x00007fcf991cf0c1 in dlopen () from /lib/x86_64-linux-gnu/libdl.so.2 > #16 0x0000000000951c8b in scidb::PluginManager::findModule(std::string > const&, bool*) () > #17 0x000000000095235f in scidb::PluginManager::loadLibrary(std::string > const&, bool) () > #18 0x0000000000ccb1a2 in > scidb::PhysicalLoadLibrary::execute(std::vector, > std::allocator > >&, > std::shared_ptr) () > #19 0x0000000000a37c6f in > scidb::PhysicalOperator::executeWrapper(std::vector, > std::allocator > >&, > std::shared_ptr) () > #20 0x00000000009e5628 in > scidb::QueryProcessorImpl::execute(std::shared_ptr, > std::shared_ptr, int) () > #21 0x00000000009e5dd9 in > scidb::QueryProcessorImpl::execute(std::shared_ptr) () > #22 0x0000000000a1c6f4 in > scidb::SciDBExecutor::completeExecuteQuery(scidb::QueryResult&, > std::shared_ptr const&) () > #23 0x0000000000903964 in > scidb::ClientMessageHandleJob::completeExecuteQuery(std::shared_ptr > const&) () > #24 0x00000000009005a6 in scidb::ClientMessageHandleJob::run() () > #25 0x000000000093d59a in > scidb::Job::executeOnQueue(std::weak_ptr&, > std::shared_ptr&) () > #26 0x00000000008b34b7 in > scidb::WorkQueue::invokeWithContext(boost::function (std::weak_ptr&, > std::shared_ptr&)>&, > std::shared_ptr&, > std::weak_ptr&) () > #27 0x0000000000972ac3 in scidb::WorkQueue::WorkQueueJob::run() () > #28 0x000000000093d6d1 in scidb::Job::execute() () > #29 0x0000000000947f39 in scidb::Thread::_threadFunction() () > #30 0x0000000000948b39 in scidb::Thread::threadFunction(void*) () > #31 0x00007fcf993da184 in start_thread () > from /lib/x86_64-linux-gnu/libpthread.so.0 > #32 0x00007fcf9579a03d in clone () from /lib/x86_64-linux-gnu/libc.so.6 > > Notice libarrow in frames #3-6. Also interesting is libprotobuf in frames > #1-2. > > Any ideas are welcome. > > Thanks! > Rares