From dev-return-8043-archive-asf-public=cust-asf.ponee.io@mxnet.apache.org Tue Aug 25 22:30:26 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 8F1EF1804BB for ; Wed, 26 Aug 2020 00:30:26 +0200 (CEST) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id 8CB92124F96 for ; Tue, 25 Aug 2020 22:30:25 +0000 (UTC) Received: (qmail 66636 invoked by uid 500); 25 Aug 2020 22:30:25 -0000 Mailing-List: contact dev-help@mxnet.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.apache.org Delivered-To: mailing list dev@mxnet.apache.org Received: (qmail 66619 invoked by uid 99); 25 Aug 2020 22:30:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Aug 2020 22:30:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4CD571A4256 for ; Tue, 25 Aug 2020 22:30:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.328 X-Spam-Level: X-Spam-Status: No, score=-0.328 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_HIGH=-0.958, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.248, HTML_IMAGE_ONLY_24=1.282, HTML_MESSAGE=0.2, MAILING_LIST_MULTI=-1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=github.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 9s6oPETrs0ky for ; Tue, 25 Aug 2020 22:30:22 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.179; helo=mail-lj1-f179.google.com; envelope-from=dmlc.notification+caf_=dev=mxnet.apache.org@gmail.com; receiver= Received: from mail-lj1-f179.google.com (mail-lj1-f179.google.com [209.85.208.179]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 592B4BC1A3 for ; Tue, 25 Aug 2020 22:30:22 +0000 (UTC) Received: by mail-lj1-f179.google.com with SMTP id h19so59803ljg.13 for ; Tue, 25 Aug 2020 15:30:22 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:delivered-to:dkim-signature:date:from:reply-to :to:cc:message-id:in-reply-to:references:subject:mime-version :content-transfer-encoding:precedence:list-id:list-archive:list-post :list-unsubscribe; bh=D/+2+IR0qcNQBvz4Z8royBp3waAKOe+3G5B5DnoS6P0=; b=G+EahJ6Xt5pDB5quWA+JFk4AGsOiRnTLZ6ZjpFYXUMFqRQh8HXJsF8/hCdQzoIffMw b4Fbbo0++Sy9rn/SxvKZPFlt9ZD49f3j+EnzzKLMNOT8S+11vUXFo7jrkHZNlBIZUjJr GN9YVjaM18Ucz6HXiZvxBH1jOV7w3OJeBc6CiW1ZRZd6OUhIfVlec0tPyQgDUc9QRv3j vPvcBvlJ6kAXAeQulqh67ebyY0dC28uqejSIwpmJ/HYixMZOdleZTAlJHky2aj3+OK/T L/xE+jSt9HxlWn0R9vLRRoaKHzweTiekPXd85N5AiuJBULPsOIlXNp8DNS6E8whZiBPf OQig== X-Gm-Message-State: AOAM530tl0tWAgBlFFsN5UanKMof1xtiksXEzUvoqcHk0qXOZpyh9y6N MXziGn+RezZg125E/V3WEfBegnWuYkwf0mLwGaWDy5D6DaBsy3ZqqA== X-Received: by 2002:a2e:b70b:: with SMTP id j11mr5328492ljo.259.1598394621301; Tue, 25 Aug 2020 15:30:21 -0700 (PDT) X-Forwarded-To: dev@mxnet.apache.org X-Forwarded-For: dmlc.notification@gmail.com dev@mxnet.apache.org Delivered-To: dmlc.notification@gmail.com Received: by 2002:ab3:1114:0:0:0:0:0 with SMTP id j20csp3422478lta; Tue, 25 Aug 2020 15:30:19 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyAW7QoQJAZfqEKDNpUWPfQka9ojVXfmst7Al9yzU7ovSsq0Z9XKCM8qEkfuGAb9S1cK9h3 X-Received: by 2002:a17:90b:4c47:: with SMTP id np7mr3114127pjb.1.1598394619528; Tue, 25 Aug 2020 15:30:19 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1598394619; cv=none; d=google.com; s=arc-20160816; b=k4IzqYK0TxSeUXJg3DMIneWO0r90bFnvFXDRyw2Ric0P5bl3U44xDKJ8VjYsY457s4 TsKJp8ElzRDgzrBNkPaT9HCdowLCMGIIxvvt3m9v+Q3ZQYpSSdFtU12nviQ6oVTm+3mx 2ZvDxPBSlm5+Bwitvk+7lDdzNkms2AKfmjsSYEydpY43NqLJL7y81uNR0NUYbfzZ1y5Q CeHGrW8FyX9u3emM4YiymfB3Rrqhmajr4NB9NFadxYx8hvPkGIY+0D64caQwQ3aUye+B EHyUGXGLG9njIw8jylQS7STdKxNdVhevokGpHVo9GEY2/VbirkDg6P5Y4tnNtZLt/RUX ZNLQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-post:list-archive:list-id:precedence :content-transfer-encoding:mime-version:subject:references :in-reply-to:message-id:cc:to:reply-to:from:date:dkim-signature; bh=D/+2+IR0qcNQBvz4Z8royBp3waAKOe+3G5B5DnoS6P0=; b=YcwZUnC6kLUUQscJs4u8esSqhIY387oxoqX6F4w/Gt8TDFPr1XCvxPUNby49ujvGhU 8Dz1FJyXGbnYAZFj9SGS44MW5wMBoyNU227Z+e1inEIwOo4N157QlH6CgW1LBVrDVOL8 gIcsy4W35kUxdX0qa4kHTtgE0tEby9HUAhl8WdYyKHyDi502f5SYDBTf+kOugl9vZUXs aJ+cqtA9Ea9Wv2hAMYI00WW2w7w5UNLtvKBPoNNsduFARoDsth40bUFC7apo3EXa1n1a wtQE3az2PZ/z9KszfCPyReTTB8RJVunTnZSIXZK7sz2xMq3FAnuAAhx9Zzp8rBynWffm XcgA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass (test mode) header.i=@github.com header.s=pf2014 header.b=K6MFR1JG; spf=pass (google.com: domain of noreply@github.com designates 192.30.254.193 as permitted sender) smtp.mailfrom=noreply@github.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=github.com Received: from out-10.smtp.github.com (out-10.smtp.github.com. [192.30.254.193]) by mx.google.com with ESMTPS id l1si96957plb.136.2020.08.25.15.30.19 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 25 Aug 2020 15:30:19 -0700 (PDT) Received-SPF: pass (google.com: domain of noreply@github.com designates 192.30.254.193 as permitted sender) client-ip=192.30.254.193; Authentication-Results: mx.google.com; dkim=pass (test mode) header.i=@github.com header.s=pf2014 header.b=K6MFR1JG; spf=pass (google.com: domain of noreply@github.com designates 192.30.254.193 as permitted sender) smtp.mailfrom=noreply@github.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=github.com Received: from github-lowworker-2300405.va3-iad.github.net (github-lowworker-2300405.va3-iad.github.net [10.48.17.39]) by smtp.github.com (Postfix) with ESMTP id EBDC2580D89 for ; Tue, 25 Aug 2020 15:30:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=github.com; s=pf2014; t=1598394619; bh=D/+2+IR0qcNQBvz4Z8royBp3waAKOe+3G5B5DnoS6P0=; h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:List-ID: List-Archive:List-Post:List-Unsubscribe:From; b=K6MFR1JGCtKR8fLJ+nbs5Cwo1BwwJavswgt4HnddmdDCWnHhlcJFqrmYKjxZ2eQ6w 470QtadZGH4IFB8bJGlvTNhBACgq2fVMC7njiBI0VWMKFKIBwX3ArrA+fWTMzJIjMV K9iVn+odeeuIXTZhZ5W+4TdPVvkltPJGjxky3yXM= Date: Tue, 25 Aug 2020 15:30:18 -0700 From: Sam Skalicky Reply-To: apache/incubator-mxnet To: apache/incubator-mxnet Cc: Sheng Zha , Mention Message-ID: In-Reply-To: References: Subject: Re: [apache/incubator-mxnet] [RFC] MXNet external operators (#18904) Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="--==_mimepart_5f4590faa653e_14b61964751d6"; charset=UTF-8 Content-Transfer-Encoding: 7bit X-GitHub-Sender: samskalicky X-GitHub-Recipient: szha X-GitHub-Reason: mention List-Archive: https://github.com/apache/incubator-mxnet X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: dmlc.notification@gmail.com ----==_mimepart_5f4590faa653e_14b61964751d6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit > @samskalicky, can clarify which symbols are needed for the external operators you are interested in? Not sufficiently, anything that anybody uses to write an internal/backend operator could be anything in MXNet/NNVM/TVM/mshadow/etc... so if the goal of the feature is enable any backend operator to be dynamically loaded, we have to export all symbols. The biggest problem with individual symbol exposure many symbols needed arent entirely defined in MXNet source code. One example is that the operator registration macro `NNVM_REGISTER_OP` resolves to something that calls `::dmlc::Registry<::nnvm::Op>::Get()` which is defined in **3rdparty/tvm/nnvm/src/core/op.cc**. So unless we go and modify that 3rd party code we're stuck. -- You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub: https://github.com/apache/incubator-mxnet/pull/18904#issuecomment-680301323 ----==_mimepart_5f4590faa653e_14b61964751d6--