From dev-return-7061-archive-asf-public=cust-asf.ponee.io@mxnet.incubator.apache.org Sun Dec 22 05:32:50 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 2562F180638 for ; Sun, 22 Dec 2019 06:32:50 +0100 (CET) Received: (qmail 73567 invoked by uid 500); 22 Dec 2019 05:32:49 -0000 Mailing-List: contact dev-help@mxnet.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mxnet.incubator.apache.org Delivered-To: mailing list dev@mxnet.incubator.apache.org Received: (qmail 73553 invoked by uid 99); 22 Dec 2019 05:32:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Dec 2019 05:32:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 89D32C04BC for ; Sun, 22 Dec 2019 05:32:47 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.074 X-Spam-Level: X-Spam-Status: No, score=0.074 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, HTML_IMAGE_ONLY_28=0.726, HTML_MESSAGE=0.2, MAILING_LIST_MULTI=-1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=github.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id ipCyYNH1Q8iI for ; Sun, 22 Dec 2019 05:32:46 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.173; helo=mail-lj1-f173.google.com; envelope-from=dmlc.notification+caf_=dev=mxnet.apache.org@gmail.com; receiver= Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 21C76BC537 for ; Sun, 22 Dec 2019 05:32:46 +0000 (UTC) Received: by mail-lj1-f173.google.com with SMTP id o13so3038136ljg.4 for ; Sat, 21 Dec 2019 21:32:46 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:delivered-to:dkim-signature:date:from:reply-to :to:cc:message-id:in-reply-to:references:subject:mime-version :content-transfer-encoding:precedence:list-id:list-archive:list-post :list-unsubscribe; bh=/UcQ9Y+pMnzhtvnSUkekT9J11+LVA+SrsGjgBGrDv+k=; b=LryQU1KM4An/2VURXmZCuy6QZdkfG2ntfhFqR/JE6oIi8I6vvpJ3WtgxMTXFoiqvVw hs3YAL31DrxCpmCP8E6KwBC0w5azQLoHcKId0Sr7c6QkjBjL6ayugvT3Z8HWR33sJUC8 Ix4s36lyb0dJhrQEaZR8/U/bPwxTozeM1H9i5grxFTwCxAQvreLlsnLR1sKFlIQ+3MvE 9z5/sYEMwkrEDPMr9FrTyp843bxOJNTUQ5N2mLw9xRxr/MSASFU8Ezi9mFUP4j0Fdyr2 DNYQTXnET0SQlBK5PZHgABooam6C4JIBbu2nI0SB3stTpvFln5307FtxXS4hnIPsEVyo W5dQ== X-Gm-Message-State: APjAAAXTaruY0MAs2mCv4lX2Vv85+ulwYrU4x5d3kxv/B0lt8H70O4rf pNWNcC26PYD7zKhZsM5Fe8Gy+1HnQtRJUfSr97gSYDCxah8MRUw= X-Received: by 2002:a2e:8804:: with SMTP id x4mr11092944ljh.187.1576992764729; Sat, 21 Dec 2019 21:32:44 -0800 (PST) X-Forwarded-To: dev@mxnet.apache.org X-Forwarded-For: dmlc.notification@gmail.com dev@mxnet.apache.org Delivered-To: dmlc.notification@gmail.com Received: by 2002:ab3:6f55:0:0:0:0:0 with SMTP id k21csp5669884ltp; Sat, 21 Dec 2019 21:32:43 -0800 (PST) X-Google-Smtp-Source: APXvYqx98DPsNEcnGidOwXkj3ECPCMix5lZymjyXEUUolmNnWrUFPIkOFRiiZynuGp2n9S5fMi7p X-Received: by 2002:a0c:acc6:: with SMTP id n6mr19309135qvc.26.1576992763233; Sat, 21 Dec 2019 21:32:43 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1576992763; cv=none; d=google.com; s=arc-20160816; b=yMkYZQc0hstPm396+RpvHsGCOnJKlqRO0A5DkwLiI/0Zg8+eYEXlOOrAFDwjVd/Yb/ JFxQEjiDEJ7pC+x6V3ucZ8fD2ZfBjm/cCM5iGo0v1m72ptVdReXt1RT0hlw+CemaKerx WrRAdbIatqP7GOyijLCRgysd1NXuO7x2+WTYqrU+985fnRlJDV+KGZfM5YKfIsrSHw7f P4pyNlbm4F57uNHW+FfAau2owTrL3u4uFg6Tkbtrv6Ijyp0TW2FEERgc7ltY9F9ekq6c LLa1Xgm671I9N7Da4e+KieTkhPudNRtKlAH9EtXbYhVWKL6LCcIH7+TDfXVdGuIGhgc0 zbeA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-post:list-archive:list-id:precedence :content-transfer-encoding:mime-version:subject:references :in-reply-to:message-id:cc:to:reply-to:from:date:dkim-signature; bh=/UcQ9Y+pMnzhtvnSUkekT9J11+LVA+SrsGjgBGrDv+k=; b=ZVFpY7Yzrbk/7IlJF0Dp/XYsV5/ePlFzQeyWflw9aArjRF8p7c4t9clNfowl79nnLR IPnOia4EiFTB5PCs73Ur/fKpEeDk338r0VYA2wUT0mlFTO5/2d0ZUvuklA1JGvvbnnmj fHR1LYBpwv5jusPW3yRa5hKRT02G164iLC2OV0aDxMVtDDeCUWMf4mNvhf4a6wFxEtMM 0kv0ijAY2ERt1dCYeLFTbLKQnJhaqqD1O+B453+4pUQT2sTuY2XzCIqx7z5eMtWwHoI0 9O0LfiMpcPHPq8M6XypfByDTMvc6lDeuw1RfS4Efn8sA7LQun6LhTYlt+QU8bxZt6c64 S5mg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass (test mode) header.i=@github.com header.s=pf2014 header.b=Jg181Ccr; spf=pass (google.com: domain of noreply@github.com designates 192.30.252.202 as permitted sender) smtp.mailfrom=noreply@github.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=github.com Received: from out-19.smtp.github.com (out-19.smtp.github.com. [192.30.252.202]) by mx.google.com with ESMTPS id a54si7238484qtb.243.2019.12.21.21.32.43 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 21 Dec 2019 21:32:43 -0800 (PST) Received-SPF: pass (google.com: domain of noreply@github.com designates 192.30.252.202 as permitted sender) client-ip=192.30.252.202; Authentication-Results: mx.google.com; dkim=pass (test mode) header.i=@github.com header.s=pf2014 header.b=Jg181Ccr; spf=pass (google.com: domain of noreply@github.com designates 192.30.252.202 as permitted sender) smtp.mailfrom=noreply@github.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=github.com Received: from github-lowworker-45eca55.ac4-iad.github.net (github-lowworker-45eca55.ac4-iad.github.net [10.52.25.70]) by smtp.github.com (Postfix) with ESMTP id E20805209E6 for ; Sat, 21 Dec 2019 21:32:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=github.com; s=pf2014; t=1576992762; bh=/UcQ9Y+pMnzhtvnSUkekT9J11+LVA+SrsGjgBGrDv+k=; h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:List-ID: List-Archive:List-Post:List-Unsubscribe:From; b=Jg181CcrjAWdQlQb4EcshjCuVyA9ocTHeYjKTZD9sooyH1MEVA97WWjG2D6rfos86 t+zd+C71NLGzA5okUNFX0Rco/HrKXZk2eolCYVMiQepUgmi2ODt/JI5OzEdJSpV96w C+wRg2G8qAJxwtdWhHVSAnopdO1w1p7Bk5lCBWkY= Date: Sat, 21 Dec 2019 21:32:42 -0800 From: Tianqi Chen Reply-To: apache/incubator-mxnet To: apache/incubator-mxnet Cc: Subscribed Message-ID: In-Reply-To: References: Subject: Re: [apache/incubator-mxnet] [RFC][mxnet 2.0][item 10.1] MXNet Imperative Op Invocation Overhead (#17097) Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="--==_mimepart_5dfefffad2291_659f3f907dccd95c1195311"; charset=UTF-8 Content-Transfer-Encoding: 7bit X-GitHub-Sender: tqchen X-GitHub-Recipient: szha X-GitHub-Reason: subscribed List-Archive: https://github.com/apache/incubator-mxnet X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: dmlc.notification@gmail.com ----==_mimepart_5dfefffad2291_659f3f907dccd95c1195311 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit The following fast-path can be addressed in the TVM FFI: - ```tuple``, ```list``` via translation in python/cython side (see benchmark above) - ```str``` is already fast (seem benchmark above) - ```Context``` can be quite fast if the object is a tvm object, around same mangitude as passing NDArray - ```np.dtype``` can get around by by str conversion, or introduce a type structure, TVM FFI support DLDataType natively - None: natively supported by FFI The following items needs to be discussed - py_slice, Ellipsis Can be supported by adding pyobject support, however that introduces dispatching into the FFI layer(making the function not accessible to other language frontends). Would be interesting to discuss alternatives -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/apache/incubator-mxnet/issues/17097#issuecomment-568234198 ----==_mimepart_5dfefffad2291_659f3f907dccd95c1195311--