From dev-return-4344-archive-asf-public=cust-asf.ponee.io@openwhisk.apache.org Mon Aug 19 09:39:25 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 447FD180665 for ; Mon, 19 Aug 2019 11:39:25 +0200 (CEST) Received: (qmail 34454 invoked by uid 500); 19 Aug 2019 09:39:24 -0000 Mailing-List: contact dev-help@openwhisk.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@openwhisk.apache.org Delivered-To: mailing list dev@openwhisk.apache.org Received: (qmail 34441 invoked by uid 99); 19 Aug 2019 09:39:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Aug 2019 09:39:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 784301A4218 for ; Mon, 19 Aug 2019 09:39:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.901 X-Spam-Level: X-Spam-Status: No, score=-0.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=sciabarra.com header.b=Pknm5rjh; dkim=pass (2048-bit key) header.d=messagingengine.com header.b=g/ZItdUY Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id bytvrwm7zjfj for ; Mon, 19 Aug 2019 09:39:20 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=66.111.4.26; helo=out2-smtp.messagingengine.com; envelope-from=michele@sciabarra.com; receiver= Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 2D375BC7A9 for ; Mon, 19 Aug 2019 09:39:20 +0000 (UTC) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 014B521F14 for ; Mon, 19 Aug 2019 05:39:13 -0400 (EDT) Received: from imap36 ([10.202.2.86]) by compute2.internal (MEProxy); Mon, 19 Aug 2019 05:39:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sciabarra.com; h=mime-version:message-id:in-reply-to:references:date:from:to :subject:content-type; s=fm2; bh=mx8O6yncIcgN2zNrfG+kfE0ss2Rinff RFPWwh7IJM6k=; b=Pknm5rjhFvBBU/vBHhehHir4pGXzI7zZmCM6RRd1Yo95Zqq xEWDJY7Yn74EF1NUZePv0VdTCnRDv2p5Wo+ejVvup7m5izxpYpFs4oIo8Q/ppvw6 21rm+ik7cSkhNb0k/ubJ8pxf76zKXrdEliLR04geqUHaMBQKxgW/LjnwDKCt4wvy Ye690HFWy1STBALm6v+Zpq1GptucwsjuZdC2fWBNvwvLnLHzhjDTHK07ce/Z/NRd RLzKuzvNfOtl23R89C4PElvoRIMtsSfAAI78nBY8uyw/a0GVVj6EemSNsqzpe9JT 63Cxpb0YdimDjALPYTQcTVVS4E3gbGOkgzCs0gg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=mx8O6y ncIcgN2zNrfG+kfE0ss2RinffRFPWwh7IJM6k=; b=g/ZItdUYng+g5u78/4MqeH P6jCPUqrTf/K0eJC3maItCEYQDfG4W7nIgHJV6WM/byQXXaYI7KINAX6rdl/QwJh tLlldx8UNclbtW0AEqszNRUxnQ8UlyIv/aYGyfZQmkuzQH/y47ZZI3bv4I9aa/xF 4jGq03bQDTy2m+1k/nzysVNmACbUoi3TjEGGeDTWAuaTL2dnL61HcLrJXUOdUUrz gsQBSfskHmMKTs6fqYmxO3smWO6HuVX6WeaVRrJAYSSK5PEBejuOp05TInICcqAq 8k+Mpw0Ppfgoua6udxtQv9JmAKUsijS2epekQ+V1RrymCD5faKhvxGt/gcFRMy8w == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduvddrudefledgudekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpedfofhitghhvghlvgcuufgtihgrsggrrhhrrgdfuceomhhi tghhvghlvgesshgtihgrsggrrhhrrgdrtghomheqnecuffhomhgrihhnpehgihhthhhusg drtghomhdpthgvkhhtohhnrdguvghvnecurfgrrhgrmhepmhgrihhlfhhrohhmpehmihgt hhgvlhgvsehstghirggsrghrrhgrrdgtohhmnecuvehluhhsthgvrhfuihiivgeptd X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 9938112200A2; Mon, 19 Aug 2019 05:39:12 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.6-877-g11309a8-fmstable-20190819v1 Mime-Version: 1.0 Message-Id: In-Reply-To: <1f995dc3-e834-4ac3-bfcb-5e0eb0405979@www.fastmail.com> References: <1f995dc3-e834-4ac3-bfcb-5e0eb0405979@www.fastmail.com> Date: Mon, 19 Aug 2019 11:39:12 +0200 From: "Michele Sciabarra" To: dev@openwhisk.apache.org Subject: Re: Speeding up a tekton build Content-Type: text/plain I show also some numbers. This is the log of an action build running on a mac with 32 GB ./build.sh taskrun.tekton.dev/kwhisk-build-1566207093 created NAME READY STATUS RESTARTS AGE controller 2/2 Running 0 15m kaniko-load-cache-w7p9f 0/1 Completed 0 15m kwhisk-build-1566206965-pod-9e2c26 0/4 Completed 0 2m8s kwhisk-build-1566207093-pod-207db6 0/4 Pending 0 0s kwhisk-build-1566207093-pod-207db6 0/4 Init:0/3 0 1s kwhisk-build-1566207093-pod-207db6 0/4 Init:1/3 0 9s kwhisk-build-1566207093-pod-207db6 0/4 Init:2/3 0 10s kwhisk-build-1566207093-pod-207db6 0/4 PodInitializing 0 11s kwhisk-build-1566207093-pod-207db6 4/4 Running 0 13s kwhisk-build-1566207093-pod-207db6 4/4 Running 0 13s kwhisk-build-1566207093-pod-207db6 2/4 Running 0 16s kwhisk-build-1566207093-pod-207db6 1/4 Running 0 70s kwhisk-build-1566207093-pod-207db6 0/4 Completed 0 71s On a recent Mac with 32GB it takes 71 seconds. On a server with Linux and 64GB it takes 50s, on a Mac with 16gb it takes 10 minutes. I cannot think of making the build simpler. It is only one step build, that download data from a git repository and pushes a very thin layer on a docker registry. I cached the base image with kaniko. I am very seriously concerned about this situation. -- Michele Sciabarra michele@sciabarra.com ----- Original message ----- From: Michele Sciabarra To: dev@openwhisk.apache.org Subject: Speeding up a tekton build Date: Monday, August 19, 2019 6:59 AM Hello Whiskers, I created a tekton build using a modified version of the actionloop runtime. Code here: https://github.com/sciabarracom/openwhisk-knative/blob/master/installer/kwhisk/build-task.yml I tried also to setup a cache for Kaniko and preload the image: https://github.com/sciabarracom/openwhisk-knative/blob/master/installer/kwhisk/kaniko-cache.yaml However when I try to build the image it takes a lot, really a lot of time. Several minutes, often more than 10minutes. The build executed with docker takes just a few seconds . Anyone shares my experience with knative build speed? This is a serious problem because creating an image is essential to be able to use knative serving. -- Michele Sciabarra michele@sciabarra.com