From dev-return-32645-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Mar 28 09:01:34 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 7051F180652 for ; Wed, 28 Mar 2018 09:01:33 +0200 (CEST) Received: (qmail 80520 invoked by uid 500); 28 Mar 2018 07:01:31 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 80504 invoked by uid 99); 28 Mar 2018 07:01:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Mar 2018 07:01:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5FABC1A167C for ; Wed, 28 Mar 2018 07:01:30 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.121 X-Spam-Level: X-Spam-Status: No, score=-0.121 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id dA91A2f9HYSM for ; Wed, 28 Mar 2018 07:01:28 +0000 (UTC) Received: from mail-lf0-f41.google.com (mail-lf0-f41.google.com [209.85.215.41]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0878A5F23E for ; Wed, 28 Mar 2018 07:01:28 +0000 (UTC) Received: by mail-lf0-f41.google.com with SMTP id m16-v6so1920888lfc.4 for ; Wed, 28 Mar 2018 00:01:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=NWSlaUVcRIJdFpXMMb7LZwK8Xh2ROVUqU2FIBMywvts=; b=T6snu7xeR1Xes0aKwTtJ10LOrPNG3ajBDN46rh7waF9ldTkGUVQ67jw1oVa77hYqXA Vm7uWIzTtW3Gtxv/V8UrpppMjOUuXV/OyCTZjLYg8UYzlCC7mjNqSOPI633ebOqzCVOS Lor4ucLAMdE0qcM/68QdaFjkukIJngjIEiK+OoiyTCsDOhVzH5ToJ9pfsh4i3i+S6GxA ooQKUNN6xJJNu6nYuLIXLoiF5K8vAFV1dkjulhDRKM6y39/UNYKeVZBPHwbitN9yq9sn eiLTUnqPandQzwrk+SimxeBKiPuplBjyBwOuU1M6yE1UqNqggwMiFsYQCP57ygS8I0g9 aBtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=NWSlaUVcRIJdFpXMMb7LZwK8Xh2ROVUqU2FIBMywvts=; b=jUnWsZxZs2S3s8eAFED+QWnF/oZtxGzNX8Vg+JQo//wztga3IIk2PkjvivogqxdXTA PZ3qEcdNF9LZ5GCs9mkEaCRUthLRqBwt4zJbW+OtWtXeEt1efvHZ7EByR3S39wBIct+b G4N16Zz8A72zzs3oLAYXJ5ysISBd4PzM+a8zZtflpxkqse3BPO/w6RAO8C0Qv9r9WPP2 4R4jDaTB8Jhu2u7nq14W/I9tKtG/Ut9Je8yuX/j8xNL0aTN74ewNC6c2x5XX34gh527x FMXHs9vw+elb8KR+SmEI4KTSck2Hy3+pcyDkJswdzZW3fVMJVMVjv0D3xmQr9Xsu03kg 1cQw== X-Gm-Message-State: AElRT7EsyHCP8CYyBERhbeFcm9BuMIUowMJSQIybU58WFG8uGLeYidR4 +jOwxxK1CVbQhvhW3+uoMTf8T4pc X-Google-Smtp-Source: AIpwx49xLoZdUsadRhNcKBMfUaZGrPfaEznlhn9+3JODguzwXYTm70L3a7ohspADs+NIqxSI0PkN8g== X-Received: by 2002:a19:5055:: with SMTP id z21-v6mr1466094lfj.4.1522220487165; Wed, 28 Mar 2018 00:01:27 -0700 (PDT) Received: from vveider-macbookpro.gridgain.local ([195.144.253.150]) by smtp.gmail.com with ESMTPSA id m13-v6sm557558lfc.41.2018.03.28.00.01.26 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 28 Mar 2018 00:01:26 -0700 (PDT) From: Petr Ivanov Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: Apache Ignite RPM packaging (Stage II) Date: Wed, 28 Mar 2018 10:01:25 +0300 References: <1521020161099-0.post@n4.nabble.com> <6A73B8D9-6ADF-4E6F-99BC-A6A6FE4579DC@gmail.com> <43596C64-F54D-4F35-BC67-001E0952126B@gmail.com> <07B5A6DF-B139-48BE-8294-E25F4378222C@gmail.com> <6650CEC4-B5F2-4350-BD7C-FEEDB6B0F71F@gmail.com> To: dev In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3445.5.20) No, not yet. Currently we are discussing RPM packages only. I want to get all feedback and possible errors working on RPM packages, = so that when we have stable agreed architecture and etc. I can recreate = it in DEB packages without necessity to fix bugs in both RPM and DEB = packages simultaneously. > On 28 Mar 2018, at 03:17, Dmitriy Setrakyan = wrote: >=20 > Petr, >=20 > I am confused. Do we already have Debian packages? >=20 > D. >=20 > On Tue, Mar 27, 2018 at 5:10 AM, Petr Ivanov = wrote: >=20 >> Hi, Igniters! >>=20 >>=20 >> Here are some news on our RPM packages initiative. >>=20 >> 1. I=E2=80=99ve finished preliminary developing of Stage II version = of RPM >> packages [1]. Main =E2=80=9Cnew feature=E2=80=9D is =E2=80=94 split = design. Also I=E2=80=99ve added >> package.sh script for automating package building process which will = help >> organise corresponding builds in TC as well as simplify process for >> developers who wishes to have custom packages. >> PR#3703 [2] is ready for review. Denis, in order to catch up with = Apache >> Ignite 2.5 release, I=E2=80=99d greatly appreciate your help in = finding reviewer. >> 2. With the help of ASF INFRA team, we now have RPM [3] and DEB [4] >> repositories on Apache Bintray. Though they are already prepared for >> hosting RPM and DEB packages respectively, and there is a way of = linking >> them to apache.org/dist/ignite page, there is possible alternative in >> storing there only plain directory layout corresponding to each = repository >> type (RPM and DEB) and manage this layout (repodata, distributions, >> versions, etc.) by ourselves, having more control over repositories = but >> lacking some simplicity of deploying new releases. WDYT? Should we = try >> Cassandra approach? They are storing their DEB packages as I = described >> above [5]. >>=20 >> Also =E2=80=94 a question arose while I was working on this issue: = which OSes (and >> which versions of each) are we going to support (if we are going) in = terms >> of step-by-step list? Currently RPM packages are tested only with = latest >> CentOS (and, respectively =E2=80=94 RHEL), but there are a lot more = RPM-based >> distributives [6] some of which are more o less popular among OS = community >> (ALT, Fedora, openSUSE, etc.). >>=20 >>=20 >> [1] https://issues.apache.org/jira/browse/IGNITE-7647 >> [2] https://github.com/apache/ignite/pull/3703 >> [3] https://bintray.com/apache/ignite-rpm >> [4] https://bintray.com/apache/ignite-deb >> [5] https://bintray.com/apache/cassandra/debian#files/ >> [6] = https://en.wikipedia.org/wiki/Category:RPM-based_Linux_distributions >>=20 >>=20 >>=20 >>=20 >>> On 15 Mar 2018, at 22:15, Petr Ivanov wrote: >>>=20 >>> I suppose that most everything if not all from libs/options will go = to >> OPTIONAL (I=E2=80=99d call it simply =E2=80=98apache-ignite-libs'). >>> More precise lib selection (if something from optional would better = to >> have in core package) will be discussed right after preliminary split >> architecture agreement. >>>=20 >>>=20 >>>=20 >>>> On 15 Mar 2018, at 22:11, Dmitry Pavlov = wrote: >>>>=20 >>>> I like idea of keeping simple system of modules, so +1 from me. >>>>=20 >>>> Where optional libs (e.g Direct IO plugin) would be included, would = it >> be >>>> core or optional? >>>>=20 >>>> =D1=87=D1=82, 15 =D0=BC=D0=B0=D1=80. 2018 =D0=B3. =D0=B2 22:09, = Denis Magda : >>>>=20 >>>>>>=20 >>>>>>>=20 >>>>>>> How big would be a final core module? >>>>>> Around 30M. Can be shrinked to ~15M if separate Visor and create = it=E2=80=99s >> own >>>>>> package. >>>>>=20 >>>>>=20 >>>>> Guys, 30 vs 280M is a huuuuge difference. I would agree with Petr = and >>>>> propose the simplest modular system: >>>>>=20 >>>>> - core module that includes basic Ignite capabilities including = SQL, >>>>> compute grid, service grid, k/v >>>>> - optional module hosts the rest - ML, streamers integration = (kafka, >>>>> flink), kubernetes, etc. >>>>>=20 >>>>> What do you think? >>>>>=20 >>>>> -- >>>>> Denis >>>>>=20 >>>>> On Thu, Mar 15, 2018 at 12:36 AM, Petr Ivanov = >> wrote: >>>>>=20 >>>>>> *DEB package >>>>>>=20 >>>>>>=20 >>>>>>> On 15 Mar 2018, at 10:35, Petr Ivanov = wrote: >>>>>>>=20 >>>>>>> Considering that DEV package for now is almost platform = independent >>>>> (its >>>>>> a java application more or less), that package will work almost = on any >>>>>> DEB-based linux, including but not limited to Ubuntu, Debian, = etc. >>>>>>> The only restriction is existence of systemctl (systemd) service >>>>> manager >>>>>> =E2=80=94 we are dependent on it. >>>>>>>=20 >>>>>>> Thats why, for instance, our RPM repository is called simply = =E2=80=98rpm=E2=80=99 >> and >>>>>> package has no arch or dist suffix =E2=80=94 it will work on = CentOS, RHEL, >>>>> Fedora, >>>>>> etc. with presence of aforementioned systemd. >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>>> On 15 Mar 2018, at 07:57, Dmitriy Setrakyan = >>>>>> wrote: >>>>>>>>=20 >>>>>>>> Will Debian package work for Ubuntu? >>>>>>>>=20 >>>>>>>> D. >>>>>>>>=20 >>>>>>>> On Wed, Mar 14, 2018 at 9:52 PM, Petr Ivanov = >>>>>> wrote: >>>>>>>>=20 >>>>>>>>> Not a problem, rather nuisance. Also, when we will move to = official >>>>>>>>> repositories, there can be a problem from OS community. >>>>>>>>>=20 >>>>>>>>> Concerning DEB packages =E2=80=94 I plan to use RPM as base = for DEB package >>>>>> build >>>>>>>>> (package layout / install scripts) for speeding up things and >>>>> excluding >>>>>>>>> possible duplication and desynchronisation, so its a matter of = =E2=80=99sit >>>>>> and do=E2=80=99 >>>>>>>>> rather then some technical research. Thats why I rose = discussion >>>>> about >>>>>>>>> future package architecture, so that after agreement I'm be = able to >>>>>> pack >>>>>>>>> both RPM and DEB identically. >>>>>>>>>=20 >>>>>>>>> Yet, if you insist, I can create DEB package according to = current >> RPM >>>>>>>>> layout in no time. >>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>>>> On 15 Mar 2018, at 04:53, Dmitriy Setrakyan < >> dsetrakyan@apache.org> >>>>>>>>> wrote: >>>>>>>>>>=20 >>>>>>>>>> Peter, >>>>>>>>>>=20 >>>>>>>>>> I don't think the package size of 280M is going to be a = problem at >>>>>> all, >>>>>>>>> but >>>>>>>>>> what you are suggesting can be an improvement down the road. >>>>>>>>>>=20 >>>>>>>>>> In the mean time, I think our top priority should be to = provide >>>>>> packages >>>>>>>>>> for Debian and Ubuntu. Having only RPMs is not nearly enough. >>>>>>>>>>=20 >>>>>>>>>> Agree? >>>>>>>>>>=20 >>>>>>>>>> D. >>>>>>>>>>=20 >>>>>>>>>> On Wed, Mar 14, 2018 at 5:36 AM, vveider = >>>>> wrote: >>>>>>>>>>=20 >>>>>>>>>>> Hi, Igniters! >>>>>>>>>>>=20 >>>>>>>>>>>=20 >>>>>>>>>>> Release 2.4 is almost there, at least binary part of it, so = I'd >>>>> like >>>>>> to >>>>>>>>>>> move >>>>>>>>>>> forward to further improve and widen AI delivery through >> packages. >>>>>>>>>>> As of now, Apache Ignite ships in RPM package weighing about >> 280M+ >>>>>> and, >>>>>>>>> to >>>>>>>>>>> improve usability and significantly reduce required download >>>>> sizes, I >>>>>>>>>>> purpose that in 2.5 release we introduce splitted delivery = as >>>>>> follows: >>>>>>>>>>> - CORE >>>>>>>>>>> - bin >>>>>>>>>>> - config >>>>>>>>>>> - libs (!optional) >>>>>>>>>>> - OPTIONAL LIBS >>>>>>>>>>> - BENCHMARKS >>>>>>>>>>> - DOCS (?) >>>>>>>>>>> - EXAMPLES >>>>>>>>>>> - .NET PLATFORM FILES >>>>>>>>>>> - C++ PLATFORM FILES >>>>>>>>>>>=20 >>>>>>>>>>> This architecture, as I assume, will add flexibility (no = reason >> to >>>>>>>>> download >>>>>>>>>>> all 280M+ of binaries where you are to run only core node >>>>>> functionality) >>>>>>>>>>> and >>>>>>>>>>> maintainability (you are in full control of what is = installed on >>>>> your >>>>>>>>>>> system). >>>>>>>>>>>=20 >>>>>>>>>>> After successful architecture choice, same scheme are = planned to >> be >>>>>>>>> used in >>>>>>>>>>> DEB packages as well. >>>>>>>>>>>=20 >>>>>>>>>>> WDYT? >>>>>>>>>>>=20 >>>>>>>>>>>=20 >>>>>>>>>>>=20 >>>>>>>>>>> -- >>>>>>>>>>> Sent from: = http://apache-ignite-developers.2346864.n4.nabble. >> com/ >>>>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>=20 >>>>>>=20 >>>>>>=20 >>>>>=20 >>>=20 >>=20 >>=20