From dev-return-48476-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Thu Nov 28 19:30:12 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id D806018064C for ; Thu, 28 Nov 2019 20:30:11 +0100 (CET) Received: (qmail 80647 invoked by uid 500); 28 Nov 2019 19:30:11 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 80635 invoked by uid 99); 28 Nov 2019 19:30:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Nov 2019 19:30:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E6D641812DE for ; Thu, 28 Nov 2019 19:30:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.002 X-Spam-Level: *** X-Spam-Status: No, score=3.002 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_REPLY=1, HTML_MESSAGE=0.2, KAM_BADIPHTTP=2, NORMAL_HTTP_TO_IP=0.001, NUMERIC_HTTP_ADDR=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 6e5DFmGkNEVa for ; Thu, 28 Nov 2019 19:30:04 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.195; helo=mail-lj1-f195.google.com; envelope-from=saikat.maitra@gmail.com; receiver= Received: from mail-lj1-f195.google.com (mail-lj1-f195.google.com [209.85.208.195]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id D7F5CBC538 for ; Thu, 28 Nov 2019 19:30:03 +0000 (UTC) Received: by mail-lj1-f195.google.com with SMTP id m4so29516043ljj.8 for ; Thu, 28 Nov 2019 11:30:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=+gflpq0NrWO0fEyIWngnf8ITgr97MCWvlhAFow443zI=; b=rL67DbQ35T7KP1wGu/vhxGYnU7FieCZbw1My96EbSw6Q9q+v6LdpsOlSy+MzJqEiCx 7iNGkZdSXAFH07abCBZBvRLbW/Fb4jw9JoYOrcqsYnoQOywIAxoWQ5Ph1Zlgk4zw/u06 zXM4rsmADdFxTd1XMMV+G5EdKkfkyrimfZqCikhhuD9bpvPbcuyN2uJd9xoormO/pHeZ X9dTRW5VkikI4zvDnX6d+zWYjRv97Y12kDCpTO3TV4kjRezQnG0jP0SEFwV2jmBA38uE p0+ttpwkK2QkN6skUHMYpGQ1tCxkhVRImABntx4ZF4JDvqi9nodvjok2xIOhmJqgZJD4 G90w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=+gflpq0NrWO0fEyIWngnf8ITgr97MCWvlhAFow443zI=; b=hEcdVwnSAubOdfAOvcyHAIgHRvicEA8RWnga0n19YV2MKU4q3dNPVblQM1CX5Tu87Y DvByBOHJbtrnq6DV6UeyOwkenjj1W3HaC2Ba/MSbpwqXoZsK1j+Q3JdBAWNctnCgqFhn se3aOqzeUANmSPUHzpkFdQYLZgkDPDXCnH37Rd28mqA21KewDkpn2yyDGQl4UOmsYOJ5 UPFTDivMLSIghG//hhoqNsS+U/ChquGdddBNqAOtvs0aFRilp0dzgC8xmhP8z1AnOBJq 3+6nOK85Gv+W9M7mfj8Y+9UH9cPtbLPS6sX3EssHNBRK6RgmuTV54hMWJof8rlO2Yim9 KxUQ== X-Gm-Message-State: APjAAAXvNubL4IJPuLO2ghUEVw5A2VjHThLlgKTV0NDew9Bhbegm9FDG hq0CiY9Qr5AT52KV4lYR0bKWIFwlta5h2BHTps6OiQ== X-Google-Smtp-Source: APXvYqyehjt0+vw868mFe2Dh4/N1JtHj5HR818p3qDm/MISs4QP3rzrX8CmZ2Uiau0SZb1MWtP1hcHVczj+WPuQyBq4= X-Received: by 2002:a2e:9899:: with SMTP id b25mr3383583ljj.70.1574969401782; Thu, 28 Nov 2019 11:30:01 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Saikat Maitra Date: Thu, 28 Nov 2019 13:29:50 -0600 Message-ID: Subject: Re: [DISCUSS] Pub/Sub Streamer Implementation To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="000000000000b9b48205986d23ff" --000000000000b9b48205986d23ff Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, We do run build with -DskipTests and then configure selective test suites to run. I will check why these test suites are not getting executed. Regards Saikat On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras wrote: > Hi all, > > I did add a test suite and run the build with the corresponding arguments= , > however the tests did not run [1]. > I checked the Flink's build logs and the same message is displayed there > too `No tests to run` [2]. > > [1] > > https://ci.ignite.apache.org/viewLog.html?buildId=3D4798203&buildTypeId= =3DIgniteExtensions_Build&tab=3DbuildLog&branch_IgniteExtensions=3Dpull%2F2= %2Fhead&_focus=3D248 > [2] > > https://ci.ignite.apache.org/viewLog.html?buildTypeId=3DIgniteExtensions_= Build&buildId=3D4789199&tab=3DbuildLog&logTab=3Dtree&filter=3Ddebug&expand= =3Dall&_focus=3D1256 > > Kind regards > *Emmanouil Gkatziouras* > https://egkatzioura.com/ | > https://www.linkedin.com/in/gkatziourasemmanouil/ > https://github.com/gkatzioura > > > On Wed, 27 Nov 2019 at 18:58, Saikat Maitra > wrote: > > > Hi, > > > > We will need to add test suites for tests to be executed in build. We > pass > > them as TestSuites param. I had added Flink sink and source testsuites. > > > > Can you please review and confirm. > > > > Regards > > Saikat > > > > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras < > > gkatzioura@gmail.com> > > wrote: > > > > > Hi all! > > > > > > I was successful building and running my pull requests. It seems that > the > > > tests do not run both for Flink and Pub/Sub [1] > > > If there is something I cannot do to make them discoverable please le= t > me > > > know. > > > > > > [1] > > > > > > > > > https://ci.ignite.apache.org/viewLog.html?buildTypeId=3DIgniteExtensions_= Build&buildId=3D4796722&tab=3DbuildLog&logTab=3Dtree&filter=3Ddebug&expand= =3Dall&_focus=3D283 > > > > > > *Emmanouil Gkatziouras* > > > https://egkatzioura.com/ | > > > https://www.linkedin.com/in/gkatziourasemmanouil/ > > > https://github.com/gkatzioura > > > > > > > > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra > > > wrote: > > > > > > > Hi Emmanouil, > > > > > > > > I have added you as contributor in Ignite Extensions project. Can y= ou > > > > please check and confirm if you are able to see the project and > execute > > > > build on your pull request. > > > > > > > > Regards, > > > > Saikat > > > > > > > > On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras < > > > > gkatzioura@gmail.com> > > > > wrote: > > > > > > > > > Hi all! > > > > > > > > > > If someone could give me read access to the Job of Ignite > Extensions > > on > > > > > Team City will greatly help me (username gkatzioura). > > > > > I suppose the builds get triggered automatically on a pull reques= t. > > > > > > > > > > Kind regards, > > > > > Emmanouil > > > > > > > > > > *Emmanouil Gkatziouras* > > > > > https://egkatzioura.com/ | > > > > > https://www.linkedin.com/in/gkatziourasemmanouil/ > > > > > https://github.com/gkatzioura > > > > > > > > > > > > > > > On Sun, 24 Nov 2019 at 21:11, Emmanouil Gkatziouras < > > > > gkatzioura@gmail.com> > > > > > wrote: > > > > > > > > > > > Hi Saikat! > > > > > > > > > > > > I just rebased with the flink branch. Unfortunately I do not ha= ve > > > read > > > > > > access to the team city link you provided and thus evaluate the > > tests > > > > for > > > > > > my pull request. > > > > > > I guess it has to do with ignite extensions being new. > > > > > > My username is gkatzioura and email the one I am using on this > > email > > > > > > > > > > > > Thank you for your time. > > > > > > > > > > > > > > > > > > *Emmanouil Gkatziouras* > > > > > > https://egkatzioura.com/ | > > > > > > https://www.linkedin.com/in/gkatziourasemmanouil/ > > > > > > https://github.com/gkatzioura > > > > > > > > > > > > > > > > > > On Sun, 24 Nov 2019 at 18:03, Saikat Maitra < > > saikat.maitra@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > >> Hi Emmanouil, > > > > > >> > > > > > >> The latest build on teamcity has passed on Flink pull request. > > > > > >> > > > > > >> > > > > > >> > > > > > > > > > > > > > > > https://ci.ignite.apache.org/viewLog.html?buildId=3D4788928&buildTypeId= =3DIgniteExtensions_Build&tab=3DbuildResultsDiv&branch_IgniteExtensions=3Dp= ull%2F1%2Fhead > > > > > >> > > > > > >> you should be able to take the changes I made in my PR and run > > build > > > > on > > > > > >> your pull request. > > > > > >> > > > > > >> Please let me know if you have any questions. > > > > > >> > > > > > >> Regards, > > > > > >> Saikat > > > > > >> > > > > > >> On Sun, Nov 24, 2019 at 10:44 AM Saikat Maitra < > > > > saikat.maitra@gmail.com > > > > > > > > > > > >> wrote: > > > > > >> > > > > > >> > Hi Emmanouil, > > > > > >> > > > > > > >> > I have fixed the Flink module testsuites and have setup new > > > project > > > > in > > > > > >> > teamcity. > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > https://ci.ignite.apache.org/project.html?projectId=3DIgniteExtensions&ta= b=3DprojectOverview > > > > > >> > > > > > > >> > I am looking into setting up the build. > > > > > >> > > > > > > >> > Regards, > > > > > >> > Saikat > > > > > >> > > > > > > >> > On Sat, Nov 23, 2019 at 9:52 AM Saikat Maitra < > > > > > saikat.maitra@gmail.com> > > > > > >> > wrote: > > > > > >> > > > > > > >> >> Hi Emmanouil, > > > > > >> >> > > > > > >> >> Thank you for your email. Yes, the plan is once the Flink P= R > is > > > > > merged > > > > > >> it > > > > > >> >> will provide the Licence, parent POMs etc and you can rebas= e > > from > > > > > >> master > > > > > >> >> branch and apply the changes on top of it. > > > > > >> >> > > > > > >> >> I am getting some issues with test failures in local with > > > > > >> >> GridTestProperties as the test.properties is not present in > > this > > > > new > > > > > >> >> project but should be available from dependencies. > > > > > >> >> > > > > > >> >> Once I address this issue, I will go ahead and merge the > > changes > > > > and > > > > > >> then > > > > > >> >> we can take it from there. > > > > > >> >> > > > > > >> >> Regards, > > > > > >> >> Saikat > > > > > >> >> > > > > > >> >> On Fri, Nov 22, 2019 at 5:23 PM Emmanouil Gkatziouras < > > > > > >> >> gkatzioura@gmail.com> wrote: > > > > > >> >> > > > > > >> >>> Hi all, > > > > > >> >>> > > > > > >> >>> I made my first pull request [1]. Since this project is > brand > > > new > > > > > (no > > > > > >> >>> parent poms, licensing), I reckoned it was best to use > > Saikat's > > > > > >> branch on > > > > > >> >>> Flink. > > > > > >> >>> I suppose the Flink branch will be merged first. If not > please > > > > give > > > > > me > > > > > >> >>> guidelines on how I should proceed next. > > > > > >> >>> > > > > > >> >>> Kind regards > > > > > >> >>> Emmanouil > > > > > >> >>> > > > > > >> >>> [1] https://github.com/apache/ignite-extensions/pull/2 > > > > > >> >>> > > > > > >> >>> *Emmanouil Gkatziouras* > > > > > >> >>> https://egkatzioura.com/ | > > > > > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ > > > > > >> >>> https://github.com/gkatzioura > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> On Fri, 22 Nov 2019 at 20:55, Denis Magda < > dmagda@apache.org> > > > > > wrote: > > > > > >> >>> > > > > > >> >>> > Awesome, ping us whenever you're ready! > > > > > >> >>> > > > > > > >> >>> > - > > > > > >> >>> > Denis > > > > > >> >>> > > > > > > >> >>> > > > > > > >> >>> > On Fri, Nov 22, 2019 at 12:52 PM Emmanouil Gkatziouras < > > > > > >> >>> > gkatzioura@gmail.com> > > > > > >> >>> > wrote: > > > > > >> >>> > > > > > > >> >>> > > Hi all! > > > > > >> >>> > > > > > > > >> >>> > > I am sorry for being late on that. I was trying to > > refactor > > > > the > > > > > >> test > > > > > >> >>> in > > > > > >> >>> > > order not to be in need of any external tools or > spinning > > > up a > > > > > >> >>> server. > > > > > >> >>> > > I did forked the new repo and indeed my changes there, > so > > a > > > > pull > > > > > >> >>> request > > > > > >> >>> > is > > > > > >> >>> > > a matter of time! > > > > > >> >>> > > > > > > > >> >>> > > Kind regards > > > > > >> >>> > > > > > > > >> >>> > > *Emmanouil Gkatziouras* > > > > > >> >>> > > https://egkatzioura.com/ | > > > > > >> >>> > > https://www.linkedin.com/in/gkatziourasemmanouil/ > > > > > >> >>> > > https://github.com/gkatzioura > > > > > >> >>> > > > > > > > >> >>> > > > > > > > >> >>> > > On Fri, 22 Nov 2019 at 20:45, Denis Magda < > > > dmagda@apache.org> > > > > > >> wrote: > > > > > >> >>> > > > > > > > >> >>> > > > Hi Emmanouil, > > > > > >> >>> > > > > > > > > >> >>> > > > Do you have any questions or need any support from t= he > > > > > >> community? > > > > > >> >>> > > > > > > > > >> >>> > > > - > > > > > >> >>> > > > Denis > > > > > >> >>> > > > > > > > > >> >>> > > > > > > > > >> >>> > > > On Sun, Nov 10, 2019 at 3:07 PM Saikat Maitra < > > > > > >> >>> saikat.maitra@gmail.com > > > > > >> >>> > > > > > > > >> >>> > > > wrote: > > > > > >> >>> > > > > > > > > >> >>> > > >> Hi Emmanouil, > > > > > >> >>> > > >> > > > > > >> >>> > > >> Can you please take a looks at dev utils, if this i= s > > > > > something > > > > > >> >>> you are > > > > > >> >>> > > >> looking for > > > > > >> >>> > > >> > > > > > https://github.com/apache/ignite/tree/master/modules/dev-utils > > > > > >> ? > > > > > >> >>> > > >> > > > > > >> >>> > > >> IMO, if you can release Pub/Sub server in maven and > > then > > > > use > > > > > >> it as > > > > > >> >>> > > >> dependency, that would be great. > > > > > >> >>> > > >> > > > > > >> >>> > > >> Regards, > > > > > >> >>> > > >> Saikat > > > > > >> >>> > > >> > > > > > >> >>> > > >> On Sun, Nov 10, 2019 at 5:00 PM Saikat Maitra < > > > > > >> >>> > saikat.maitra@gmail.com> > > > > > >> >>> > > >> wrote: > > > > > >> >>> > > >> > > > > > >> >>> > > >> > Hi Emmanouil, > > > > > >> >>> > > >> > > > > > > >> >>> > > >> > The master branch has been initialized. I have > > raised a > > > > PR > > > > > to > > > > > >> >>> > migrate > > > > > >> >>> > > >> > Flink module to ignite-extensions. > > > > > >> >>> > > >> > > > > > > >> >>> > > >> > PR > > https://github.com/apache/ignite-extensions/pull/1 > > > > > >> >>> > > >> > Jira : > > > > https://issues.apache.org/jira/browse/IGNITE-12356 > > > > > >> >>> > > >> > > > > > > >> >>> > > >> > Regards, > > > > > >> >>> > > >> > Saikat > > > > > >> >>> > > >> > > > > > > >> >>> > > >> > > > > > > >> >>> > > >> > On Sun, Nov 10, 2019 at 3:39 PM Emmanouil > > Gkatziouras < > > > > > >> >>> > > >> > gkatzioura@gmail.com> wrote: > > > > > >> >>> > > >> > > > > > > >> >>> > > >> >> Hi all! > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> This is an update. The integration is tested wit= h > > > mocks > > > > > >> based > > > > > >> >>> on > > > > > >> >>> > the > > > > > >> >>> > > >> >> original Ignite repo [1]. > > > > > >> >>> > > >> >> I am currently waiting for the first commits on > the > > > new > > > > > >> >>> integration > > > > > >> >>> > > >> >> project > > > > > >> >>> > > >> >> to take place in order to create my pull request > > > > > accordingly > > > > > >> >>> to the > > > > > >> >>> > > >> >> initial > > > > > >> >>> > > >> >> commits. > > > > > >> >>> > > >> >> In order to simulate the Pub/Sub server in a tes= t > I > > > > used a > > > > > >> test > > > > > >> >>> > > server > > > > > >> >>> > > >> >> implementation [2]. Unfortunately they don't hav= e > > this > > > > > util > > > > > >> >>> > uploaded > > > > > >> >>> > > >> in a > > > > > >> >>> > > >> >> maven repo, thus it needs to be hosted on a mave= n > > repo > > > > > >> (Apache > > > > > >> >>> > > License > > > > > >> >>> > > >> >> 2.0). Is there a repo for utilities that Ignite > uses > > > for > > > > > the > > > > > >> >>> > > >> test/build? > > > > > >> >>> > > >> >> I have also created a ticket [3] > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> Kind regards > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> [1] > > > > > >> >>> > > > > https://github.com/gkatzioura/ignite/tree/pubsub/modules/pubsub > > > > > >> >>> > > >> >> [2] > > > > > >> >>> > https://github.com/GoogleCloudPlatform/kafka-pubsub-emulator > > > > > >> >>> > > >> >> [3] > > > https://issues.apache.org/jira/browse/IGNITE-12262 > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> *Emmanouil Gkatziouras* > > > > > >> >>> > > >> >> https://egkatzioura.com/ | > > > > > >> >>> > > >> >> https://www.linkedin.com/in/gkatziourasemmanouil= / > > > > > >> >>> > > >> >> https://github.com/gkatzioura > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> On Fri, 25 Oct 2019 at 03:35, Saikat Maitra < > > > > > >> >>> > saikat.maitra@gmail.com > > > > > >> >>> > > > > > > > > >> >>> > > >> >> wrote: > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> >> > Hello Ilya, > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > Thank you for your email. Yes, before we remov= e > > any > > > > > >> >>> integration > > > > > >> >>> > we > > > > > >> >>> > > >> will > > > > > >> >>> > > >> >> > move them to another repository and release. > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > We are thinking we will start with Pub/Sub > > Streamer > > > > > >> >>> > implementation > > > > > >> >>> > > >> and > > > > > >> >>> > > >> >> > continue to move other integration as mentione= d > in > > > the > > > > > >> >>> following > > > > > >> >>> > > doc. > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > > > > > >> >>> > > > > > > > >> >>> > > > > > > >> >>> > > > > > >> > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularizati= on#IEP-36:Modularization-IndependentIntegrations > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > Regards, > > > > > >> >>> > > >> >> > Saikat > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > On Thu, Oct 24, 2019 at 11:00 AM Ilya > Kasnacheev < > > > > > >> >>> > > >> >> > ilya.kasnacheev@gmail.com> > > > > > >> >>> > > >> >> > wrote: > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > Hello! > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > My take on this: we want to offload some of > > > > > >> integrations, > > > > > >> >>> but > > > > > >> >>> > > >> please > > > > > >> >>> > > >> >> > commit > > > > > >> >>> > > >> >> > > and release them to another project first, a= nd > > > only > > > > > >> then we > > > > > >> >>> > will > > > > > >> >>> > > >> >> decide > > > > > >> >>> > > >> >> > to > > > > > >> >>> > > >> >> > > remove them from our repository. > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > Please also make sure they are available wit= h > > same > > > > > >> artifact > > > > > >> >>> > name > > > > > >> >>> > > >> and > > > > > >> >>> > > >> >> API. > > > > > >> >>> > > >> >> > > If this has to be changed, let's wait for AI > 3.0 > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > Regards, > > > > > >> >>> > > >> >> > > -- > > > > > >> >>> > > >> >> > > Ilya Kasnacheev > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > =D1=81=D1=80, 23 =D0=BE=D0=BA=D1=82. 2019 = =D0=B3. =D0=B2 03:23, Saikat Maitra < > > > > > >> >>> > > >> saikat.maitra@gmail.com>: > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > Hello Emmanouil, > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > As discussed earlier, I discussed with > Apache > > > > Bahir > > > > > >> >>> community > > > > > >> >>> > > and > > > > > >> >>> > > >> >> they > > > > > >> >>> > > >> >> > > are > > > > > >> >>> > > >> >> > > > interested to have Apache Ignite extension= s > as > > > > part > > > > > of > > > > > >> >>> Apache > > > > > >> >>> > > >> Bahir > > > > > >> >>> > > >> >> > > > project. > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > Can you please share Pub/Sub streamer > > > > implementation > > > > > >> >>> details > > > > > >> >>> > > with > > > > > >> >>> > > >> >> > Apache > > > > > >> >>> > > >> >> > > > Bahir community and request for feedback. > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > https://bahir.apache.org/ > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > I have also requested for contributor acce= ss > > in > > > > Jira > > > > > >> for > > > > > >> >>> > Apache > > > > > >> >>> > > >> >> Bahir > > > > > >> >>> > > >> >> > > > project so that I can create issues and > assign > > > to > > > > > >> myself. > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > I can help with code reviews as well. > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > Here is the email thread for reference > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > > > > > https://www.mail-archive.com/dev@bahir.apache.org/msg02703.html > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > Regards, > > > > > >> >>> > > >> >> > > > Saikat > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > On Mon, Oct 21, 2019 at 7:54 PM Saikat > Maitra > > < > > > > > >> >>> > > >> >> saikat.maitra@gmail.com > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > wrote: > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > Hello, > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > As discussed I have created following > > > discussion > > > > > >> >>> threads on > > > > > >> >>> > > our > > > > > >> >>> > > >> >> > > migration > > > > > >> >>> > > >> >> > > > > proposals for Apache Ignite extensions: > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > > > > > >> >>> > > > > > > > >> >>> > > > > > > >> >>> > > > > > >> > > > > > > > > > > > > > > > http://apache-ignite-users.70518.x6.nabble.com/DISCUSS-Proposal-for-Ignit= e-Extensions-as-a-separate-Bahir-module-or-Incubator-project-td29829.html > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> > > > > > >> https://www.mail-archive.com/dev@bahir.apache.org/msg02703.htm= l > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > I will share update as I hear more > > > information. > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > Regards, > > > > > >> >>> > > >> >> > > > > Saikat > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > > On Fri, Oct 18, 2019 at 9:03 PM Saikat > > Maitra > > > < > > > > > >> >>> > > >> >> > saikat.maitra@gmail.com > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > wrote: > > > > > >> >>> > > >> >> > > > > > > > > > >> >>> > > >> >> > > > >> Hello Denis, > > > > > >> >>> > > >> >> > > > >> > > > > > >> >>> > > >> >> > > > >> Sure, sounds good. I will create a > separate > > > > > >> discussion > > > > > >> >>> > > thread > > > > > >> >>> > > >> to > > > > > >> >>> > > >> >> get > > > > > >> >>> > > >> >> > > > >> community feedback on whether we > > > > > >> >>> > > >> >> > > > >> should join the Bahir or kick-off "Igni= te > > > > > >> Extensions" > > > > > >> >>> > > project. > > > > > >> >>> > > >> >> > > > >> > > > > > >> >>> > > >> >> > > > >> Regards, > > > > > >> >>> > > >> >> > > > >> Saikat > > > > > >> >>> > > >> >> > > > >> > > > > > >> >>> > > >> >> > > > >> On Thu, Oct 17, 2019 at 2:21 PM Denis > > Magda < > > > > > >> >>> > > >> dmagda@apache.org> > > > > > >> >>> > > >> >> > > wrote: > > > > > >> >>> > > >> >> > > > >> > > > > > >> >>> > > >> >> > > > >>> Folks, > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> The concept of Apache Bahir is precise= ly > > > what > > > > we > > > > > >> >>> need! > > > > > >> >>> > > >> Saikat, > > > > > >> >>> > > >> >> > thanks > > > > > >> >>> > > >> >> > > > for > > > > > >> >>> > > >> >> > > > >>> doing the research. Why I believe the = * > > > idea* > > > > > >> fits us > > > > > >> >>> > well: > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> - All integrations can be stored in > > > > separate > > > > > >> >>> Github > > > > > >> >>> > > >> >> repositories > > > > > >> >>> > > >> >> > > and > > > > > >> >>> > > >> >> > > > >>> have their dev lifecycles. We've no= t > > > > obliged > > > > > to > > > > > >> >>> couple > > > > > >> >>> > > all > > > > > >> >>> > > >> >> the > > > > > >> >>> > > >> >> > > > >>> integrations > > > > > >> >>> > > >> >> > > > >>> in a single repo. For instance, Spa= rk > > can > > > > be > > > > > >> >>> located > > > > > >> >>> > in > > > > > >> >>> > > a > > > > > >> >>> > > >> >> > > dedicated > > > > > >> >>> > > >> >> > > > >>> repo > > > > > >> >>> > > >> >> > > > >>> while streaming integrations might = be > > in > > > a > > > > > >> single > > > > > >> >>> one. > > > > > >> >>> > > >> It's > > > > > >> >>> > > >> >> up > > > > > >> >>> > > >> >> > to > > > > > >> >>> > > >> >> > > > us. > > > > > >> >>> > > >> >> > > > >>> - All the repositories and > integrations > > > > > belong > > > > > >> to > > > > > >> >>> ASF. > > > > > >> >>> > > >> We're > > > > > >> >>> > > >> >> not > > > > > >> >>> > > >> >> > > > >>> dumping > > > > > >> >>> > > >> >> > > > >>> them on Github but rather keep > > supporting > > > > and > > > > > >> >>> > developing > > > > > >> >>> > > >> in > > > > > >> >>> > > >> >> > > > >>> accordance with > > > > > >> >>> > > >> >> > > > >>> ASF vision and practices. > > > > > >> >>> > > >> >> > > > >>> - There is a way to reward > contributors > > > via > > > > > >> >>> > > committership > > > > > >> >>> > > >> and > > > > > >> >>> > > >> >> > PMC > > > > > >> >>> > > >> >> > > > >>> membership. You won't get this if a > > > project > > > > > is > > > > > >> >>> just > > > > > >> >>> > one > > > > > >> >>> > > of > > > > > >> >>> > > >> >> the > > > > > >> >>> > > >> >> > > > >>> millions of > > > > > >> >>> > > >> >> > > > >>> Github projects. > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> Saikat, as Ignite PMC member, could yo= u > > > please > > > > > >> >>> kick-off a > > > > > >> >>> > > >> >> separate > > > > > >> >>> > > >> >> > > > >>> dev-list > > > > > >> >>> > > >> >> > > > >>> discussion to involve more community > > members > > > > and > > > > > >> >>> > referring > > > > > >> >>> > > to > > > > > >> >>> > > >> >> this > > > > > >> >>> > > >> >> > > > >>> thread? > > > > > >> >>> > > >> >> > > > >>> I think the primary question the > community > > > > needs > > > > > >> to > > > > > >> >>> > answer > > > > > >> >>> > > >> >> whether > > > > > >> >>> > > >> >> > we > > > > > >> >>> > > >> >> > > > >>> should join the Bahir or kick-off > "Ignite > > > > > >> Extensions" > > > > > >> >>> > > >> project? > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> - > > > > > >> >>> > > >> >> > > > >>> Denis > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> On Thu, Oct 17, 2019 at 2:54 AM Alexey > > > > Zinoviev > > > > > < > > > > > >> >>> > > >> >> > > > zaleslaw.sin@gmail.com> > > > > > >> >>> > > >> >> > > > >>> wrote: > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > >>> > Maybe we could move all our Streamin= g > > > > > >> Integrations > > > > > >> >>> > there, > > > > > >> >>> > > >> but > > > > > >> >>> > > >> >> > what > > > > > >> >>> > > >> >> > > is > > > > > >> >>> > > >> >> > > > >>> about > > > > > >> >>> > > >> >> > > > >>> > maintaining and committer permission= s > to > > > the > > > > > new > > > > > >> >>> > > >> repositories? > > > > > >> >>> > > >> >> > > > >>> > I see the list of the committers and > PMC > > > > > members > > > > > >> >>> there > > > > > >> >>> > > >> >> > > > >>> > > > > https://bahir.apache.org/community-members/ > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > Could somebody from Ignite community > be > > > > added > > > > > to > > > > > >> >>> this > > > > > >> >>> > > list > > > > > >> >>> > > >> as > > > > > >> >>> > > >> >> a > > > > > >> >>> > > >> >> > > > >>> > PMC/committer to maintain Ignite > > > > integrations? > > > > > >> >>> > > >> >> > > > >>> > If yes, I'd happy to join this proje= ct > > and > > > > > >> >>> collaborate > > > > > >> >>> > > with > > > > > >> >>> > > >> >> these > > > > > >> >>> > > >> >> > > > guys > > > > > >> >>> > > >> >> > > > >>> > together > > > > > >> >>> > > >> >> > > > >>> > If no, and we should start from the > zero > > > > level > > > > > >> with > > > > > >> >>> > > >> external > > > > > >> >>> > > >> >> PRs > > > > > >> >>> > > >> >> > - > > > > > >> >>> > > >> >> > > > >>> hmmm, > > > > > >> >>> > > >> >> > > > >>> > it's better to have our own external > > > > > repository > > > > > >> >>> with > > > > > >> >>> > > >> >> ApacheBahirr > > > > > >> >>> > > >> >> > > > >>> ideology. > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > Also, I agree, that all connectors > could > > > be > > > > > >> moved > > > > > >> >>> there > > > > > >> >>> > > (in > > > > > >> >>> > > >> >> > > > >>> ApacheBahirr > > > > > >> >>> > > >> >> > > > >>> > like repository), but not all module= s > > from > > > > the > > > > > >> page > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > > > > > >> >>> > > > > > > > >> >>> > > > > > > >> >>> > > > > > >> > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularizati= on#IEP-36:Modularization-IndependentIntegrations > > > > > >> >>> > > >> >> > > > >>> > because > > > > > >> >>> > > >> >> > > > >>> > they use different parts of core > modules > > > and > > > > > >> could > > > > > >> >>> be > > > > > >> >>> > > >> >> developed > > > > > >> >>> > > >> >> > > with > > > > > >> >>> > > >> >> > > > >>> > different velocity. > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > In reality, before creation of new > > > > > repositories > > > > > >> we > > > > > >> >>> need > > > > > >> >>> > > >> wide > > > > > >> >>> > > >> >> > > > discussion > > > > > >> >>> > > >> >> > > > >>> > based on the document mentioned abov= e. > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > P.S. Of course, we could experiment = in > > the > > > > > next > > > > > >> >>> release > > > > > >> >>> > > 2.8 > > > > > >> >>> > > >> >> with > > > > > >> >>> > > >> >> > > one > > > > > >> >>> > > >> >> > > > >>> or two > > > > > >> >>> > > >> >> > > > >>> > integrations like twitter or ZeroMQ > > > > > >> >>> > > >> >> > > > >>> > Also, I'd like Denis Magda idea for > the > > > > > separate > > > > > >> >>> > > >> repositories > > > > > >> >>> > > >> >> in > > > > > >> >>> > > >> >> > > > Apache > > > > > >> >>> > > >> >> > > > >>> > Github to maintain them by anybody. > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > =D1=87=D1=82, 17 =D0=BE=D0=BA=D1=82.= 2019 =D0=B3. =D0=B2 05:02, Saikat > > > Maitra < > > > > > >> >>> > > >> >> > > saikat.maitra@gmail.com > > > > > >> >>> > > >> >> > > > >: > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > Hi Denis, Emmanouil > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > Thank you for your email. I think > > > > creating a > > > > > >> >>> separate > > > > > >> >>> > > >> >> > integration > > > > > >> >>> > > >> >> > > > >>> project > > > > > >> >>> > > >> >> > > > >>> > > in github and also proposing it as > an > > > > apache > > > > > >> >>> > incubator > > > > > >> >>> > > >> >> project > > > > > >> >>> > > >> >> > > will > > > > > >> >>> > > >> >> > > > >>> be a > > > > > >> >>> > > >> >> > > > >>> > > good move. The other separate > > > integration > > > > > >> modules > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > > > > > >> >>> > > > > > > > >> >>> > > > > > > >> >>> > > > > > >> > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularizati= on#IEP-36:Modularization-IndependentIntegrations > > > > > >> >>> > > >> >> > > > >>> > > can > > > > > >> >>> > > >> >> > > > >>> > > be moved to this new apache > incubator > > > > > project. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > There are similar integration > > available > > > > for > > > > > >> >>> Flink and > > > > > >> >>> > > >> Spark > > > > > >> >>> > > >> >> in > > > > > >> >>> > > >> >> > > > Apache > > > > > >> >>> > > >> >> > > > >>> > Bahir > > > > > >> >>> > > >> >> > > > >>> > > https://bahir.apache.org/ > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > Do you think we should reach out t= o > > > Apache > > > > > >> Bahir > > > > > >> >>> > > >> community > > > > > >> >>> > > >> >> > with a > > > > > >> >>> > > >> >> > > > >>> > proposal > > > > > >> >>> > > >> >> > > > >>> > > or we should plan to create a > separate > > > > > Apache > > > > > >> >>> > Incubator > > > > > >> >>> > > >> >> > project? > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > Regards, > > > > > >> >>> > > >> >> > > > >>> > > Saikat > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > On Wed, Oct 16, 2019 at 6:21 AM > > > Emmanouil > > > > > >> >>> > Gkatziouras < > > > > > >> >>> > > >> >> > > > >>> > > gkatzioura@gmail.com> > > > > > >> >>> > > >> >> > > > >>> > > wrote: > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > Hi all! > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > Based on the discussions most > > probably > > > > > this > > > > > >> is > > > > > >> >>> > going > > > > > >> >>> > > to > > > > > >> >>> > > >> >> be on > > > > > >> >>> > > >> >> > > > >>> another > > > > > >> >>> > > >> >> > > > >>> > > > GitHub repo. Therefore I will > > prepare > > > a > > > > > >> >>> standalone > > > > > >> >>> > > >> project > > > > > >> >>> > > >> >> > with > > > > > >> >>> > > >> >> > > > the > > > > > >> >>> > > >> >> > > > >>> > > Pub/Sub > > > > > >> >>> > > >> >> > > > >>> > > > module and once the repository i= s > > > > created > > > > > a > > > > > >> >>> pull > > > > > >> >>> > > >> request > > > > > >> >>> > > >> >> > shall > > > > > >> >>> > > >> >> > > be > > > > > >> >>> > > >> >> > > > >>> > issued. > > > > > >> >>> > > >> >> > > > >>> > > > If there is anything else I can = do > > in > > > > > order > > > > > >> to > > > > > >> >>> > > >> facilitate > > > > > >> >>> > > >> >> > this > > > > > >> >>> > > >> >> > > > >>> please > > > > > >> >>> > > >> >> > > > >>> > let > > > > > >> >>> > > >> >> > > > >>> > > > me know. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > If a ticket is created for this > > > issue, I > > > > > >> shall > > > > > >> >>> be > > > > > >> >>> > > able > > > > > >> >>> > > >> to > > > > > >> >>> > > >> >> > > create > > > > > >> >>> > > >> >> > > > a > > > > > >> >>> > > >> >> > > > >>> pull > > > > > >> >>> > > >> >> > > > >>> > > > request and thus a build will ta= ke > > > place > > > > > on > > > > > >> >>> > ignite's > > > > > >> >>> > > >> CI. > > > > > >> >>> > > >> >> > > > >>> > > > If everyone is aligned with > adding a > > > > > Pub/Sub > > > > > >> >>> > > >> >> implementation > > > > > >> >>> > > >> >> > > may I > > > > > >> >>> > > >> >> > > > >>> > create > > > > > >> >>> > > >> >> > > > >>> > > a > > > > > >> >>> > > >> >> > > > >>> > > > ticket on JIRA? > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > My next question has to do on ho= w > > > Ignite > > > > > >> >>> configures > > > > > >> >>> > > the > > > > > >> >>> > > >> >> build > > > > > >> >>> > > >> >> > > > jobs > > > > > >> >>> > > >> >> > > > >>> in > > > > > >> >>> > > >> >> > > > >>> > > Team > > > > > >> >>> > > >> >> > > > >>> > > > City. The unit tests for my > > > > implementation > > > > > >> >>> need a > > > > > >> >>> > > local > > > > > >> >>> > > >> >> > Pub/Sub > > > > > >> >>> > > >> >> > > > >>> server > > > > > >> >>> > > >> >> > > > >>> > up > > > > > >> >>> > > >> >> > > > >>> > > > and running (they provide one fo= r > > > > testing > > > > > >> >>> > purposes). > > > > > >> >>> > > >> Will > > > > > >> >>> > > >> >> > this > > > > > >> >>> > > >> >> > > > take > > > > > >> >>> > > >> >> > > > >>> > > effect > > > > > >> >>> > > >> >> > > > >>> > > > in a form of a build script insi= de > > my > > > > > >> >>> > implementation > > > > > >> >>> > > or > > > > > >> >>> > > >> >> is it > > > > > >> >>> > > >> >> > > > >>> something > > > > > >> >>> > > >> >> > > > >>> > > > that should be configured on Tea= m > > > City? > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > Kind regards, > > > > > >> >>> > > >> >> > > > >>> > > > Emmanouil > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > *Emmanouil Gkatziouras* > > > > > >> >>> > > >> >> > > > >>> > > > https://egkatzioura.com/ | > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ > > > > > >> >>> > > >> >> > > > >>> > > > https://github.com/gkatzioura > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > On Tue, 15 Oct 2019 at 23:27, > Denis > > > > Magda > > > > > < > > > > > >> >>> > > >> >> dmagda@apache.org > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > >>> wrote: > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > Emmanouil, Saikat, > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > After contemplating on this, l= et > > me > > > > > >> propose > > > > > >> >>> > another > > > > > >> >>> > > >> way > > > > > >> >>> > > >> >> > with > > > > > >> >>> > > >> >> > > > this > > > > > >> >>> > > >> >> > > > >>> > > > > particular integration that is > > > aligned > > > > > >> with > > > > > >> >>> our > > > > > >> >>> > > >> >> > > modularization > > > > > >> >>> > > >> >> > > > >>> > > endeavor. > > > > > >> >>> > > >> >> > > > >>> > > > > The modularization [1] defines > the > > > > > Ignite > > > > > >> >>> core, > > > > > >> >>> > > >> Ignite > > > > > >> >>> > > >> >> > > modules, > > > > > >> >>> > > >> >> > > > >>> and > > > > > >> >>> > > >> >> > > > >>> > > > > independent integrations. The > > first > > > > two > > > > > >> are > > > > > >> >>> to be > > > > > >> >>> > > >> >> located > > > > > >> >>> > > >> >> > in > > > > > >> >>> > > >> >> > > > >>> Ignite > > > > > >> >>> > > >> >> > > > >>> > > > > repositories and to be > > > tested/updated > > > > by > > > > > >> the > > > > > >> >>> > > >> community > > > > > >> >>> > > >> >> for > > > > > >> >>> > > >> >> > > > every > > > > > >> >>> > > >> >> > > > >>> > > release. > > > > > >> >>> > > >> >> > > > >>> > > > > The modules are a subset of > > existing > > > > > >> >>> integrations > > > > > >> >>> > > >> that > > > > > >> >>> > > >> >> are > > > > > >> >>> > > >> >> > > > >>> adopted > > > > > >> >>> > > >> >> > > > >>> > > widely > > > > > >> >>> > > >> >> > > > >>> > > > > and require community attentio= n. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > As for the independent > > integrations > > > > [1], > > > > > >> >>> those > > > > > >> >>> > are > > > > > >> >>> > > >> >> supposed > > > > > >> >>> > > >> >> > > to > > > > > >> >>> > > >> >> > > > be > > > > > >> >>> > > >> >> > > > >>> > > located > > > > > >> >>> > > >> >> > > > >>> > > > > in a separate GitHub repo. I > would > > > > > advise > > > > > >> us > > > > > >> >>> to > > > > > >> >>> > > start > > > > > >> >>> > > >> >> > > > >>> implementing > > > > > >> >>> > > >> >> > > > >>> > this > > > > > >> >>> > > >> >> > > > >>> > > > > concept with the Pub/Sub > > > integration. > > > > > Even > > > > > >> >>> though > > > > > >> >>> > > it > > > > > >> >>> > > >> >> will > > > > > >> >>> > > >> >> > be > > > > > >> >>> > > >> >> > > > >>> located > > > > > >> >>> > > >> >> > > > >>> > > in a > > > > > >> >>> > > >> >> > > > >>> > > > > separate Github repo, it will = be > > > > listed > > > > > >> among > > > > > >> >>> > > >> officially > > > > > >> >>> > > >> >> > > > >>> available > > > > > >> >>> > > >> >> > > > >>> > > > > integrations on the Ignite > website > > > > > >> featuring > > > > > >> >>> > > >> Emmanouil > > > > > >> >>> > > >> >> as a > > > > > >> >>> > > >> >> > > > >>> > > contributor. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > What do you think? > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > [1] > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > >> >>> > > >> >> > > > >>> > > > > > >> >>> > > >> >> > > > > > > > > >> >>> > > >> >> > > > > > > > >> >>> > > >> >> > > > > > > >> >>> > > >> >> > > > > > >> >>> > > >> > > > > > >> >>> > > > > > > > >> >>> > > > > > > >> >>> > > > > > >> > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularizati= on#IEP-36:Modularization-IndependentIntegrations > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > - > > > > > >> >>> > > >> >> > > > >>> > > > > Denis > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > On Mon, Oct 14, 2019 at 9:47 P= M > > > Saikat > > > > > >> >>> Maitra < > > > > > >> >>> > > >> >> > > > >>> > saikat.maitra@gmail.com > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > >> >>> > > >> >> > > > >>> > > > > wrote: > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > Hi Emmanouil, > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > The changes looks good to me= . > I > > > > wanted > > > > > >> to > > > > > >> >>> check > > > > > >> >>> > > if > > > > > >> >>> > > >> you > > > > > >> >>> > > >> >> > are > > > > > >> >>> > > >> >> > > > also > > > > > >> >>> > > >> >> > > > >>> > able > > > > > >> >>> > > >> >> > > > >>> > > to > > > > > >> >>> > > >> >> > > > >>> > > > > > validate that the once data = is > > > added > > > > > to > > > > > >> >>> Ignite > > > > > >> >>> > > >> cluster > > > > > >> >>> > > >> >> > you > > > > > >> >>> > > >> >> > > > are > > > > > >> >>> > > >> >> > > > >>> also > > > > > >> >>> > > >> >> > > > >>> > > > able > > > > > >> >>> > > >> >> > > > >>> > > > > to > > > > > >> >>> > > >> >> > > > >>> > > > > > access it using another Igni= te > > > > client > > > > > or > > > > > >> >>> using > > > > > >> >>> > > rest > > > > > >> >>> > > >> >> > > > endpoints. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > We use Teamcity for CI > process, > > > the > > > > > >> >>> details are > > > > > >> >>> > > as > > > > > >> >>> > > >> >> > follows > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > Trigger validation of those > test > > > > > suites > > > > > >> >>> that > > > > > >> >>> > have > > > > > >> >>> > > >> been > > > > > >> >>> > > >> >> > > > >>> affected by > > > > > >> >>> > > >> >> > > > >>> > > your > > > > > >> >>> > > >> >> > > > >>> > > > > > changes on TeamCity < > > > > > >> >>> > > http://ci.ignite.apache.org/>: > > > > > >> >>> > > >> < > > > > > >> >>> > > >> >> > > > >>> > > > > http://204.14.53.153/ > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > - Locate a test suite you > > have > > > to > > > > > >> check, > > > > > >> >>> > press > > > > > >> >>> > > >> >> button > > > > > >> >>> > > >> >> > > > named > > > > > >> >>> > > >> >> > > > >>> > "..." > > > > > >> >>> > > >> >> > > > >>> > > > that > > > > > >> >>> > > >> >> > > > >>> > > > > > is located on the left of > > "Run" > > > > > >> button. > > > > > >> >>> "Run > > > > > >> >>> > > >> custom > > > > > >> >>> > > >> >> > > build" > > > > > >> >>> > > >> >> > > > >>> > dialog > > > > > >> >>> > > >> >> > > > >>> > > > will > > > > > >> >>> > > >> >> > > > >>> > > > > > appear; > > > > > >> >>> > > >> >> > > > >>> > > > > > - Go to "Changes" tab and > > > choose > > > > > >> >>> > > >> >> > > > >>> > "pull//head" > > > > > >> >>> > > >> >> > > > >>> > > > in > > > > > >> >>> > > >> >> > > > >>> > > > > > "Build branch" dropdown > list; > > > > > >> >>> > > >> >> > > > >>> > > > > > - Press "Run build" butto= n > > and > > > > > >> monitor > > > > > >> >>> tests > > > > > >> >>> > > >> >> results. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > @Roman rshtykh@yahoo.com - > can > > > you > > > > > also > > > > > >> >>> please > > > > > >> >>> > > >> take a > > > > > >> >>> > > >> >> > > look? > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > Regards, > > > > > >> >>> > > >> >> > > > >>> > > > > > Saikat > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > On Sun, Oct 13, 2019 at 6:20 > PM > > > > > >> Emmanouil > > > > > >> >>> > > >> Gkatziouras > > > > > >> >>> > > >> >> < > > > > > >> >>> > > >> >> > > > >>> > > > > > gkatzioura@gmail.com> > > > > > >> >>> > > >> >> > > > >>> > > > > > wrote: > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > Hi @Saikat Maitra > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > I have my implementation o= n > an > > > > > Ignite > > > > > >> >>> fork on > > > > > >> >>> > > my > > > > > >> >>> > > >> >> > personal > > > > > >> >>> > > >> >> > > > >>> GitHub > > > > > >> >>> > > >> >> > > > >>> > > > > account > > > > > >> >>> > > >> >> > > > >>> > > > > > > [1] > > > > > >> >>> > > >> >> > > > >>> > > > > > > It is based on the Kafka > > > > > >> implementation > > > > > >> >>> which > > > > > >> >>> > > is > > > > > >> >>> > > >> of > > > > > >> >>> > > >> >> a > > > > > >> >>> > > >> >> > > > polling > > > > > >> >>> > > >> >> > > > >>> > > nature. > > > > > >> >>> > > >> >> > > > >>> > > > > > > GCP does not provide a > service > > > > like > > > > > >> >>> Kafka. > > > > > >> >>> > > >> Instead > > > > > >> >>> > > >> >> it > > > > > >> >>> > > >> >> > > > >>> provides us > > > > > >> >>> > > >> >> > > > >>> > > > with > > > > > >> >>> > > >> >> > > > >>> > > > > > > Pub/Sub which is just like > > > Kafka. > > > > > >> >>> > > >> >> > > > >>> > > > > > > Therefore using the Kafka > > > streamer > > > > > as > > > > > >> a > > > > > >> >>> > > guideline > > > > > >> >>> > > >> >> made > > > > > >> >>> > > >> >> > > more > > > > > >> >>> > > >> >> > > > >>> sense > > > > > >> >>> > > >> >> > > > >>> > > to > > > > > >> >>> > > >> >> > > > >>> > > > > me. > > > > > >> >>> > > >> >> > > > >>> > > > > > > > > > > > >> >>> > > >> >> > > > >>> > > > > > > Apart from the > implementation > > I > > > > have > > > > > >> also > > > > > >> >>> > > added a > > > > > >> >>> > > >> >> unit > > > > > >> >>> > > >> >> > > > test. > > > > > >> >>> > > >> >> > > > >>> > > > > > > It definitely needs some > > > polishing > > > > > >> and a > > > > > >> >>> > double > > > > > >> >>> > > >> >> check > > > > > >> >>> > > >> >> > on > > > > > >> >>> > > >> >> > > my > > > > > >> >>> > > >> >> > > > >>> side > > > > > >> >>> > > >> >> > > > >>> > to > > > > > >> >>> > > >> >> > > > >>> > > > > make > > > > > >> >>> > > >> >> > > > >>> > > > > > > the review smooth. > > > > > >> >>> > > >> >> > > > >>> > > > > > > For the tests a local > Pub/Sub > > > [2] > > > > > >> server > > > > --000000000000b9b48205986d23ff--