From user-return-27082-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Sep 11 15:09:54 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 8AE4C18063F for ; Wed, 11 Sep 2019 17:09:54 +0200 (CEST) Received: (qmail 5710 invoked by uid 500); 11 Sep 2019 15:09:53 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 5700 invoked by uid 99); 11 Sep 2019 15:09:53 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Sep 2019 15:09:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 0084EC2D40 for ; Wed, 11 Sep 2019 15:09:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.901 X-Spam-Level: * X-Spam-Status: No, score=1.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, MIME_BOUND_DIGITS_15=0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id qkazuOFsBhQO for ; Wed, 11 Sep 2019 15:09:50 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::529; helo=mail-ed1-x529.google.com; envelope-from=ilya.kasnacheev@gmail.com; receiver= Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 59E917DD32 for ; Wed, 11 Sep 2019 15:09:50 +0000 (UTC) Received: by mail-ed1-x529.google.com with SMTP id v38so20959714edm.7 for ; Wed, 11 Sep 2019 08:09:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=fr4qWPmTDrw+BrwAwev+X13z1uL0mvtnd3pKqpL008I=; b=XF+kMyaM7K5ySroKKJDKuKiPIgmDWKS+J6oTC2oWCkiLrzNzAAhvEJEN+gLINqLodm hxrqj0UdcnFgdnmI8Hn6dOX8/ZoNnVM9Jt11VBusmOvXU6QdLa2MK1v3fqhP2hzurxkC XvuXsj9Re30maj2Y1qCLgLx+zC+iTkw9UwuVSoNYKSVeGsiyA+2wvw+vJXGX7p72CB/4 oRlQaoyhE7PRlDd5S+CJz8jLuzxxfv9eU2yjqFJz+p/7uxWJD7jPeH+DivOgvq1ouBuJ o61SGy69FGyV2V2u9DoQ3MDG3bglCj56GuWFCy1N2dgngbVUeEzOeTPh3886geZrrNEp 3SVw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=fr4qWPmTDrw+BrwAwev+X13z1uL0mvtnd3pKqpL008I=; b=O9kyy35j6xt4VoLXSz6BSM56f7g/SC7Xw28EQFEa6KfPSxlJ1bnEgxZmCUC9v4zcgw 2EqkWkXhypl7n4NxcYy1CrVmowp7SFbeoUeqmEY+RB0Q98dUMrwKPRMDDQV9CnjDVR/J DjfAxMxVKa1gL7m+VffL6Sevevtni7ZXew+kU9B2O1PpGmkGVgK4nFb9Q3kB8bqJy5U7 wzUChcJ/Lt+LRfX0pFdugcBoh4m4m5nc3QWjcddp05ef0yLmObx0e6jtCDMDV+3g+Pe1 bhSsGjZJBmClIVKjQiaI9N0l5UjZxciuRd9yZGSXIuUSI5D/r50ttTr4rQqJ/LHoKocp 7xOQ== X-Gm-Message-State: APjAAAWb2tY75UmXXZUqwBLE2fb+wNVKJU/g2zi98HWc0YbiYhEOIULS TINshyAWY10s/TtmI8NJ0Q+g7XXDl6JQX1Xa4JBqDw== X-Google-Smtp-Source: APXvYqyV7o8bCQphgnBlJ7zPDTcdSQ0DipqdDYKQDxcY5TAEUuVh3Z+tXZw+9vwtSkd6+95OFMz5M+8WmepsQnB6/E8= X-Received: by 2002:a17:906:edca:: with SMTP id sb10mr30831826ejb.1.1568214584135; Wed, 11 Sep 2019 08:09:44 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Ilya Kasnacheev Date: Wed, 11 Sep 2019 18:09:33 +0300 Message-ID: Subject: Re: Data from multiple MySQL DBs To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="0000000000003813990592486971" --0000000000003813990592486971 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello! I think the best course will be to read all DBs in user code and use data streamer to populate Ignite. Regards, --=20 Ilya Kasnacheev =D0=B2=D1=82, 10 =D1=81=D0=B5=D0=BD=D1=82. 2019 =D0=B3. =D0=B2 18:01, Kurt = Semba : > Hi all, > > > > I need to sync data from multiple MySQL databases into Ignite. > > > > All those MySQL databases follow the same schema / same tables but > obviously contain different data. They are separate instances of the same > DB and we want to pull all that data into Ignite to have a central store = to > query against. > > > > What would be the best strategy to solve this? > > > > Create a dedicated Cache for each DB instance and then find a way to > create a UNION SQL query over all those Caches? > > Find a way to define all the MySQL DBs as data sources in the Spring XML > cluster config file and hope that Ignite pulls the same type of data from > all DBs? > > > > I=E2=80=99m open for suggestions =F0=9F=98=8A > > Thanks > > Kurt > --0000000000003813990592486971 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello!

I think the best cour= se will be to read all DBs in user code and use data streamer to populate I= gnite.

Regards,
--
Ilya Kasnacheev


=D0=B2=D1=82, 10 =D1=81=D0=B5=D0= =BD=D1=82. 2019 =D0=B3. =D0=B2 18:01, Kurt Semba <ksemba@extremenetworks.com>:

Hi all,

=C2=A0

I need to sync data from multip= le MySQL databases into Ignite.

=C2=A0

All those MySQL databases follo= w the same schema / same tables but obviously contain different data. They = are separate instances of the same DB and we want to pull all that data int= o Ignite to have a central store to query against.

=C2=A0

What would be the best strategy= to solve this?

=C2=A0

Create a dedicated Cache for ea= ch DB instance and then find a way to create a UNION SQL query over all tho= se Caches?

Find a way to define all the My= SQL DBs as data sources in the Spring XML cluster config file and hope that= Ignite pulls the same type of data from all DBs?

=C2=A0

I=E2=80=99m open for suggestion= s =F0=9F=98=8A

Thanks

Kurt

--0000000000003813990592486971--