From user-return-59704-archive-asf-public=cust-asf.ponee.io@cassandra.apache.org Wed Feb 7 00:04:16 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 69BE5180657 for ; Wed, 7 Feb 2018 00:04:16 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 5A124160C46; Tue, 6 Feb 2018 23:04:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3299D160C45 for ; Wed, 7 Feb 2018 00:04:15 +0100 (CET) Received: (qmail 52682 invoked by uid 500); 6 Feb 2018 23:04:08 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 52541 invoked by uid 99); 6 Feb 2018 23:04:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Feb 2018 23:04:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id BAC8B1802E5 for ; Tue, 6 Feb 2018 23:04:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.879 X-Spam-Level: * X-Spam-Status: No, score=1.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id kaTGYwbvuhcK for ; Tue, 6 Feb 2018 23:04:04 +0000 (UTC) Received: from mail-qt0-f169.google.com (mail-qt0-f169.google.com [209.85.216.169]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id EFF125F216 for ; Tue, 6 Feb 2018 23:04:03 +0000 (UTC) Received: by mail-qt0-f169.google.com with SMTP id m11so4545943qtn.10 for ; Tue, 06 Feb 2018 15:04:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:message-id:in-reply-to:references:subject:mime-version; bh=QjwW3PZcRdtTT/I6cgiCaJCCRsyoumKuLG5WatPkTJ4=; b=nU6Uwr5LUGGiZxHJa0Fj0bMURU2ZL0ryV7IylBWcYIpivzdjbI5fa2MngFdi1Bf71i 1rKlqIXja/pFhrwQ9KmIYt+lnpZBcBC1Wxt+s2QqvUnaPOTlB8nLkpwqEpTXtT35X4mp sCo2nWogan4uLbJ8m6fMIt/DKzOAncC4VZdDZA5ttvD0qkb/sgANZHf/ttToWskoShUW iX5LM73bk8+DstOQz/DlB5/QcJbTxs2mVWT+vU529EsP6/szWyTgoisN7MFtMtmh6nKi L+5qNvE5L6KreSEfpqZNId/m5Ps2vynWf+1nBvqpyw7mdGYYPiIOp0dd3pSv9qAfw+ZK bQ7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:message-id:in-reply-to:references :subject:mime-version; bh=QjwW3PZcRdtTT/I6cgiCaJCCRsyoumKuLG5WatPkTJ4=; b=cD8qEJ+yCvySwktoGvmkLDdA4U8Y1Rc/6PFK+LlJXEEChhh9ZXFyAqCSZwK9jWalQ/ 8lNbVwREJfTxUHko+huAxGZAary+dqIy/htFKNaWsYkQgRSf4dJy4ThE+tPIsZ60v+wV NNVlr9C0K0xQy0td3tMua1GXWjM8zygUICw/DdRBXGs/2+eBes5hyhyR8d7v/xMyxJTE cUG7Qlu1r3yjaZzx63Y9nxWxMd6tWxjsJnXFdWkefQFyaPWeYTxvvRI5175z8ieNa8Cp KrdVXNIerV9MjM5VtjrH6cg3BWfNeAgsYAx8JKujh86KXd5TjNgBqaac1EEuf/rYzoaa 5/eA== X-Gm-Message-State: APf1xPDZq05B6K8J/CN5WVSoE0O1DYXWLwX9S3Av9nkNIeHrEHyviLRL g48YH6sO1SapGEDWSJX9Po0wAHIu X-Google-Smtp-Source: AH8x2248r25K6oWnwk4TcwOoFVdDzhPXZoPd18dV93iP3f6dGm9sTEV++yISmN6rcroG9xUjbhWgjQ== X-Received: by 10.200.61.90 with SMTP id u26mr6148619qtf.168.1517958242703; Tue, 06 Feb 2018 15:04:02 -0800 (PST) Received: from [192.168.0.10] (216-15-28-189.s5307.c3-0.161-cbr1.lnh-161.md.cable.rcncustomer.com. [216.15.28.189]) by smtp.gmail.com with ESMTPSA id h12sm80762qth.27.2018.02.06.15.04.00 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 06 Feb 2018 15:04:00 -0800 (PST) Date: Tue, 6 Feb 2018 18:03:42 -0500 From: Rahul Singh To: "=?utf-8?Q?user=40cassandra.apache.org?=" , user@cassandra.apache.org Message-ID: In-Reply-To: References: <358f243c-bafd-4f13-a8b4-be9db38f03fe@Spark> Subject: RE: Cassandra CDC X-Readdle-Message-ID: ff3e74dd-e604-45b6-94de-375000a000e3@Spark MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="5a7a345f_238e1f29_3e67" --5a7a345f_238e1f29_3e67 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Ah got it. Good stuff. -- Rahul Singh rahul.singh=40anant.us Anant Corporation On =46eb 6, 2018, 9:40 AM -0500, Nigel LEACH , wrote: > Not too much delving needed, I upgraded jamm to v0.3.2. I=E2=80=99m not= entirely sure why this was required, it seems a little obscure, but I=E2= =80=99m back on track. > > Many Thanks > Nigel > > =46rom: Nigel LEACH > Sent: 06 =46ebruary 2018 14:25 > To: user=40cassandra.apache.org > Subject: RE: Cassandra CDC > > Thanks Rahul, I looked at the smartcat implementation, and am doing som= ething very similar. Unfortunately, I=E2=80=99m using a mixed DSE and Apa= che codebase, which may not help. > > Anyway, if CDC worked for you with a random partitioner that=E2=80=99s = good news, as its more likely my code that is wrong. I will just have to = delve a bit more deeply. > > Regards > Nigel > > > =46rom: Rahul Singh =5Bmailto:rahul.xavier.singh=40gmail.com=5D > Sent: 06 =46ebruary 2018 14:14 > To: user=40cassandra.apache.org > Subject: Re: Cassandra CDC > > Nigel, > > Are you using something like this or rolled your own=3F > > https://github.com/smartcat-labs/cassandra-kafka-connector/tree/master/= cassandra-cdc > > Ive used it in a docker composition and it seemed to work fine for me. > > https://github.com/smartcat-labs/cassandra-kafka-connector/blob/master/= cassandra-trigger/src/main/java/io/smartcat/cassandra/trigger/KafkaTrigge= r.java > > > > -- > Rahul Singh > rahul.singh=40anant.us > > Anant Corporation > > On =46eb 6, 2018, 5:50 AM -0500, Nigel LEACH , wrote: > Hello, I=E2=80=99m loading Cassandra (v3.10.0.1652) data into a Kafka (= v1.0.0) topic via CDC and the org.apache.cassandra.db.commitlog.CommitLog= Reader. All seems to fit together, but I am seeing an =E2=80=9CInvalid pa= rtitioner RandomPartitioner=E2=80=9D error thrown. Is CDC compatible with= the RandomPartitioner=3F There doesn=E2=80=99t seem to be a great deal o= f documentation, but I may well have missed something. > > Many thanks for any assistance, before I start debugging in anger. > Nigel > > =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F > This e-mail may contain confidential and/or privileged information. If = you are not the intended recipient (or have received this e-mail in error= ) please notify the sender immediately and delete this e-mail. Any unauth= orised copying, disclosure or distribution of the material in this e-mail= is prohibited. > Please refer to http://www.bnpparibas.co.uk/en/email-disclaimer/ for ad= ditional disclosures. > > =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F > This e-mail may contain confidential and/or privileged information. If = you are not the intended recipient (or have received this e-mail in error= ) please notify the sender immediately and delete this e-mail. Any unauth= orised copying, disclosure or distribution of the material in this e-mail= is prohibited. > Please refer to http://www.bnpparibas.co.uk/en/email-disclaimer/ for ad= ditional disclosures. --5a7a345f_238e1f29_3e67 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline
Ah got it. Good stuff.

--
Rahul Singh
rahul.singh=40anant.us

Anant Corporation

On =46eb 6, 2018, 9:40 AM -0500, Nigel LEACH <nigel.leach=40uk.bnppari= bas.com>, wrote:

Not too m= uch delving needed, I upgraded jamm to v0.3.2. I=E2=80=99m not entirely s= ure why this was required, it seems a little obscure, but I=E2=80=99m bac= k on track.

&=23160;<= /span>

Many Than= ks

Nigel

&=23160;<= /span>

=46rom: Nigel LEACH
Sent: 06 =46ebruary 2018 14:25
To: user=40cassandra.apache.org
Subject: RE: Cassandra CDC

&=23160;

Thanks Ra= hul, I looked at the smartcat implementation, and am doing something very= similar. Unfortunately, I=E2=80=99m using a mixed DSE and Apache codebas= e, which may not help.

&=23160;<= /span>

Anyway, i= f CDC worked for you with a random partitioner that=E2=80=99s good news, = as its more likely my code that is wrong. I will just have to delve a bit= more deeply.

&=23160;<= /span>

Regards

Nigel

&=23160;<= /span>

&=23160;<= /span>

=46rom: Rahul Singh =5Bmailto:rahul.xavier.singh=40gmail.com=5D
Sent: 06 =46ebruary 2018 14:14
To: user=40cass= andra.apache.org
Subject: Re: Cassandra CDC

&=23160;

Nigel,&=23160;

&=23160;

Are you using something like = this or rolled your own=3F

&=23160;

&=23160;

Ive used it in a docker compo= sition and it seemed to work fine for me.&=23160;

&=23160;

&=23160;

&=23160;


--
Rahul Singh
rahul.singh=40anant.us<= br />
Anant Corporation


On =46eb 6, 2018, 5:50 AM -0500, Nigel LEACH <nigel.leach=40uk.bnpparibas.com>, w= rote:

Hello, I=E2=80=99m loading Cassandra (v= 3.10.0.1652) data into a Kafka (v1.0.0) topic via CDC and the org.apache.= cassandra.db.commitlog.CommitLogReader. All seems to fit together, but I = am seeing an =E2=80=9CInvalid partitioner RandomPartitioner=E2=80=9D erro= r thrown. Is CDC compatible with the RandomPartitioner=3F There doesn=E2=80= =99t seem to be a great deal of documentation, but I may well have missed= something.

&=23160;

Many thanks for any assistance, before = I start debugging in anger.

Nigel


=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F
This e-mail may contain confidential and/or privileged information. If yo= u are not the intended recipient (or have received this e-mail in error) = please notify the sender immediately and delete this e-mail. Any unauthor= ised copying, disclosure or distribution of the material in this e-mail i= s prohibited.

Please refer to http://www.bnpparibas.co.uk/en/email-disclaim= er/ for additional disclosures.


=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F
This e-mail may contain confidential and/or privileged information. If yo= u are not the intended recipient (or have received this e-mail in error) = please notify the sender immediately and delete this e-mail. Any unauthor= ised copying, disclosure or distribution of the material in this e-mail i= s prohibited.

Please refer to http://www.bnpparibas.co.uk/en/email-disclaimer/ for a= dditional disclosures.

--5a7a345f_238e1f29_3e67--