Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 301A8200BD3 for ; Tue, 22 Nov 2016 01:59:10 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2EAEE160B19; Tue, 22 Nov 2016 00:59:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 60B91160AF9 for ; Tue, 22 Nov 2016 01:59:08 +0100 (CET) Received: (qmail 83475 invoked by uid 500); 22 Nov 2016 00:59:06 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 83458 invoked by uid 99); 22 Nov 2016 00:59:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Nov 2016 00:59:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B7B60C18BF for ; Tue, 22 Nov 2016 00:59:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.199 X-Spam-Level: * X-Spam-Status: No, score=1.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id Cn5MbP2wjb1L for ; Tue, 22 Nov 2016 00:59:03 +0000 (UTC) Received: from mail-qk0-f172.google.com (mail-qk0-f172.google.com [209.85.220.172]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id EB1485FC81 for ; Tue, 22 Nov 2016 00:59:02 +0000 (UTC) Received: by mail-qk0-f172.google.com with SMTP id x190so3632856qkb.0 for ; Mon, 21 Nov 2016 16:59:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=pWakPrLP4RL+0dezNI91oD9VoPriJXcDL6IWoa3ZA08=; b=wdgj7pG8dFU+lVGIZkz0N00n9MypdJo/BVOYVcV27lBsbvK3zqIi5Z3sA9Dzk4CSvR eJBvc0l70kgDmJaDMtxsRX+fnLmF2OrSizVB/16ac+1pmzFHblm7nuNL2KDIrfGfxjHr vbcXcEvrAcKdDiI8BVIysfRoMiaFXcRHCgHuwMLYEgD3fLceTiA9kry9CEURedLy/FvW THnFDtmQdhkIkBq5OwErTPK2k0SoCdSeFgQQed53UzMU39S5fduvZzdX6g2BbszhVaQg u93I0biNWR8Vxl3MuIvn7Y8FqQCDXvgpcizDgB+fPtujRp5GBhSeVvgwETJOdADQ6U+R OfEQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=pWakPrLP4RL+0dezNI91oD9VoPriJXcDL6IWoa3ZA08=; b=TaQJd4xj4HEUILOTkOYZ8QarkKSNtaN3FNAmfV3TX0DUJYXOOqb19CFQQMJT1vG6IO wnsRGExQ/wLfQBWOn340tmRWMjXrujxJkInRzT3CNwjxpe6I/KNU03CqH+SBeS2J47Ul H+mAVJeG799UisE9cJ3ykpoLuu4JL9Vz4wSwhnkWJNyFagilYKVkJt3qe9NrDGCS61KY Pg33diApOdLPhYgBExT9icetG6xPjoor9+2WOkVQS9k0ZTKWJGntQRvn4NwrOKlmsb5T 4FuTWxUTF5dvehK5C2+P47Kr7dW1RJi5J6wm/XHFGAJOKNuuIKijCKt0BHvYxpULD9/T 5tsg== X-Gm-Message-State: AKaTC03IRnq7gngmCKuBt4nXsGV7Js2+0SllW5iPo0Z/l/EF+HlQc1VwdFoYnHRn33929HvNytAkwMWS9CWtvw== X-Received: by 10.55.16.10 with SMTP id a10mr18757356qkh.66.1479776341796; Mon, 21 Nov 2016 16:59:01 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.35.211 with HTTP; Mon, 21 Nov 2016 16:59:01 -0800 (PST) In-Reply-To: References: From: Jai Bheemsen Rao Dhanwada Date: Mon, 21 Nov 2016 16:59:01 -0800 Message-ID: Subject: Re: Cassandra reaper To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a114759ea337bc60541d947f4 archived-at: Tue, 22 Nov 2016 00:59:10 -0000 --001a114759ea337bc60541d947f4 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I noticed that I am not able to add schedules, but I can run repairs. Is there some limitation on the opensource for adding the schedules? On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwada < jaibheemsen@gmail.com> wrote: > Hello Alexander, > > Thanks for the help, I couldn't get around with my issue. > but I started using : https://github.com/thelastpickle/cassandra-reaper > it works like a charm :) > > I am using GUI, I just need to tweak/play with the configuration. > > Thanks again for the help > > > On Tue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada < > jaibheemsen@gmail.com> wrote: > >> ok thank you, >> I will try and update you. >> >> On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < >> alex@thelastpickle.com> wrote: >> >>> Running reaper with INFO level logging (that can be configured in the >>> yaml file), you should have a console output telling you what's going o= n. >>> >>> If you started reaper with memory back end, restarting it will reset it >>> and you'll have to register your cluster again, but if you used postgre= s it >>> will resume tasks where they were left off. >>> >>> Please restart Reaper to at least have an output we can get information >>> from, otherwise we're blind. >>> >>> Since you're using Cassandra 2.1, I'd advise switching to our fork sinc= e >>> the original one is compiled against Cassandra 2.0 libraries. If you sw= itch >>> and use postgres, make sure you update the schema accordingly as we add= ed >>> fields for incremental repair support. >>> >>> Cheers, >>> >>> Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < >>> jaibheemsen@gmail.com> a =C3=A9crit : >>> >>>> Cassandra version is 2.1.16 >>>> >>>> In my setup I don't see it is writting to any logs >>>> >>>> On Tue, Nov 1, 2016 at 10:25 AM, Alexander Dejanovski < >>>> alex@thelastpickle.com> wrote: >>>> >>>> Do you have anything in the reaper logs that would show a failure of >>>> some sort ? >>>> Also, can you tell me which version of Cassandra you're using ? >>>> >>>> Thanks >>>> >>>> On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < >>>> jaibheemsen@gmail.com> wrote: >>>> >>>> Thanks Alex, >>>> >>>> Forgot to mention but I did add the cluster. See the status below. It >>>> says the status is running but I don't see any repair happening. this = is in >>>> the same state from past 1 days. >>>> b/w there not much of data in cluster. >>>> >>>> [root@machine cassandra-reaper]# ./bin/spreaper status-repair 3 >>>> # Report improvements/bugs at https://github.com/spotify/cas >>>> sandra-reaper/issues >>>> # ------------------------------------------------------------ >>>> ------------------ >>>> # Repair run with id '3': >>>> { >>>> "cause": "manual spreaper run", >>>> "cluster_name": "production", >>>> "column_families": [], >>>> "creation_time": "2016-11-01T00:39:15Z", >>>> "duration": null, >>>> "end_time": null, >>>> "estimated_time_of_arrival": null, >>>> "id": 3, >>>> "intensity": 0.900, >>>> "keyspace_name": "users", >>>> * "last_event": "no events",* >>>> "owner": "root", >>>> "pause_time": null, >>>> "repair_parallelism": "DATACENTER_AWARE", >>>> "segments_repaired": 0, >>>> "start_time": "2016-11-01T00:39:15Z", >>>> * "state": "RUNNING",* >>>> "total_segments": 301 >>>> } >>>> [root@ machine cassandra-reaper]# >>>> >>>> On Tue, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski < >>>> alex@thelastpickle.com> wrote: >>>> >>>> Hi, >>>> >>>> The first step in using reaper is to add a cluster to it, as it is a >>>> tool that can manage multiple clusters and does not need to be execute= d on >>>> a Cassandra node (you can run in on any edge node you want). >>>> >>>> You should run : ./bin/spreaper add-cluster 127.0.0.1 >>>> Where you'll replace 127.0.0.1 by the address of one of the nodes of >>>> your cluster. >>>> >>>> Then you can run : ./bin/spreaper cluster_name keyspace_name >>>> to start repairing a keyspace. >>>> >>>> You might want to drop in the UI made by Stefan Podkowinski which migh= t >>>> ease things up for you, at least at the beginning : >>>> https://github.com/spodkowinski/cassandra-reaper-ui >>>> >>>> Worth mentioning that at The Last Pickle we maintain a fork of Reaper >>>> that handles incremental repair, works with C* 2.x and 3.0, and bundle= s the >>>> UI : https://github.com/thelastpickle/cassandra-reaper >>>> We have a branch that allows using Cassandra as a storage backend >>>> instead of Postgres : https://github.com/thelastpi >>>> ckle/cassandra-reaper/tree/add-cassandra-storage >>>> It should be merged to master really soon and should be ready to use. >>>> >>>> Cheers, >>>> >>>> >>>> On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada < >>>> jaibheemsen@gmail.com> wrote: >>>> >>>> Hello, >>>> >>>> Has anyone played around with the cassandra reaper ( >>>> https://github.com/spotify/cassandra-reaper)? >>>> >>>> if so can some please help me with the set-up, I can't get it working. >>>> I used the below steps: >>>> >>>> 1. create jar file using maven >>>> 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server >>>> cassandra-reaper.yaml >>>> 3. ./bin/spreaper repair production users >>>> >>>> -- >>>> ----------------- >>>> Alexander Dejanovski >>>> France >>>> @alexanderdeja >>>> >>>> Consultant >>>> Apache Cassandra Consulting >>>> http://www.thelastpickle.com >>>> >>>> >>>> -- >>>> ----------------- >>>> Alexander Dejanovski >>>> France >>>> @alexanderdeja >>>> >>>> Consultant >>>> Apache Cassandra Consulting >>>> http://www.thelastpickle.com >>>> >>>> >>>> -- >>> ----------------- >>> Alexander Dejanovski >>> France >>> @alexanderdeja >>> >>> Consultant >>> Apache Cassandra Consulting >>> http://www.thelastpickle.com >>> >> >> > --001a114759ea337bc60541d947f4 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I noticed that I am not able to add schedules, but I can r= un repairs.

Is there some limitation on the opensource f= or adding the schedules?

On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwa= da <jaibheemsen@gmail.com> wrote:
Hello Alexander,

Thanks f= or the help, I couldn't get around with my issue.
but I start= ed using :=C2=A0https://github.com/thelastpickle/cassandra-reaper= it works like a charm :)

I am using GUI, I ju= st need to tweak/play with the configuration.

Than= ks again for the help


On T= ue, Nov 1, 2016 at 12:26 PM, Jai Bheemsen Rao Dhanwada &l= t;jaibheemsen@gm= ail.com> wrote:
ok thank you,=C2=A0
I will try and update you.
=

On Tue, Nov 1, 20= 16 at 10:57 AM, Alexander Dejanovski <alex@thelastpickle.com><= /span> wrote:

Running reap= er with INFO level logging (that can be configured in the yaml file), you s= hould have a console output telling you what's going on.

If you started reaper with memory back end, restarting it wi= ll reset it and you'll have to register your cluster again, but if you = used postgres it will resume tasks where they were left off.

Please restart Reaper to at least have an output we can get = information from, otherwise we're blind.

Since you're using Cassandra 2.1, I'd advise switchi= ng to our fork since the original one is compiled against Cassandra 2.0 lib= raries. If you switch and use postgres, make sure you update the schema acc= ordingly as we added fields for incremental repair support.

Cheers,


Le mar. 1 nov. 2016 18:31, = Jai Bheemsen Rao Dhanwada <jaibheemsen@gmail.com> a =C3=A9crit=C2=A0:
Cassandra version i= s 2.1.16

In my setup I don= 't see it is writting to any logs

On Tue, Nov 1, 2016 at 10:25 AM, = Alexander Dejanovski <alex@thelastpickle.com&= gt; wrote:
Do you have anything in the reaper logs that would show a fai= lure of some sort ?
Also, can you tell me which version of Ca= ssandra you're using ?

Thanks=C2=A0

On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada <jaibheem= sen@gmail.com> wrote:
T= hanks Alex,

Forgot to mention but I did add the= cluster. See the status below. It says the status is running but I don'= ;t see any repair happening. this is in the same state from past 1 days.
b/w there not = much of data in cluster.

[root@machine cassandra-reaper]# = =C2=A0./bin/spreaper status-repair 3
# Report improvements/bugs at https://github.com/spotify/cass= andra-reaper/issues
# --------------------------------------------------------= ----------------------
# Repair run with id '3':
{
=C2=A0 "cause": "manual spreaper= run",
= =C2=A0 "cluster_name": "production",
=C2=A0 "column_families&q= uot;: [],
= =C2=A0 "creation_time": "2016-11-01T00:39:15Z",
=C2=A0 "durati= on": null,
=C2=A0 "end_time": null,
=C2=A0 "estimated_time_of_arrival": nu= ll,
=C2=A0 &= quot;id": 3,
=C2=A0 "intensity": 0.900,
=C2=A0 "keyspace_name": "user= s",
=C2=A0 "last_even= t": "no events",
=C2=A0 "owner": "root",
=C2=A0 "pause_= time": null,
=C2=A0 "repair_parallelism": "DATACENTER_AWARE",<= /div>
=C2=A0 "= ;segments_repaired": 0,
=C2=A0 "start_time": "2016-11-01T00:39:15Z&= quot;,
=C2=A0 "state"= : "RUNNING",
=C2=A0 "total_segments": 301
}
[root@=C2=A0machine=C2=A0cassandra-reaper]#

=
On Tu= e, Nov 1, 2016 at 9:24 AM, Alexander Dejanovski <alex@thelastpickle.com> wrote:
Hi,

=
The first s= tep in using reaper is to add a cluster to it, as it is a tool that can man= age multiple clusters and does not need to be executed on a Cassandra node = (you can run in on any edge node you want).

You should run : ./bin/spreaper add-cluster 127.0.0.1
Where you'll replace 127.0= .0.1 by the address of one of the nodes of your cluster.=C2=A0

Then you can run : ./bin/spreaper cluster_name keyspa= ce_name
to s= tart repairing a keyspace.

You might want= to drop in the UI made by Stefan=C2=A0Podkowinski which might ease things = up for you, at least at the beginning :=C2=A0https://github.com/spodkowinski/cassandr= a-reaper-ui

Worth mentioning that at = The Last Pickle we maintain a fork of Reaper that handles incremental repai= r, works with C* 2.x and 3.0, and bundles the UI : https://github.com/thelastpickle/cas= sandra-reaper=C2=A0
We have a branch that allows using Cassandra as a storage backe= nd instead of Postgres :=C2=A0https://github.com/thelastpick= le/cassandra-reaper/tree/add-cassandra-storage
It should be merged to master r= eally soon and should be ready to use.=C2=A0

Cheers,


On Tue, Nov 1, 2016 at 1:45 AM Jai Bheemsen Rao Dhanwada <jaibheemsen@gmail.com> wrote:
Hello,

Has anyone played around wi= th the cassandra reaper (https://github.com/spotify/cassandra-reaper)?

if so can some = please help me with the set-up, I can't get it working. I used the belo= w steps:

1. create jar file using maven
2.=C2=A0java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server=C2=A0cassandra-reaper.yaml
3.=C2=A0./bin/spreaper repair production users
-= -
-----------------
Alexander Dejanovski
France
@alexanderdeja

Consultant
Apache Cassandra Consulting
http://www.thelastpickle.com

--
-----------------
Alexander Dejanovski
= France
@alexanderdeja

Consultant
Apache Cassandra = Consulting
http://www.thelastpickle.com<= /a>




--001a114759ea337bc60541d947f4--