Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 007F6200B5B for ; Fri, 5 Aug 2016 17:16:43 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id F3216160A8E; Fri, 5 Aug 2016 15:16:42 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BFF2E160A64 for ; Fri, 5 Aug 2016 17:16:41 +0200 (CEST) Received: (qmail 59343 invoked by uid 500); 5 Aug 2016 15:16:40 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59333 invoked by uid 99); 5 Aug 2016 15:16:40 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Aug 2016 15:16:40 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id E3586186240 for ; Fri, 5 Aug 2016 15:16:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.041 X-Spam-Level: *** X-Spam-Status: No, score=3.041 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, HTML_OBFUSCATE_10_20=1.162, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 6mWtfTqjqtGy for ; Fri, 5 Aug 2016 15:16:36 +0000 (UTC) Received: from mail-yw0-f174.google.com (mail-yw0-f174.google.com [209.85.161.174]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 3B4F35F251 for ; Fri, 5 Aug 2016 15:16:35 +0000 (UTC) Received: by mail-yw0-f174.google.com with SMTP id j12so268463199ywb.2 for ; Fri, 05 Aug 2016 08:16:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=jyz6IkNWuHhcKWZ7i2IT2h1+30xI7PLu0dxkie1J6FA=; b=wNv8X5BpaFUvPcUTJrDfExY+yv4GVrDaqGyU3d0/2ThOdxYdr6rjdPF1t9ft0rFYtS Pk2rl5eydpYuHOqCa2sLpU6XuXFFGyfkq2DeUJOkNGhU/WJKame5LykOuX6Jq0KWvNO5 gJksZ8JWhGB5FYO/TPgiM5EdE9gZEiXzF2x6LyQz2zkMpMCjKu798qwrp0BjCAsgO+sF kiLEFj+O5vtjEZ8VATxU3Yw5GuD49ZuEQIlcMjzbzZgrzkGHgiM6GOErobmqGAmtgjBY UT1HCwtT1r83SrrIUF2PJ5yHV9gDB4i3/Sksxsv2NJJ/4VV9s1uuw47SQCUDcuoXoqly PJpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=jyz6IkNWuHhcKWZ7i2IT2h1+30xI7PLu0dxkie1J6FA=; b=lVprsLwUWDiJFsGJxmDiP3GWC/uKiecTjvw0VvZegeeG1l4xb4BwpQfw6GwGZVVQfJ PsWO4sQ/73SnEhJWocrwtRiPymV3FZCTcU6Ei/qeYtqHm9q+4VVKb3bQQHXWWvIIYkKl b/0tk/7O4o3v2MDNfLbJBqu6L9AebDvl8e/HU+Rts66uxrI8oGX2T6aDIKtm/B13HUzK rOIaJq/oHRgjc0j579FD28lYurYv32FTvgLCMTB8IBDNWahCa5JORZFsxoNc8VN5bgfj SYuiaWW9jcZ9ntshZZS/O3wuAi0QsC012KpMmw8vbFMjJoyw0h+lYd8laGqBSotUsnMp qi6w== X-Gm-Message-State: AEkooutWt14nVwAovlJLnijBHzvOFH8N2y5S6lKIgEyKSZQBu/xb58WlHi7dMKs4VoZNCbQ1xVs+7dOcRFJ4hw== X-Received: by 10.129.145.6 with SMTP id i6mr59365562ywg.35.1470410194113; Fri, 05 Aug 2016 08:16:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.118.136 with HTTP; Fri, 5 Aug 2016 08:16:13 -0700 (PDT) In-Reply-To: References: From: Paulo Motta Date: Fri, 5 Aug 2016 12:16:13 -0300 Message-ID: Subject: Re: Sync failed between in AntiEntropySessions - Repair To: "user@cassandra.apache.org" Content-Type: multipart/alternative; boundary=94eb2c09248c4b5b480539548d4e archived-at: Fri, 05 Aug 2016 15:16:43 -0000 --94eb2c09248c4b5b480539548d4e Content-Type: text/plain; charset=UTF-8 you need to check 192.168.0.36/10.234.86.36 for streaming ERRORS 2016-08-05 12:08 GMT-03:00 Jean Carlo : > Hi Paulo > > I found the lines, we got an exception "Outgoing stream handler has been > closed" these are > > ERROR [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:53,772 > StreamSession.java:621 - [Stream #c4e79260-5a46-11e6-9993-e11d93fd5b40] > Remote peer 192.168.0.36 failed stream session. > INFO [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:53,772 > StreamResultFuture.java:180 - [Stream #c4e79260-5a46-11e6-9993-e11d93fd5b40] > Session with /192.168.0.36 is complete > WARN [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:53,773 > StreamResultFuture.java:207 - [Stream #c4e79260-5a46-11e6-9993-e11d93fd5b40] > Stream failed > ERROR [StreamReceiveTask:107995] 2016-08-04 16:55:53,782 > StreamReceiveTask.java:183 - Error applying streamed data: > java.lang.RuntimeException: Outgoing stream handler has been closed > at org.apache.cassandra.streaming.ConnectionHandler. > sendMessage(ConnectionHandler.java:138) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamSession. > maybeCompleted(StreamSession.java:697) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamSession. > taskCompleted(StreamSession.java:653) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamReceiveTask$ > OnCompletionRunnable.run(StreamReceiveTask.java:179) > ~[apache-cassandra-2.1.14.jar:2.1.14] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [na:1.8.0_60] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [na:1.8.0_60] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > [na:1.8.0_60] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > [na:1.8.0_60] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60] > > ERROR [StreamReceiveTask:107995] 2016-08-04 16:55:53,782 > StreamSession.java:505 - [Stream #c4e79260-5a46-11e6-9993-e11d93fd5b40] > Streaming error occurred > java.lang.RuntimeException: Outgoing stream handler has been closed > at org.apache.cassandra.streaming.ConnectionHandler. > sendMessage(ConnectionHandler.java:138) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamSession. > maybeCompleted(StreamSession.java:697) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamSession. > taskCompleted(StreamSession.java:653) ~[apache-cassandra-2.1.14.jar: > 2.1.14] > at org.apache.cassandra.streaming.StreamReceiveTask$ > OnCompletionRunnable.run(StreamReceiveTask.java:179) > ~[apache-cassandra-2.1.14.jar:2.1.14] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > [na:1.8.0_60] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > [na:1.8.0_60] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > [na:1.8.0_60] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > [na:1.8.0_60] > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60] > > I al looking through the changes files to see if it is a bug fixed in the > 2.1.15 > > > > Saludos > > Jean Carlo > > "The best way to predict the future is to invent it" Alan Kay > > On Fri, Aug 5, 2016 at 4:24 PM, Paulo Motta > wrote: > >> It seems you have a streaming error, look for ERROR statement in the >> streaming classes before that which may give you a more specific root >> cause. In any case, I'd suggest you to upgrade to 2.1.15 as there were a >> couple of streaming fixes on this version that might help. >> >> 2016-08-05 11:15 GMT-03:00 Jean Carlo : >> >>> >>> Hi guys, Doing a repair I got this error for 2 tokenranges. >>> >>> ERROR [Thread-2499244] 2016-08-04 20:05:24,288 StorageService.java:3068 >>> - Repair session 41e4bab0-5a63-11e6-9993-e11d93fd5b40 for range >>> (487410372471205090,492009442088088379] failed with error >>> org.apache.cassandra.exceptions.RepairExcep >>> tion: [repair #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, >>> (487410372471205090,492009442088088379]] Sync failed between / >>> 192.168.0.144 and /192.168.0.37 >>> java.util.concurrent.ExecutionException: java.lang.RuntimeException: >>> org.apache.cassandra.exceptions.RepairException: [repair >>> #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, (487410372471205090, >>> 492009442088088379]] Sync failed between /192.168.0.144 and / >>> 192.168.0.37 >>> at java.util.concurrent.FutureTask.report(FutureTask.java:122) >>> [na:1.8.0_60] >>> at java.util.concurrent.FutureTask.get(FutureTask.java:192) >>> [na:1.8.0_60] >>> at org.apache.cassandra.service.StorageService$4.runMayThrow(StorageService.java:3059) >>> ~[apache-cassandra-2.1.14.jar:2.1.14] >>> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) >>> [apache-cassandra-2.1.14.jar:2.1.14] >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> [na:1.8.0_60] >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>> [na:1.8.0_60] >>> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60] >>> Caused by: java.lang.RuntimeException: org.apache.cassandra.exceptions.RepairException: >>> [repair #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, >>> (487410372471205090,492009442088088379]] Sync failed between / >>> 10.234.72.144 and >>> /10.234.86.37 >>> at com.google.common.base.Throwables.propagate(Throwables.java:160) >>> ~[guava-16.0.jar:na] >>> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:32) >>> [apache-cassandra-2.1.14.jar:2.1.14] >>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> [na:1.8.0_60] >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>> [na:1.8.0_60] >>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >>> ~[na:1.8.0_60] >>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >>> ~[na:1.8.0_60] >>> ... 1 common frames omitted >>> Caused by: org.apache.cassandra.exceptions.RepairException: [repair >>> #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, (487410372471205090, >>> 492009442088088379]] Sync failed between /192.168.0.144 and / >>> 192.168.0.37 >>> at org.apache.cassandra.repair.RepairSession.syncComplete(RepairSession.java:223) >>> ~[apache-cassandra-2.1.14.jar:2.1.14] >>> at org.apache.cassandra.service.ActiveRepairService.handleMessa >>> ge(ActiveRepairService.java:422) ~[apache-cassandra-2.1.14.jar:2.1.14] >>> at org.apache.cassandra.repair.RepairMessageVerbHandler.doVerb( >>> RepairMessageVerbHandler.java:134) ~[apache-cassandra-2.1.14.jar:2.1.14] >>> at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64) >>> ~[apache-cassandra-2.1.14.jar:2.1.14] >>> ... 3 common frames omitted >>> >>> Is it a network problem or we are having a bug ? There is nothing else >>> in the log of cassandra more than >>> Sync failed between. >>> >>> We are having cassandra 2.1.14 >>> >>> Best regards >>> >>> Jean Carlo >>> >>> "The best way to predict the future is to invent it" Alan Kay >>> >> >> > --94eb2c09248c4b5b480539548d4e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
you need to check 192.168.0.36/10.234.86.36 for streaming ERRORS

2016-08-05 12:08 GMT-03:00 = Jean Carlo <jean.jeancarl48@gmail.com>:
Hi Paulo

I fo= und the lines, we got an exception "Outgoing stream handler has been c= losed" these are

ERROR [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:53,772 StreamSessi= on.java:621 - [Stream #c4e79260-5a46-11e6-9993-e11d93fd5b40] Remote pe= er 192.168.0.36 failed stream session.
INFO=C2=A0 [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:= 53,772 StreamResultFuture.java:180 - [Stream #c4e79260-5a46-11e6-9993-= e11d93fd5b40] Session with /192.168.0.36 is complete
WARN=C2=A0 [STREAM-IN-/10.234.86.36] 2016-08-04 16:55:53,773 = StreamResultFuture.java:207 - [Stream #c4e79260-5a46-11e6-9993-e11d93f= d5b40] Stream failed
ERROR [StreamReceiveTask:107995] 2016-08-04 16:55:5= 3,782 StreamReceiveTask.java:183 - Error applying streamed data:
java.l= ang.RuntimeException: Outgoing stream handler has been closed
=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.streaming.Co= nnectionHandler.sendMessage(ConnectionHandler.java:138) ~[apache-= cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at org.apache.cassandra.streaming.StreamSession.maybeCompl= eted(StreamSession.java:697) ~[apache-cassandra-2.1.14.jar:2.1.14= ]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.streaming.StreamSession.taskCompleted(StreamSession.java:653) ~= [apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.cassandra.streaming.StreamReceiveTask$= OnCompletionRunnable.run(StreamReceiveTask.java:179) ~[apache-cassandr= a-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.FutureTask.run(FutureTask.ja= va:266) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolEx= ecutor.java:1142) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadP= oolExecutor.java:617) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.Thread.run(Thread.java:745) [na:= 1.8.0_60]

ERROR [StreamReceiveTask:107995] 2016-08-04 16:55:5= 3,782 StreamSession.java:505 - [Stream #c4e79260-5a46-11e6-9993-e11d93= fd5b40] Streaming error occurred
java.lang.RuntimeException: Outgoing st= ream handler has been closed
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = at org.apache.cassandra.streaming.ConnectionHandler.sendMessage(C= onnectionHandler.java:138) ~[apache-cassandra-2.1.14.jar:2.1.14]<= br>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.= streaming.StreamSession.maybeCompleted(StreamSession.java:697) ~[= apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.cassandra.streaming.StreamSession.task= Completed(StreamSession.java:653) ~[apache-cassandra-2.1.14.jar:2= .1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandr= a.streaming.StreamReceiveTask$OnCompletionRunnable.run(Strea= mReceiveTask.java:179) ~[apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurre= nt.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_6= 0]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_60]
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.ThreadPoo= lExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_60]
=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.Thread= PoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.Th= read.run(Thread.java:745) [na:1.8.0_60]

I al looki= ng through the changes files to see if it is a bug fixed in the 2.1.15
<= div>


<= div>

Saludos

Jean Carlo=

"The best way to predict the future is to invent it" A= lan Kay

On Fri, Aug 5, 2016 at 4:24 PM, Paulo Motta = <pauloricardomg@gmail.com> wrote:
It seems you have a streaming error, look f= or ERROR statement in the streaming classes before that which may give you = a more specific root cause. In any case, I'd suggest you to upgrade to = 2.1.15 as there were a couple of streaming fixes on this version that might= help.

2016-08-05 11:15 GMT-03:00 Jean Carlo <jean.jeancarl48@gm= ail.com>:
=

Hi guys, Doing a repair I got this error for 2 tokenranges. =

ERROR [Thread-2499244] 2016-08-04 20:05:24,288 StorageService.= java:3068 - Repair session 41e4bab0-5a63-11e6-9993-e11d93fd5b40 for ra= nge (487410372471205090,492009442088088379] failed with error org.apache= .cassandra.exceptions.RepairExcep
tion: [repair #41e4bab0-5a63-11e6= -9993-e11d93fd5b40 on ks/cf_adv, (487410372471205090,49200944208808= 8379]] Sync failed between /192.168.0.144 and /192.168.0.37
java.util.concurrent.ExecutionException: java.la= ng.RuntimeException: org.apache.cassandra.exceptions.RepairException: = [repair #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, (487410372= 471205090,492009442088088379]] Sync failed between /192.168.0.144 and /192.168.0.37
=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at java.util.concurrent.FutureTask.report(FutureTas= k.java:122) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at = java.util.concurrent.FutureTask.get(FutureTask.java:192) [na:1.8.0_60]=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.serv= ice.StorageService$4.runMayThrow(StorageService.java:3059) ~[apac= he-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRun= nable.java:28) [apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.Executors$Ru= nnableAdapter.call(Executors.java:511) [na:1.8.0_60]
=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.FutureTask.run(= FutureTask.java:266) [na:1.8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
Cause= d by: java.lang.RuntimeException: org.apache.cassandra.exceptions.Repa= irException: [repair #41e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_ad= v, (487410372471205090,492009442088088379]] Sync failed between /10.234.72.144 and
=C2=A0= /10.234.86.37
=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-16.0.jar:na]
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.utils.Wra= ppedRunnable.run(WrappedRunnable.java:32) [apache-cassandra-2.1.14.jar= :2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.co= ncurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1= .8.0_60]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurr= ent.FutureTask.run(FutureTask.java:266) [na:1.8.0_60]
=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.ThreadPoolExecu= tor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_60]
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.util.concurrent.ThreadPoo= lExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_60]
= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ... 1 common frames omitted
C= aused by: org.apache.cassandra.exceptions.RepairException: [repair #41= e4bab0-5a63-11e6-9993-e11d93fd5b40 on ks/cf_adv, (487410372471205090,<= a href=3D"tel:4920094420" value=3D"+554920094420" target=3D"_blank">4920094= 42088088379]] Sync failed between /192.168.0.144 and /192.168.0.37
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at org.apache.cassandra.repair.RepairSession.syncComplete(RepairSession.java:223) ~[apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.service.A= ctiveRepairService.handleMessage(ActiveRepairService.java:422) ~[= apache-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.cassandra.repair.RepairMessageVerbHandler.doVe= rb(RepairMessageVerbHandler.java:134) ~[apache-cassandra-2.1.14.j= ar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.ne= t.MessageDeliveryTask.run(MessageDeliveryTask.java:64) ~[apac= he-cassandra-2.1.14.jar:2.1.14]
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 ... 3 common frames omitted

Is it a network problem or we are having a bug ? There is nothing else in = the log of cassandra more than
Sync failed between.
We are having cassandra 2.1.14

= Best regards

<= /span>
Jean Carlo
"The best = way to predict the future is to invent it" Alan Kay



--94eb2c09248c4b5b480539548d4e--