Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 290EE189EF for ; Tue, 4 Aug 2015 20:47:05 +0000 (UTC) Received: (qmail 73782 invoked by uid 500); 4 Aug 2015 20:47:05 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 73761 invoked by uid 500); 4 Aug 2015 20:47:04 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 73749 invoked by uid 99); 4 Aug 2015 20:47:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2015 20:47:04 +0000 Date: Tue, 4 Aug 2015 20:47:04 +0000 (UTC) From: "Paulo Motta (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-9983) Windows dtest: incremental_repair_test.py:TestIncRepair.multiple_subsequent_repair_test MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-9983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Motta updated CASSANDRA-9983: ----------------------------------- Description: This test was failing on the lastest cassci builds ([#44|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/44/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/] and [#38|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/38/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/]). It also made the whole suite hang sometimes. For this reason, it was disabled from windows dtests on [this commit|https://github.com/riptano/cassandra-dtest/commit/478731bc830b62453a3b3996bf9dd0bfd1f6c2a6]. Below are some stack traces: {noformat} ERROR [ScheduledTasks:1] 2015-08-04 16:49:30,865 MessagingService.java:894 - MUTATION messages were dropped in last 5000 ms: 112 for internal timeout and 0 for cross node timeout {noformat} {noformat} ERROR [STREAM-OUT-/127.0.0.3] 2015-08-04 16:51:01,820 StreamSession.java:521 - [Stream #96593730-3ae1-11e5-b4d0-358ed15ecf72] Streaming error occurred java.lang.OutOfMemoryError: Java heap space at com.ning.compress.lzf.BufferRecycler.allocOutputBuffer(BufferRecycler.java:79) ~[compress-lzf-0.8.4.jar:na] at com.ning.compress.lzf.LZFOutputStream.(LZFOutputStream.java:50) ~[compress-lzf-0.8.4.jar:na] at org.apache.cassandra.streaming.StreamWriter.write(StreamWriter.java:83) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:96) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40) ~[main/:na] at org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:46) ~[main/:na] at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363) ~[main/:na] at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335) ~[main/:na] -- {noformat} {noformat} ERROR [Reference-Reaper:1] 2015-08-04 16:51:42,663 Ref.java:187 - LEAK DETECTED: a reference (org.apache.cassandra.utils.concurrent.Ref$State@344b91f8) to class org.apache.cassandra.io.util.SafeMemory$MemoryTidy@1718063907:Memory@[75039b10..75039b14) was not released before the reference was garbage collected {noformat} was: This test was failing on the lastest cassci builds ([#44|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/44/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/] and [#38|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/38/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/]). Below are some stack traces: {noformat} ERROR [ScheduledTasks:1] 2015-08-04 16:49:30,865 MessagingService.java:894 - MUTATION messages were dropped in last 5000 ms: 112 for internal timeout and 0 for cross node timeout {noformat} {noformat} ERROR [STREAM-OUT-/127.0.0.3] 2015-08-04 16:51:01,820 StreamSession.java:521 - [Stream #96593730-3ae1-11e5-b4d0-358ed15ecf72] Streaming error occurred java.lang.OutOfMemoryError: Java heap space at com.ning.compress.lzf.BufferRecycler.allocOutputBuffer(BufferRecycler.java:79) ~[compress-lzf-0.8.4.jar:na] at com.ning.compress.lzf.LZFOutputStream.(LZFOutputStream.java:50) ~[compress-lzf-0.8.4.jar:na] at org.apache.cassandra.streaming.StreamWriter.write(StreamWriter.java:83) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:96) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48) ~[main/:na] at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40) ~[main/:na] at org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:46) ~[main/:na] at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363) ~[main/:na] at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335) ~[main/:na] -- {noformat} > Windows dtest: incremental_repair_test.py:TestIncRepair.multiple_subsequent_repair_test > --------------------------------------------------------------------------------------- > > Key: CASSANDRA-9983 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9983 > Project: Cassandra > Issue Type: Sub-task > Reporter: Paulo Motta > Assignee: Paulo Motta > Priority: Minor > Fix For: 2.2.x > > > This test was failing on the lastest cassci builds ([#44|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/44/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/] and [#38|http://cassci.datastax.com/view/win32/job/cassandra-2.2_dtest_win32/38/testReport/junit/incremental_repair_test/TestIncRepair/multiple_subsequent_repair_test_2/]). It also made the whole suite hang sometimes. For this reason, it was disabled from windows dtests on [this commit|https://github.com/riptano/cassandra-dtest/commit/478731bc830b62453a3b3996bf9dd0bfd1f6c2a6]. > Below are some stack traces: > {noformat} > ERROR [ScheduledTasks:1] 2015-08-04 16:49:30,865 MessagingService.java:894 - MUTATION messages were dropped in last 5000 ms: 112 for internal timeout and 0 for cross node timeout > {noformat} > {noformat} > ERROR [STREAM-OUT-/127.0.0.3] 2015-08-04 16:51:01,820 StreamSession.java:521 - [Stream #96593730-3ae1-11e5-b4d0-358ed15ecf72] Streaming error occurred > java.lang.OutOfMemoryError: Java heap space > at com.ning.compress.lzf.BufferRecycler.allocOutputBuffer(BufferRecycler.java:79) ~[compress-lzf-0.8.4.jar:na] > at com.ning.compress.lzf.LZFOutputStream.(LZFOutputStream.java:50) ~[compress-lzf-0.8.4.jar:na] > at org.apache.cassandra.streaming.StreamWriter.write(StreamWriter.java:83) ~[main/:na] > at org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:96) ~[main/:na] > at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48) ~[main/:na] > at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40) ~[main/:na] > at org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:46) ~[main/:na] > at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363) ~[main/:na] > at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335) ~[main/:na] > -- > {noformat} > {noformat} > ERROR [Reference-Reaper:1] 2015-08-04 16:51:42,663 Ref.java:187 - LEAK DETECTED: a reference (org.apache.cassandra.utils.concurrent.Ref$State@344b91f8) to class org.apache.cassandra.io.util.SafeMemory$MemoryTidy@1718063907:Memory@[75039b10..75039b14) was not released before the reference was garbage collected > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)