cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Philip Thompson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-12904) dtest failure in repair_tests.repair_test.TestRepair.simple_sequential_repair_test
Date Wed, 16 Nov 2016 18:19:58 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-12904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671199#comment-15671199
] 

Philip Thompson commented on CASSANDRA-12904:
---------------------------------------------

Multiplex shows a different, but related error. Looks like the nodes are consistent before
the repair. Hints are disabled though. No guess yet as to what's wrong.

> dtest failure in repair_tests.repair_test.TestRepair.simple_sequential_repair_test
> ----------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-12904
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-12904
>             Project: Cassandra
>          Issue Type: Test
>            Reporter: Michael Shuler
>            Assignee: Philip Thompson
>              Labels: dtest, test-failure
>         Attachments: node1.log, node1_debug.log, node1_gc.log, node2.log, node2_debug.log,
node2_gc.log, node3.log, node3_debug.log, node3_gc.log
>
>
> example failure:
> http://cassci.datastax.com/job/cassandra-2.2_dtest/710/testReport/repair_tests.repair_test/TestRepair/simple_sequential_repair_test/
> {noformat}
> Error Message
> 2001 != 2000
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-gzVU4X
> dtest: DEBUG: Done setting configuration options:
> {   'initial_token': None,
>     'num_tokens': '32',
>     'phi_convict_threshold': 5,
>     'range_request_timeout_in_ms': 10000,
>     'read_request_timeout_in_ms': 10000,
>     'request_timeout_in_ms': 10000,
>     'truncate_request_timeout_in_ms': 10000,
>     'write_request_timeout_in_ms': 10000}
> dtest: DEBUG: Starting cluster..
> cassandra.policies: INFO: Using datacenter 'datacenter1' for DCAwareRoundRobinPolicy
(via host '127.0.0.1'); if incorrect, please specify a local_dc to the constructor, or limit
contact points to local cluster nodes
> cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.3 datacenter1> discovered
> cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1> discovered
> dtest: DEBUG: Inserting data...
> cassandra.cluster: WARNING: Host 127.0.0.3 has been marked down
> cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry
in 2.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection
refused
> cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry
in 4.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection
refused
> cassandra.pool: WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry
in 8.0 seconds: [Errno 111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection
refused
> cassandra.pool: INFO: Successful reconnection to 127.0.0.3, marking node up if it isn't
already
> cassandra.cluster: INFO: Host 127.0.0.3 may be up; will prepare queries and open connection
pool
> cassandra.cluster: INFO: Connection pools established for node 127.0.0.3
> dtest: DEBUG: Checking data on node3...
> cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.1 datacenter1> discovered
> cassandra.cluster: INFO: New Cassandra host <Host: 127.0.0.2 datacenter1> discovered
> --------------------- >> end captured logging << ---------------------
> Stacktrace
>   File "/usr/lib/python2.7/unittest/case.py", line 329, in run
>     testMethod()
>   File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 291, in simple_sequential_repair_test
>     self._simple_repair(sequential=True)
>   File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 386, in _simple_repair
>     self._repair_and_verify(sequential)
>   File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 118, in _repair_and_verify
>     self.check_rows_on_node(node3, 2000, missings=[1000])
>   File "/home/automaton/cassandra-dtest/repair_tests/repair_test.py", line 71, in check_rows_on_node
>     self.assertEqual(len(result), rows)
>   File "/usr/lib/python2.7/unittest/case.py", line 513, in assertEqual
>     assertion_func(first, second, msg=msg)
>   File "/usr/lib/python2.7/unittest/case.py", line 506, in _baseAssertEqual
>     raise self.failureException(msg)
> "2001 != 2000\n-------------------- >> begin captured logging << --------------------\ndtest:
DEBUG: cluster ccm directory: /tmp/dtest-gzVU4X\ndtest: DEBUG: Done setting configuration
options:\n{   'initial_token': None,\n    'num_tokens': '32',\n    'phi_convict_threshold':
5,\n    'range_request_timeout_in_ms': 10000,\n    'read_request_timeout_in_ms': 10000,\n
   'request_timeout_in_ms': 10000,\n    'truncate_request_timeout_in_ms': 10000,\n    'write_request_timeout_in_ms':
10000}\ndtest: DEBUG: Starting cluster..\ncassandra.policies: INFO: Using datacenter 'datacenter1'
for DCAwareRoundRobinPolicy (via host '127.0.0.1'); if incorrect, please specify a local_dc
to the constructor, or limit contact points to local cluster nodes\ncassandra.cluster: INFO:
New Cassandra host <Host: 127.0.0.3 datacenter1> discovered\ncassandra.cluster: INFO:
New Cassandra host <Host: 127.0.0.2 datacenter1> discovered\ndtest: DEBUG: Inserting
data...\ncassandra.cluster: WARNING: Host 127.0.0.3 has been marked down\ncassandra.pool:
WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry in 2.0 seconds: [Errno
111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection refused\ncassandra.pool:
WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry in 4.0 seconds: [Errno
111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection refused\ncassandra.pool:
WARNING: Error attempting to reconnect to 127.0.0.3, scheduling retry in 8.0 seconds: [Errno
111] Tried connecting to [('127.0.0.3', 9042)]. Last error: Connection refused\ncassandra.pool:
INFO: Successful reconnection to 127.0.0.3, marking node up if it isn't already\ncassandra.cluster:
INFO: Host 127.0.0.3 may be up; will prepare queries and open connection pool\ncassandra.cluster:
INFO: Connection pools established for node 127.0.0.3\ndtest: DEBUG: Checking data on node3...\ncassandra.cluster:
INFO: New Cassandra host <Host: 127.0.0.1 datacenter1> discovered\ncassandra.cluster:
INFO: New Cassandra host <Host: 127.0.0.2 datacenter1> discovered\n---------------------
>> end captured logging << ---------------------"
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message