cassandra-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Culpepper <jackculpep...@gmail.com>
Subject Re: nose tests -- run recently?
Date Mon, 08 Feb 2010 21:02:51 GMT
On Mon, Feb 8, 2010 at 12:38 PM, Jonathan Ellis <jbellis@gmail.com> wrote:
> On Mon, Feb 8, 2010 at 2:25 PM, Jack Culpepper <jackculpepper@gmail.com> wrote:
>> Are you running on a platform that doesn't care about capitalization?
>
> Yes.  If you're building Thrift on windows you're only the second
> person I know to have done so. :)
>

Your platform *cares* about capitalization, right? Maybe I'm missing
something, but how can you "from Constants import VERSION"? The file
containing VERSION is called "constants.py" in the tree.

>> error: [Errno 104] Connection reset by peer
>
> I've never seen Thrift do that before.  Did you check the server log
> for exceptions?

No exceptions. I actually get a different error when I run the tests now.

$ nosetests
.E.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
======================================================================
ERROR: system.test_server.TestMutations.test_batch_insert
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/python/lib/python2.6/site-packages/nose-0.11.1-py2.6.egg/nose/case.py",
l
ine 183, in runTest
    self.test(*self.arg)
  File "/k/jack/cassandra/test/system/test_server.py", line 299, in
test_batch_insert
    _verify_batch()
  File "/k/jack/cassandra/test/system/test_server.py", line 93, in _verify_batch
    _verify_simple()
  File "/k/jack/cassandra/test/system/test_server.py", line 99, in
_verify_simple
    assert client.get('Keyspace1', 'key1', ColumnPath('Standard1',
column='c1'), Consistency
Level.ONE).column == Column('c1', 'value1', 0)
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 277, in get
    return self.recv_get()
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 305, in recv
_get
    raise result.nfe
NotFoundException: NotFoundException()

======================================================================
ERROR: system.test_server.TestMutations.test_batch_insert_super
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/python/lib/python2.6/site-packages/nose-0.11.1-py2.6.egg/nose/case.py",
l
ine 183, in runTest
    self.test(*self.arg)
  File "/k/jack/cassandra/test/system/test_server.py", line 540, in
test_batch_insert_super
    client.batch_insert('Keyspace1', 'key1', cfmap, ConsistencyLevel.ZERO)
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 607, in batc
h_insert
    self.recv_batch_insert()
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 621, in recv
_batch_insert
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "build/bdist.linux-i686/egg/thrift/protocol/TBinaryProtocol.py",
line 126, in readMes
sageBegin
    sz = self.readI32()
  File "build/bdist.linux-i686/egg/thrift/protocol/TBinaryProtocol.py",
line 203, in readI32
    buff = self.trans.readAll(4)
  File "build/bdist.linux-i686/egg/thrift/transport/TTransport.py",
line 58, in readAll
    chunk = self.read(sz-have)
  File "build/bdist.linux-i686/egg/thrift/transport/TTransport.py",
line 155, in read
    self.__rbuf = StringIO(self.__trans.read(max(sz, self.DEFAULT_BUFFER)))
  File "build/bdist.linux-i686/egg/thrift/transport/TSocket.py", line
92, in read
    buff = self.handle.recv(sz)
error: [Errno 104] Connection reset by peer


..and here is the last sequence from the log:

DEBUG [main] 2010-02-08 20:48:24,636 CassandraDaemon.java (line 109)
Binding thrift service
 to /127.0.0.1:9170
 INFO [main] 2010-02-08 20:48:24,636 CassandraDaemon.java (line 149)
Cassandra starting up.
..
DEBUG [pool-1-thread-1] 2010-02-08 20:48:24,766 CassandraServer.java
(line 365) batch_inser
t
DEBUG [pool-1-thread-1] 2010-02-08 20:48:24,766 StorageProxy.java
(line 274) insert writing
 local key key1
DEBUG [pool-1-thread-1] 2010-02-08 20:48:24,819 CassandraServer.java
(line 267) get
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:48:24,819 StorageProxy.java
(line 672) weakreadlocal
 reading SliceByNamesReadCommand(table='Keyspace1', key='key1',
columnParent='QueryPath(col
umnFamilyName='Standard1', superColumnName='null',
columnName='null')', columns=[6331,])
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:48:24,819 SliceQueryFilter.java
(line 116) collectin
g 6331:false:6@0
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:48:24,819 SliceQueryFilter.java
(line 116) collectin
g 6332:false:6@0
DEBUG [pool-1-thread-1] 2010-02-08 20:48:24,876 CassandraServer.java
(line 217) get_slice
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:48:24,876 StorageProxy.java
(line 672) weakreadlocal
 reading SliceFromReadCommand(table='Keyspace1', key='key1',
column_parent='QueryPath(colum
nFamilyName='Standard1', superColumnName='null', columnName='null')',
start='', finish='',
reversed=false, count=1000)
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:48:24,876 SliceQueryFilter.java
(line 116) collectin
g 6331:false:6@0
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:48:24,876 SliceQueryFilter.java
(line 116) collectin
g 6332:false:6@0
DEBUG [pool-1-thread-1] 2010-02-08 20:48:24,876 CassandraServer.java
(line 217) get_slice
DEBUG [ROW-READ-STAGE:3] 2010-02-08 20:48:24,876 StorageProxy.java
(line 672) weakreadlocal
 reading SliceFromReadCommand(table='Keyspace1', key='key1',
column_parent='QueryPath(colum
nFamilyName='Standard2', superColumnName='null', columnName='null')',
start='', finish='',
reversed=false, count=1000)
DEBUG [ROW-READ-STAGE:3] 2010-02-08 20:48:24,876 SliceQueryFilter.java
(line 116) collectin
g 6331:false:6@0
DEBUG [ROW-READ-STAGE:3] 2010-02-08 20:48:24,876 SliceQueryFilter.java
(line 116) collectin
g 6332:false:6@0

When I run again I get the first one again:

$ nosetests
.E.EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
======================================================================
ERROR: system.test_server.TestMutations.test_batch_insert
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/python/lib/python2.6/site-packages/nose-0.11.1-py2.6.egg/nose/case.py",
l
ine 183, in runTest
    self.test(*self.arg)
  File "/k/jack/cassandra/test/system/test_server.py", line 299, in
test_batch_insert
    _verify_batch()
  File "/k/jack/cassandra/test/system/test_server.py", line 93, in _verify_batch
    _verify_simple()
  File "/k/jack/cassandra/test/system/test_server.py", line 99, in
_verify_simple
    assert client.get('Keyspace1', 'key1', ColumnPath('Standard1',
column='c1'), Consistency
Level.ONE).column == Column('c1', 'value1', 0)
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 277, in get
    return self.recv_get()
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 305, in recv
_get
    raise result.nfe
NotFoundException: NotFoundException()

======================================================================
ERROR: system.test_server.TestMutations.test_batch_insert_super
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/python/lib/python2.6/site-packages/nose-0.11.1-py2.6.egg/nose/case.py",
l
ine 183, in runTest
    self.test(*self.arg)
  File "/k/jack/cassandra/test/system/test_server.py", line 540, in
test_batch_insert_super
    client.batch_insert('Keyspace1', 'key1', cfmap, ConsistencyLevel.ZERO)
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 607, in batc
h_insert
    self.recv_batch_insert()
  File "/k/jack/cassandra/interface/thrift/gen-py/cassandra/Cassandra.py",
line 621, in recv
_batch_insert
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "build/bdist.linux-i686/egg/thrift/protocol/TBinaryProtocol.py",
line 126, in readMes
sageBegin
    sz = self.readI32()
  File "build/bdist.linux-i686/egg/thrift/protocol/TBinaryProtocol.py",
line 203, in readI32
    buff = self.trans.readAll(4)
  File "build/bdist.linux-i686/egg/thrift/transport/TTransport.py",
line 58, in readAll
    chunk = self.read(sz-have)
  File "build/bdist.linux-i686/egg/thrift/transport/TTransport.py",
line 155, in read
    self.__rbuf = StringIO(self.__trans.read(max(sz, self.DEFAULT_BUFFER)))
  File "build/bdist.linux-i686/egg/thrift/transport/TSocket.py", line
92, in read
    buff = self.handle.recv(sz)
error: [Errno 104] Connection reset by peer


The relevant part of the log:

 INFO [main] 2010-02-08 20:54:55,957 CassandraDaemon.java (line 149)
Cassandra starting up.
..
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,031 CassandraServer.java
(line 365) batch_inser
t
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,031 StorageProxy.java
(line 123) insert writing
 local key key1
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,197 CassandraServer.java
(line 267) get
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:54:56,197 StorageProxy.java
(line 672) weakreadlocal
 reading SliceByNamesReadCommand(table='Keyspace1', key='key1',
columnParent='QueryPath(col
umnFamilyName='Super1', superColumnName='[B@195ff24',
columnName='null')', columns=[4,])
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:54:56,197 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736331 [4:false:6@0,])
DEBUG [ROW-READ-STAGE:1] 2010-02-08 20:54:56,197 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736332 [5:false:6@0,6:false:6@0,])
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,270 CassandraServer.java
(line 217) get_slice
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:54:56,270 StorageProxy.java
(line 672) weakreadlocal
 reading SliceFromReadCommand(table='Keyspace1', key='key1',
column_parent='QueryPath(colum
nFamilyName='Super1', superColumnName='null', columnName='null')',
start='', finish='', rev
ersed=false, count=1000)
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:54:56,270 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736331 [4:false:6@0,])
DEBUG [ROW-READ-STAGE:2] 2010-02-08 20:54:56,270 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736332 [5:false:6@0,6:false:6@0,])
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,270 CassandraServer.java
(line 267) get
DEBUG [ROW-READ-STAGE:3] 2010-02-08 20:54:56,270 StorageProxy.java
(line 672) weakreadlocal
 reading SliceByNamesReadCommand(table='Keyspace1', key='key1',
columnParent='QueryPath(col
umnFamilyName='Super2', superColumnName='[B@1f9f0f2',
columnName='null')', columns=[4,])
DEBUG [pool-1-thread-1] 2010-02-08 20:54:56,270 CassandraServer.java
(line 217) get_slice
DEBUG [ROW-READ-STAGE:4] 2010-02-08 20:54:56,270 StorageProxy.java
(line 672) weakreadlocal
 reading SliceFromReadCommand(table='Keyspace1', key='key1',
column_parent='QueryPath(colum
nFamilyName='Super1', superColumnName='null', columnName='null')',
start='', finish='', rev
ersed=false, count=1000)
DEBUG [ROW-READ-STAGE:4] 2010-02-08 20:54:56,270 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736331 [4:false:6@0,])
DEBUG [ROW-READ-STAGE:4] 2010-02-08 20:54:56,270 SliceQueryFilter.java
(line 116) collectin
g SuperColumn(736332 [5:false:6@0,6:false:6@0,])

I'd like to contribute something and I'm happy to put it in contrib.

I'm running on a couple of 32-bit debian machines in EC2. There should
be nothing unusual about my setup.

Jack

>> What if I create a separate set of tests to make sure a running
>> cluster is behaving properly? The first test would make sure the
>> proper key spaces exist. That could fail with a clear message.
>> Subsequently, scan the keys, remove all of them, then scan again. Now,
>> either the environment is clean or something failed. Next, do some
>> insertions, deletions, scans, etc. This would help me verify that my
>> cluster is set up properly.
>
> Sounds more like an in-house testing tool to me but we could evaluate
> putting something like that in contrib/.
>
> -Jonathan
>

Mime
View raw message