cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michał Łowicki <>
Subject Inconsistencies between two tables if BATCH used
Date Thu, 15 Jan 2015 17:09:10 GMT

We've two tables in:
* First one *entity *has log-like structure - whenever entity is modified
we create new version of it and put into the table with new mtime which is
part of compound key. Old one is removed.
* Second one called *entity_by_id *is manually managed index for *entity*.
By having only id you can get basic entity attributes from *entity_by_id*.

While adding entity we do two inserts - to *entity *and *entity_by_id *(in
this order)
While deleting we do the same using the same order so first we remove
record from *entity *table.

It turned out that these two tables were inconsistent. We had ~260 records
in *entity_by_id *for which there is no corresponding record in *entity. *In
*entity *table it's much worse because ~7000 records in *entity_by_id* are
missing and it was growing much faster.

We were using LOCAL_QUROUM. C* 2.1.2. Two datacenters. We didn't get any
exceptions while inserts or deletes. BatchQuery from cqlengine (0.20.0) has
been used.

If BatchQuery is not used:

with BatchQuery() as b:
-        entity.batch(b).save()
-        entity_by_id = EntityById.copy_fields_from(entity)
-        entity_by_id.batch(b).save()
+    entity_by_id = EntityById.copy_fields_from(entity)

Everything is fine. We don't have more inconsistencies. I've check what
cqlengine generates and seems that works as expected:

('BEGIN  BATCH\n  UPDATE sync.entity SET "name" = %(4)s WHERE "user_id" =
%(0)s AND "data_type_id" = %(1)s AND "version" = %(2)s AND "id" = %(3)s\n
INSERT INTO sync.entity_by_id ("user_id", "id", "parent_id", "deleted",
"folder", "data_type_id", "version") VALUES (%(5)s, %(6)s, %(7)s, %(8)s,
%(9)s, %(10)s, %(11)s)\nAPPLY BATCH;',)
We suspect that it's a problem in the C* itself. Any ideas how to debug
what is going on as BATCH is needed in this case?

Michał Łowicki

View raw message