Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of
 JEREMIAH.JORDAN@morningstar.com designates 216.228.224.34 as permitted
 sender)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Apple Message framework v1244.3)
Subject: Re: How to speed up "Waiting for schema agreement" for a single node
 Cassandra cluster?
From: Jeremiah Jordan <jeremiah.jordan@morningstar.com>
In-Reply-To: <FE75D134-9853-409D-86E0-16527E2E9ED7@lovely.email.ne.jp>
Date: Tue, 4 Oct 2011 21:12:56 -0500
Content-Transfer-Encoding: quoted-printable
Message-Id: <674DAAE2-F944-4C4A-84D5-E08E0068BB7B@morningstar.com>
References: <B648DBF8-0E18-41E3-B4E7-59163594D254@lovely.email.ne.jp>
 <CALdd-zjD+Qytz5cr=ZsR21LoPtA_vBE0VHB+oreWvZ8mg81zFQ@mail.gmail.com>
 <FE75D134-9853-409D-86E0-16527E2E9ED7@lovely.email.ne.jp>
To: user@cassandra.apache.org

But truncate is still slow, especially if it can't use JNA (windows) as =
it snapshots.  Depending on how much data you are inserting during your =
unit tests, just paging through all the keys and then deleting them is =
the fastest way, though if you use timestamps besides "now" this won't =
work, as the timestamps need to be increasing between test runs.


On Oct 4, 2011, at 9:33 AM, Joseph Norton wrote:

>=20
> I didn't consider using truncate because a set of potentially random =
Column Families are created dynamically during the test.
>=20
> Are there any configuration knobs that could be adjusted for drop + =
recreate?
>=20
> thanks in advance,
>=20
> - Joe N
>=20
>=20
> Joseph Norton
> norton@alum.mit.edu
>=20
>=20
>=20
> On Oct 4, 2011, at 11:19 PM, Jonathan Ellis wrote:
>=20
>> Truncate is faster than drop + recreate.
>>=20
>> On Tue, Oct 4, 2011 at 9:15 AM, Joseph Norton =
<norton@lovely.email.ne.jp> wrote:
>>>=20
>>> Hello.
>>>=20
>>> For unit test purposes, I have a single node Cassandra cluster.  I =
need to drop and re-create several keyspaces between each test =
iteration.  This process takes approximately 10 seconds for a single =
node installation.
>>>=20
>>> Can you recommend any tricks or recipes to reduce the time required =
for such operations and/or for "Waiting for schema agreement" to =
complete?
>>>=20
>>> regards,
>>>=20
>>> - Joe N.
>>>=20
>>>=20
>>>=20
>>>=20
>>> $ time ./setupDB.sh
>>> Deleteing cassandra keyspaces
>>> Connected to: "Foo" on 127.0.0.1/9160
>>> ed9c7fc0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> ee8c36f0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> eeb14b20-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> Insert data
>>> Creating cassandra keyspaces
>>> Connected to: "Foo" on 127.0.0.1/9160
>>> ef1a6d30-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> Authenticated to keyspace: Bars
>>> ef4af310-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> ef9bab20-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> efbceec0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f00e4310-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f0589280-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f0821380-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f0c44ca0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> Authenticated to keyspace: Baz
>>> f121d5f0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f1619e10-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f18b4620-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> Authenticated to keyspace: Buz
>>> f1debd50-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f20690a0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f25043d0-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> f29a1e10-ee91-11e0-0000-534d24a6e7f7
>>> Waiting for schema agreement...
>>> ... schemas agree across the cluster
>>> Inserting data in cassandra
>>> Connected to: "Foo" on 127.0.0.1/9160
>>> Authenticated to keyspace: Boo
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>> Value inserted.
>>>=20
>>> real    0m9.554s
>>> user    0m2.729s
>>> sys     0m0.194s
>>>=20
>>>=20
>>> Joseph Norton
>>> norton@alum.mit.edu
>>>=20
>>>=20
>>>=20
>>>=20
>>=20
>>=20
>>=20
>> --=20
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of DataStax, the source for professional Cassandra support
>> http://www.datastax.com
>=20