Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of jeremy.hanna1234@gmail.com
 designates 209.85.213.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=from:content-type:content-transfer-encoding:subject:date:message-id
         :to:mime-version:x-mailer;
        b=ezs6dqF0wcRcmtIhTqcwQdjAU3XlSnk2LMvyGzxOpz7gLH1J21eeBwwiFjYknlxA4A
         fIf9FeamVA1bnI9e68JpAln3SBC3VZ0OqYWn1Rfd1JOj39aemEgpc3anShB/Wxm9k02h
         KtyYQapmXGrdnGiswVgfXcTalKTC889gdaxiI=
From: Jeremy Hanna <jeremy.hanna1234@gmail.com>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: useful little way to run locally with (pig|hive) && cassandra
Date: Wed, 15 Jun 2011 12:35:42 -0500
Message-Id: <D9A91142-CC68-4399-96B7-CD7E5E5352B1@gmail.com>
To: user@cassandra.apache.org,
 user@pig.apache.org,
 Brisk Users <brisk-users@googlegroups.com>
Mime-Version: 1.0 (Apple Message framework v1084)

We started doing this recently and thought it might be useful to others.

Pig (and Hive) have a sample function that allows you to sample data =
from your data store.

In pig it looks something like this:
mysample =3D SAMPLE myrelation 0.01;

One possible use for this, with pig and cassandra is to solve a =
conundrum of testing locally.  We've wondered how to do this so we =
decided to do sampling of a column family (or set of CFs), store into =
HDFS (or CFS), download locally, then import into your local Cassandra =
node.  That gives you real data to test against with pig/hive or for =
other purposes.

That way, when you're flying out to the Hadoop Summit or the Cassandra =
SF event, you can play with real data :).

Maybe others have been doing this for years, but if not, we're finding =
it handy.

Jeremy=