incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From William Oberman <>
Subject pig and widerows
Date Wed, 26 Sep 2012 19:42:57 GMT

I'm trying to figure out what's going on with my cassandra/hadoop/pig
system.  I created a "mini" copy of my main cassandra data by randomly
subsampling to get ~50,000 keys.  I was then writing pig scripts but also
the equivalent operation using simple single threaded code to double check

Of course my very first test failed.  After doing a pig DUMP on the raw
data, what appears to be happening is I'm only getting the first 1024
columns of a key.  After some googling, this seems to be known behavior
unless you add "?widerows=true" to the pig load URI. I tried this, but
it didn't seem to fix anything :-(   Here's the the start of my pig script:
foo = LOAD 'cassandra://KEYSPACE/COLUMN_FAMILY?widerows=true' USING
CassandraStorage() AS (key:chararray, columns:bag {column:tuple (name,

I'm using cassandra 1.1.5 from datastax rpms.  I'm using hadoop
(0.20.2+923.418-1) and pig (0.8.1+28.39-1) from cloudera rpms.

What am I doing wrong?  Or, how I can enable debugging/logging to next
figure out what is going on?  I haven't had to debug hadoop+pig+cassandra
much, other than doing DUMP/ILLUSTRATE from pig.


View raw message