cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "tu nguyen khac (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-5085) Hadoop map reduce job work wrong with big wide rows
Date Sat, 22 Dec 2012 03:59:12 GMT


tu nguyen khac commented on CASSANDRA-5085:

Can I update only Cassandra lib for hadoop by changing refer to new Casaandra
lib ?? i don't want to change my production enviromment ?? Thanks for your support :)
> Hadoop map reduce job work wrong with big wide rows 
> ----------------------------------------------------
>                 Key: CASSANDRA-5085
>                 URL:
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>    Affects Versions: 1.1.1
>         Environment: Centos 6.0, 7 node cluster (24gb ram, 16 core) , replication factor=2
>            Reporter: tu nguyen khac
> I have 7 nodes cassandra (1.1.1) and hadoop (1.03) cluster ( tasktracker install on every
cassandra node).
> and my column family use wide row pattern. 1 row contains about 200k columns (max about
> My problem is that: when i use Hadoop to run analytic jobs ( count numbers of occurrence
of a something in data) the result i received is wrong ( result is too lower as I expected
in test records)
> there 's one strange when we monitoring on job tracker is map progress task indicate
wrong ( in my image below ) , And number of "Map input records" when I rerun job ( same data)
is not same.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message