incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Шамим <sre...@yandex.ru>
Subject Pig_cassandra : Map task only running on one node
Date Mon, 25 Feb 2013 15:17:04 GMT
Dear users,
  We have got very strange beheviour of hadoop cluster after upgrading Cassandra from 1.1.5
to Cassandra 1.2.1. We have 5 nodes cluster of Cassandra, where three of them are hodoop slaves.
Now when we are submitting job through Pig script, only one map task runs on one of the hadoop
slaves regardless of volumume of datas (already tried with more than million rows).
Configure of pig as follows:
export PIG_HOME=/oracle/pig-0.10.0
export PIG_CONF_DIR=${HADOOP_HOME}/conf
export PIG_INITIAL_ADDRESS=192.168.157.103
export PIG_RPC_PORT=9160
export PIG_PARTITIONER=org.apache.cassandra.dht.Murmur3Partitioner

Also we have these following properties in hadoop:
 <property>
 <name>mapred.tasktracker.map.tasks.maximum</name>
 <value>10</value>
 </property>
 <property>
 <name>mapred.map.tasks</name>
 <value>4</value>
 </property> 
Any hint or suggestion will be very appreciated.
Thank'x in advance
Shamim

Mime
View raw message