Return-Path: 
 <commits-return-75206-apmail-cassandra-commits-archive=cassandra.apache.org@cassandra.apache.org>
X-Original-To: apmail-cassandra-commits-archive@www.apache.org
Delivered-To: apmail-cassandra-commits-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id A0904DB14
	for <apmail-cassandra-commits-archive@www.apache.org>;
 Sun, 26 May 2013 12:57:23 +0000 (UTC)
Received: (qmail 20522 invoked by uid 500); 26 May 2013 12:57:23 -0000
Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org
Received: (qmail 20478 invoked by uid 500); 26 May 2013 12:57:23 -0000
Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:commits-help@cassandra.apache.org>
List-Unsubscribe: <mailto:commits-unsubscribe@cassandra.apache.org>
List-Post: <mailto:commits@cassandra.apache.org>
List-Id: <commits.cassandra.apache.org>
Reply-To: dev@cassandra.apache.org
Delivered-To: mailing list commits@cassandra.apache.org
Received: (qmail 20439 invoked by uid 99); 26 May 2013 12:57:22 -0000
Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 May 2013 12:57:22 +0000
Date: Sun, 26 May 2013 12:57:21 +0000 (UTC)
From: "Shamim Ahmed (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12646363.1367910042540.23784.1369573041963@arcas>
In-Reply-To: <JIRA.12646363.1367910042540@arcas>
References: <JIRA.12646363.1367910042540@arcas>
Subject: [jira] [Commented] (CASSANDRA-5544) Hadoop jobs assigns only one
 mapper in task
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/CASSANDRA-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13667311#comment-13667311 ] 

Shamim Ahmed commented on CASSANDRA-5544:
-----------------------------------------

Cassandra version 1.1.11 have no such problem. I have test in single node cluster and it's created 15 map. 
                
> Hadoop jobs assigns only one mapper in task 
> --------------------------------------------
>
>                 Key: CASSANDRA-5544
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5544
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Hadoop
>    Affects Versions: 1.2.1
>         Environment: Red hat linux 5.4, Hadoop 1.0.3, pig 0.11.1
>            Reporter: Shamim Ahmed
>            Assignee: Brandon Williams
>
> We have got very strange beheviour of hadoop cluster after upgrading 
> Cassandra from 1.1.5 to Cassandra 1.2.1. We have 5 nodes cluster of Cassandra, where three of them are hodoop slaves. Now when we are submitting job through Pig script, only one map assigns in task running on one of the hadoop slaves regardless of 
> volume of data (already tried with more than million rows).
> Configure of pig as follows:
> export PIG_HOME=/oracle/pig-0.10.0
> export PIG_CONF_DIR=${HADOOP_HOME}/conf
> export PIG_INITIAL_ADDRESS=192.168.157.103
> export PIG_RPC_PORT=9160
> export PIG_PARTITIONER=org.apache.cassandra.dht.Murmur3Partitioner
> Also we have these following properties in hadoop:
>  <property>
>  <name>mapred.tasktracker.map.tasks.maximum</name>
>  <value>10</value>
>  </property>
>  <property>
>  <name>mapred.map.tasks</name>
>  <value>4</value>
>  </property>

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira