Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 45867 invoked from network); 7 May 2010 13:53:55 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 May 2010 13:53:55 -0000 Received: (qmail 84544 invoked by uid 500); 7 May 2010 13:53:55 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 84519 invoked by uid 500); 7 May 2010 13:53:54 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 84511 invoked by uid 99); 7 May 2010 13:53:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 May 2010 13:53:54 +0000 X-ASF-Spam-Status: No, hits=-0.5 required=10.0 tests=AWL,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rff.rff@gmail.com designates 209.85.219.225 as permitted sender) Received: from [209.85.219.225] (HELO mail-ew0-f225.google.com) (209.85.219.225) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 May 2010 13:53:48 +0000 Received: by ewy25 with SMTP id 25so301754ewy.27 for ; Fri, 07 May 2010 06:53:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:mime-version:received:in-reply-to :references:from:date:message-id:subject:to:content-type; bh=H7G15MpHIKufkoT5QR2wg9eEha3eJ0aL8VI+NCBqazQ=; b=pWlBJzrjyWANTIDImei+f+hXs4EhFxSFz6zBZWvVkWqzDTZlwA32ULtBwrdKox02f9 SS/Xy8F48sG98PzFqAl+JjS89khtGutGdpTxo7SnN+vcTItkYYZrc0ryg1cSzemHczFH RfVN0RazHvVVWYhAabwkAq/FIigi8RHHdBwjU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=kb4vAE5itDTGKU65k3tH2kbS6kSKyHj9HNaHX52FwKwPriwz5Jua1H2QUwEr4HmnRJ TK2kPpl1m7+sjkGnSi1MIZIJzGSSFd4dbB2RY+Ul3/NxVtuOSffuaF1EeHa17pkyfDNn fDYZIM+yxBaUnTqmuSEx0cmwiHDyFfI90G22I= Received: by 10.213.49.144 with SMTP id v16mr87777ebf.46.1273240407110; Fri, 07 May 2010 06:53:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.11.6 with HTTP; Fri, 7 May 2010 06:53:07 -0700 (PDT) In-Reply-To: References: From: gabriele renzi Date: Fri, 7 May 2010 15:53:07 +0200 Message-ID: Subject: Re: timeout while running simple hadoop job To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 On Fri, May 7, 2010 at 2:44 PM, Jonathan Ellis wrote: > Sounds like you need to configure Hadoop to not create a whole bunch > of Map tasks at once interesting, from a quick check it seems there are a dozen threads running. Yet , setNumMapTasks seems to be deprecated (together with JobConf) and while I guess -Dmapred.map.tasks=N may still work, it seems that so it seems the only way to manage the number of map tasks is via a custom subclass of ColumnFamilyInputFormat. But of course you have a point that in a single box this does not add anything.