Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 69E1B10706 for ; Sat, 19 Oct 2013 06:09:35 +0000 (UTC) Received: (qmail 72248 invoked by uid 500); 19 Oct 2013 06:09:26 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 71916 invoked by uid 500); 19 Oct 2013 06:09:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 71899 invoked by uid 99); 19 Oct 2013 06:09:09 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 19 Oct 2013 06:09:09 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of anseh.danesh@gmail.com designates 209.85.212.46 as permitted sender) Received: from [209.85.212.46] (HELO mail-vb0-f46.google.com) (209.85.212.46) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 19 Oct 2013 06:09:04 +0000 Received: by mail-vb0-f46.google.com with SMTP id 10so1986928vbe.5 for ; Fri, 18 Oct 2013 23:08:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=n+lMoCJ/iX2OiydBoQ8LgNuyHz+dy9AsWlsMbnvOj9E=; b=iDaMYx3ZqKlmiIBB49ouRG3LAQQ9V952fFngVl8M4W1YyQVG82l4ftWq0NUoZvEJ3d QX/nzpm27UeyFo9fyADXl+rSMXu+irJfjLP9Go9hwyKHxO4yJUyJDwBeddTrEeIfhSKn 7AsXz2/fYkxnX0uQLJmEmffOdadIz2iv//F7xOhvcgKzEOU5EvpoC5H8OsT9Vwn4QOVr Hkz61kDYo5m5EetwMHPyeN25TCywd15wQBH3KBGLcF57kZLqk7IWxBJ1kqiny2AY6x8s lnxOnxZTtfqIDk4w3zhjht2H+CfApqPJDfz2ZPYOddehgb6u/lvXzU7OGYdonqdhwQSf oaOA== MIME-Version: 1.0 X-Received: by 10.52.227.6 with SMTP id rw6mr3709337vdc.19.1382162923729; Fri, 18 Oct 2013 23:08:43 -0700 (PDT) Received: by 10.58.151.33 with HTTP; Fri, 18 Oct 2013 23:08:43 -0700 (PDT) Date: Sat, 19 Oct 2013 09:38:43 +0330 Message-ID: Subject: number of map and reduce task does not change in M/R program From: Anseh Danesh To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e01161660173b3604e911e268 X-Virus-Checked: Checked by ClamAV on apache.org --089e01161660173b3604e911e268 Content-Type: text/plain; charset=ISO-8859-1 Hi all.. I have a question.. I have a mapreduce program that get input from cassandra. my input is a little big, about 100000000 data. my problem is that my program takes too long to process, but I think mapreduce is good and fast for large volume of data. so I think maybe I have problems in number of map and reduce tasks.. I set the number of map and reduce asks with JobConf, with Job, and also in conf/mapred-site.xml, but I don't see any changes.. in my logs at first there is map 0% reduce 0% and after about 2 hours working it shows map 1% reduce 0%..!! what should I do? please Help me I really get confused... --089e01161660173b3604e911e268 Content-Type: text/html; charset=ISO-8859-1
Hi all.. I have a question.. I have a mapreduce program that get input from cassandra. my input is a little big, about 100000000 data. my problem is that my program takes too long to process, but I think mapreduce is good and fast for large volume of data. so I think maybe I have problems in number of map and reduce tasks.. I set the number of map and reduce asks with JobConf, with Job, and also in conf/mapred-site.xml, but I don't see any changes.. in my logs at first there is map 0% reduce 0% and after about 2 hours working it shows map 1% reduce 0%..!! what should I do? please Help me I really get confused...
--089e01161660173b3604e911e268--