Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 15D87B58A for ; Tue, 10 Jan 2012 20:46:42 +0000 (UTC) Received: (qmail 77456 invoked by uid 500); 10 Jan 2012 20:46:40 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 77400 invoked by uid 500); 10 Jan 2012 20:46:40 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 77392 invoked by uid 99); 10 Jan 2012 20:46:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jan 2012 20:46:40 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ginzman@hotmail.com designates 65.54.61.78 as permitted sender) Received: from [65.54.61.78] (HELO snt0-omc1-s41.snt0.hotmail.com) (65.54.61.78) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jan 2012 20:46:30 +0000 Received: from SNT135-W33 ([65.55.90.9]) by snt0-omc1-s41.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 10 Jan 2012 12:46:09 -0800 Message-ID: Content-Type: multipart/alternative; boundary="_cad747e8-7caa-449d-9a60-f72ea0533be3_" X-Originating-IP: [94.159.174.185] From: David Ginzburg To: Subject: RE: minimum time to kick off MapReduce job Date: Tue, 10 Jan 2012 20:46:09 +0000 Importance: Normal In-Reply-To: References: MIME-Version: 1.0 X-OriginalArrivalTime: 10 Jan 2012 20:46:09.0605 (UTC) FILETIME=[E1DB8F50:01CCCFD8] X-Virus-Checked: Checked by ClamAV on apache.org --_cad747e8-7caa-449d-9a60-f72ea0533be3_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable It is possible What kind of node are you using=2C what other processes are running? what = are the Xmx for NN and JT ? Date: Tue=2C 10 Jan 2012 10:35:43 -0500 Subject: minimum time to kick off MapReduce job From: scott.a.lindner@gmail.com To: mapreduce-user@hadoop.apache.org Hi=2C I am experiencing slow startup times when submitting a MapReduce job (singl= e node cluster for testing purposes) and was hoping someone could confirm t= hat this was expected behavior. Even a job that does absolutely no process= ing takes 20-30 seconds to complete. Is this expected? If not=2C what is = the rough minimum time to kick off a newly submitted job? Thanks=2C-Scott = --_cad747e8-7caa-449d-9a60-f72ea0533be3_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

It is possible
What kind of node are you using=2C what other =3B pro= cesses are running? what are the Xmx for NN and JT ?

Date: Tue=2C 10 Jan 201= 2 10:35:43 -0500
Subject: minimum time to kick off MapReduce job
From= : scott.a.lindner@gmail.com
To: mapreduce-user@hadoop.apache.org

= Hi=2C

I am experiencing slow startup times when submitti= ng a MapReduce job (single node cluster for testing purposes) and was hopin= g someone could confirm that this was expected behavior. =3BEven a job= that does absolutely no processing takes 20-30 seconds to complete. = =3BIs this expected? =3BIf not=2C what is the rough minimum time to ki= ck off a newly submitted job?

Thanks=2C

-Scott

= --_cad747e8-7caa-449d-9a60-f72ea0533be3_--