Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 963EE10DB3 for ; Wed, 5 Feb 2014 18:31:01 +0000 (UTC) Received: (qmail 73913 invoked by uid 500); 5 Feb 2014 18:31:00 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 73832 invoked by uid 500); 5 Feb 2014 18:31:00 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 73824 invoked by uid 99); 5 Feb 2014 18:31:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Feb 2014 18:31:00 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ssc.open@googlemail.com designates 209.85.215.169 as permitted sender) Received: from [209.85.215.169] (HELO mail-ea0-f169.google.com) (209.85.215.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Feb 2014 18:30:54 +0000 Received: by mail-ea0-f169.google.com with SMTP id h10so427870eak.0 for ; Wed, 05 Feb 2014 10:30:32 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=message-id:date:from:reply-to:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=q0La8YYB7KFTigcC/Ua5lUV1cluBt3PZVFjf4yiUaP8=; b=FTl5aW8H0Gb2oVp6WwmiAxLY9zgdHfBNbGChohx2CORm2uOs7Q425RXr9Iv+hYW2qx nq1IZmNkf6usbys42QXbWvQB92SVlT4R94vokiEHFBQT1U0nvwD1x0tByMrr3+DL1Hg1 3dPsk3QVNDXKLvak6v3QYIsL6rN2GbuSdjzghctaBvhziHTPM63esaV47s5wXdnc8iO8 kt95TIwhfXkRDmLj/4X2SqxvJubhnufFle9q0RuACXU6PGKrpuJsn6xNuCgiF7WB/14J UBdEF7sBAxu8IDX3vwI/r5KVujLUfgGD8K12vgmjxEijzEQgjflMi8M3geOMWr2EOCZs Si1Q== X-Received: by 10.14.48.68 with SMTP id u44mr1077927eeb.115.1391625032726; Wed, 05 Feb 2014 10:30:32 -0800 (PST) Received: from [192.168.0.2] (g231191127.adsl.alicedsl.de. [92.231.191.127]) by mx.google.com with ESMTPSA id g1sm104528825eet.6.2014.02.05.10.30.31 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 05 Feb 2014 10:30:31 -0800 (PST) Message-ID: <52F28345.9080504@apache.org> Date: Wed, 05 Feb 2014 19:30:29 +0100 From: Sebastian Schelter Reply-To: ssc@apache.org User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: user@giraph.apache.org Subject: Re: Problem with giraph deployment on the cluster References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org No need to excuse :) On 02/05/2014 07:15 PM, Alexander Frolov wrote: > I think I have solved problem. Configuration of Hadoop was messy. Sorry. > > > On Wed, Feb 5, 2014 at 5:55 PM, Alexander Frolov > wrote: > >> >> >> >> On Wed, Feb 5, 2014 at 5:49 PM, Alexander Frolov >> wrote: >> >>> Hello, >>> >>> I have deployed Giraph on the 8-node cluster (Giraph: >>> release-1.0.0-RC2-152-g585511f, Hadoop:0.20.203.0rc1). As I do not have >>> Internet on the cluster I have copied Giraph from my local computer where >>> it worked well. >>> >>> Now I am trying to test it on the cluster and have following issues: >>> >>> 1) When I running Giraph (with -h, just to test) it starts very slowly >>> comparing to my local machine. >>> 2) When I running a simple test it hangs like this: >>> >>> frolo@A11:~> $HADOOP_HOME/bin/hadoop jar >>> $GIRAPH_HOME/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar >>> org.apache.giraph.GiraphRunner >>> org.apache.giraph.examples.SimpleShortestPathsComputation -vif >>> org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat >>> -vip /user/frolo/input/tiny_graph.txt -vof >>> org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op >>> /user/frolo/output/shortestpaths -w 1 >>> 14/02/05 17:29:33 INFO utils.ConfigurationUtils: No edge input format >>> specified. Ensure your InputFormat does not require one. >>> 14/02/05 17:29:33 INFO utils.ConfigurationUtils: No edge output format >>> specified. Ensure your OutputFormat does not require one. >>> 14/02/05 17:29:33 INFO job.GiraphJob: run: Since checkpointing is >>> disabled (default), do not allow any task retries (setting >>> mapred.map.max.attempts = 0, old value = 4) >>> 14/02/05 17:29:35 INFO job.GiraphJob: run: Tracking URL: >>> http://A11:50030/jobdetails.jsp?jobid=job_201402051720_0002 >>> >>> and nothing happens. >>> >>> frolo@A11:~> $HADOOP_HOME/bin/hadoop job -list >>> 1 jobs currently running >>> JobId State StartTime UserName Priority SchedulingInfo >>> job_201402051720_0002 1 1391606975417 frolo NORMAL NA >>> frolo@A11:~> $HADOOP_HOME/bin/hadoop job -status job_201402051720_0002 >>> >>> Job: job_201402051720_0002 >>> file: >>> hdfs://A11:54310/home/frolo/hadoop/tmp/mapred/staging/frolo/.staging/job_201402051720_0002/job.xml >>> tracking URL: http://A11:50030/jobdetails.jsp?jobid=job_201402051720_0002 >>> map() completion: 0.0 >>> reduce() completion: 0.0 >>> Counters: 2 >>> Job Counters >>> SLOTS_MILLIS_MAPS=4613 >>> Launched map tasks=2 >>> >>> I would appreciate any help in tracking down this issue. Thank you. >>> >> >> Just forgot to add that $HADOOP_HOME/bin/hadoop job -kill >> job_201402051720_0002 does not kill the job actually. >> >> Best, >>> Alex >>> >> >> >