Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B0530EAC8 for ; Mon, 25 Feb 2013 16:36:25 +0000 (UTC) Received: (qmail 21646 invoked by uid 500); 25 Feb 2013 16:36:20 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 20544 invoked by uid 500); 25 Feb 2013 16:36:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Delivered-To: moderator for user@hadoop.apache.org Received: (qmail 92401 invoked by uid 99); 25 Feb 2013 16:27:25 -0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=SPF_PASS,T_FILL_THIS_FORM_SHORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dboyd@data-tactics.com designates 208.73.111.65 as permitted sender) Message-ID: <512B90D0.9070305@data-tactics-corp.com> Date: Mon, 25 Feb 2013 11:26:56 -0500 From: David Boyd User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130215 Thunderbird/17.0.3 MIME-Version: 1.0 To: "user@hadoop.apache.org" Subject: Getting Giraph to build/run with CDH4 (cannot initialize cluster - check mapreduce.framework.name) Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.1.3.65] X-Virus-Checked: Checked by ClamAV on apache.org All: I am trying to get the Giraph 0.2 snapshot (pulled via GIT on Friday) to build and run with CDH4. I modified the pom.xml to provide a profile for my specific version (4.1.1). The build works (mvn -Phadoop_cdh4.1.1 clean package test) and passes all the tests. If I try to do the next step and submit to my cluster with the command: mvn -Phadoop_cdh4.1.1 test -Dprop.mapred.job.tracker=10.1.94.53:8021 -Dgiraph.zkList=10.1.94.104:2181 the JSON test in core fails. If I move that test out of the way a whole bunch of tests in examples fail. They all fail with: > java.io.IOException: Cannot initialize Cluster. Please check your > configuration for mapreduce.framework.name and the correspond server > addresses. I have tried passing mapreduce.framework.name as both local and classic. I have also set those values in my mapreduce-site.xml. Interestingly I can run the pagerank benchmark in code with the command: > hadoop jar > ./giraph-core/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-cdh4.1.3-jar-with-dependencies.jar > org.apache.giraph.benchmark.PageRankBenchmark > -Dmapred.child.java-opts="-Xmx64g -Xms64g XX:+UseConcMarkSweepGC > -XX:-UseGCOverheadLimit" -Dgiraph.zkList=10.1.94.104:2181 -e 1 -s 3 -v > -V 50000 -w 83 And it completes just fine. I have searched high and low for documents and examples on how to run the example programs from other than maven but have not found any thing. Any help or suggestions would be greatly appreciated. THanks. -- ========= mailto:dboyd@data-tactics.com ============ David W. Boyd Director, Engineering, Research and Development Data Tactics Corporation 7901 Jones Branch, Suite 240 Mclean, VA 22102 office: +1-703-506-3735, ext 308 fax: +1-703-506-6703 cell: +1-703-402-7908 ============== http://www.data-tactics.com/ ============ The information contained in this message may be privileged and/or confidential and protected from disclosure. If the reader of this message is not the intended recipient or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify the sender immediately by replying to this message and deleting the material from any computer.