Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 18D87DF07 for ; Tue, 11 Sep 2012 11:16:12 +0000 (UTC) Received: (qmail 74241 invoked by uid 500); 11 Sep 2012 11:16:06 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 73962 invoked by uid 500); 11 Sep 2012 11:16:06 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 73939 invoked by uid 99); 11 Sep 2012 11:16:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:16:05 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FSL_RCVD_USER,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [194.116.199.141] (HELO thb-mta-01.emailfiltering.com) (194.116.199.141) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:15:58 +0000 Received: from 83-244-202-21.cust-83.exponential-e.net ([83.244.202.21]) by thb-mta-01.emailfiltering.com with emfmta (version 4.8.5.104) vanilla id 28017547912 ;b1c1782b0d7b3362; Tue, 11 Sep 2012 12:15:37 +0100 Received: from dss-protector.sig.ads (unknown [127.0.0.1]) by dss-protector.sig.ads (Service) with ESMTP id BDC8C128013 for ; Tue, 11 Sep 2012 11:15:36 +0000 (GMT) Received: from GBGH-SVEXCHFE02.sig.ads (unknown [10.10.14.23]) by dss-protector.sig.ads (Service) with ESMTP id C75FE128002 for ; Tue, 11 Sep 2012 11:15:35 +0000 (GMT) Received: from GBGH-EXCH-CMS.sig.ads ([fe80::dcac:17fe:e957:d280]) by GBGH-SVEXCHFE02.sig.ads ([fe80::69ae:bd72:c665:191c%10]) with mapi; Tue, 11 Sep 2012 12:15:35 +0100 From: Tony Burton To: "user@hadoop.apache.org" Date: Tue, 11 Sep 2012 12:14:57 +0100 Subject: RE: hadoop trunk build failure - yarn, surefire related? Thread-Topic: hadoop trunk build failure - yarn, surefire related? Thread-Index: Ac2QDIlTYbECSLqSQ6O7AXRFKiJCJwAAZ+gA Message-ID: <556325346CA26341B6F0530E07F90D96016C64CD95F8@GBGH-EXCH-CMS.sig.ads> References: <556325346CA26341B6F0530E07F90D96016C64CD95E1@GBGH-EXCH-CMS.sig.ads> <21B01BD2-C5F7-4488-9C5F-EB72BDC19A8D@hortonworks.com> <556325346CA26341B6F0530E07F90D96016C64CD95EA@GBGH-EXCH-CMS.sig.ads> <556325346CA26341B6F0530E07F90D96016C64CD95ED@GBGH-EXCH-CMS.sig.ads> <556325346CA26341B6F0530E07F90D96016C64CD95F0@GBGH-EXCH-CMS.sig.ads> <556325346CA26341B6F0530E07F90D96016C64CD95F6@GBGH-EXCH-CMS.sig.ads> <556325346CA26341B6F0530E07F90D96016C64CD95F7@GBGH-EXCH-CMS.sig.ads> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Good suggestions Harsh and Hemanth. When I was asked to submit a patch for hadoop 1.0.3, I thought it a good ex= ercise to work through the build process to become familiar even though the= patch is documentation-only. Maybe the requests for patches could come wit= h a list of suggested reading as well as the link to http://wiki.apache.org= /hadoop/HowToContribute, and the contributer can distill the appropriate im= portant steps from all three. Otherwise, it's hard to tell which is the "go= spel" version. Tony -----Original Message----- From: Harsh J [mailto:harsh@cloudera.com]=20 Sent: 11 September 2012 11:59 To: user@hadoop.apache.org Subject: Re: hadoop trunk build failure - yarn, surefire related? I guess we'll need to clean that guide and divide it in two - For branch-1 maintenance contributors, and for trunk contributors. I had another page that serves a slightly different purpose, but may help you just the same: http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton wr= ote: > That's good to know - is there a more up to date guide than http://wiki.a= pache.org/hadoop/HowToContribute which still makes many references to ant b= uilds? > > > > > -----Original Message----- > From: Harsh J [mailto:harsh@cloudera.com] > Sent: 11 September 2012 11:36 > To: user@hadoop.apache.org > Subject: Re: hadoop trunk build failure - yarn, surefire related? > > Ah there is no longer a need to run ant anymore on trunk. Ignore the > leftover files in the base MR project directory - those should be > cleaned up soon. All of the functional pieces of the build right now > definitely use Maven. > > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton = wrote: >> Ok - thanks Harsh. >> >> Following Steve's earlier advice I tried the mvn install, which worked f= ine, then ant test in hadoop-mapreduce-project which failed. I was mid-emai= l to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-projec= t and report back. >> >> Tony >> >> >> -----Original Message----- >> From: Harsh J [mailto:harsh@cloudera.com] >> Sent: 11 September 2012 11:25 >> To: user@hadoop.apache.org >> Subject: Re: hadoop trunk build failure - yarn, surefire related? >> >> Tony, >> >> What I do is: >> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn= test >> >> This seems to work in running without any missing dependencies at least. >> >> The user lists are all merged, but the developer lists remain separate >> as that works better. >> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton = wrote: >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I= can >>> see came from repository.apache.org though. >>> >>> >>> >>> How do I run the MR tests only? >>> >>> >>> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lis= ts >>> had merged into one though - did I get the wrong end of the stick? >>> >>> >>> >>> Tony >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> From: Steve Loughran [mailto:stevel@hortonworks.com] >>> Sent: 11 September 2012 10:45 >>> >>> >>> To: user@hadoop.apache.org >>> Subject: Re: hadoop trunk build failure - yarn, surefire related? >>> >>> >>> >>> It's probably some maven thing -in particular Maven's habit of grabbing= the >>> online nightly snapshots off apache rather than local, >>> >>> >>> >>> try mvn clean install -DskipTests -offline >>> >>> to force in all the artifacts, then run the MR tests >>> >>> >>> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the pla= ce to >>> discuss build and test process. >>> >>> On 11 September 2012 09:58, Tony Burton wro= te: >>> >>> Hi, >>> >>> >>> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the >>> codebase as part of following the "How To Contribute" guide at >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently >>> failing in hadoop-mapreduce-client-jobclient, the failure message is be= low - >>> something to do with org.hadoop.yarn.client and/or the maven surefire >>> plugin. Can anyone suggest how to proceed? Thanks! >>> >>> >>> >>> >>> >>> >>> >>> [INFO] >>> -----------------------------------------------------------------------= - >>> [INFO] Reactor Summary: >>> [INFO] [snipped SKIPPED test groups] >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.= 988s] >>> [INFO] >>> [INFO] >>> -----------------------------------------------------------------------= - >>> [INFO] BUILD FAILURE >>> [INFO] >>> -----------------------------------------------------------------------= - >>> [INFO] Total time: 17.229s >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012 >>> [INFO] Final Memory: 21M/163M >>> [INFO] >>> -----------------------------------------------------------------------= - >>> [ERROR] Failed to execute goal >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test)= on >>> project hadoop-mapreduce-client-jobclient: Execution default-test of go= al >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: >>> java.lang.reflect.InvocationTargetException; nested exception is >>> java.lang.reflect.InvocationTargetException: null: >>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClien= tImpl >>> -> [Help 1] >>> [ERROR] >>> [ERROR] To see the full stack trace of the errors, re-run Maven with th= e -e >>> switch. >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>> [ERROR] >>> [ERROR] For more information about the errors and possible solutions, p= lease >>> read the following articles: >>> [ERROR] [Help 1] >>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionExcepti= on >>> >>> P Think of the environment: please don't print this email unless you re= ally >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright= and >>> may be legally privileged. If you are not the intended recipient, then = the >>> dissemination or copying of this email is prohibited. If you have recei= ved >>> this in error, please notify the sender by replying by email and then d= elete >>> the email completely from your system. Neither Sporting Index nor the s= ender >>> accepts responsibility for any virus, or any other defect which might a= ffect >>> any computer or IT system into which the email is received and/or opene= d. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way fr= om >>> receipt or use of this email. Sporting Index Ltd is a company registere= d in >>> England and Wales with company number 2636842, whose registered office = is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd i= s >>> authorised and regulated by the UK Financial Services Authority (reg. n= o. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >>> >>> >>> >>> Inbound Email has been scanned for viruses and SPAM >>> >>> P Think of the environment: please don't print this email unless you re= ally >>> need to. >>> >>> Outbound Email has been scanned for viruses and SPAM >>> >>> This email and any attachments are confidential, protected by copyright= and >>> may be legally privileged. If you are not the intended recipient, then = the >>> dissemination or copying of this email is prohibited. If you have recei= ved >>> this in error, please notify the sender by replying by email and then d= elete >>> the email completely from your system. Neither Sporting Index nor the s= ender >>> accepts responsibility for any virus, or any other defect which might a= ffect >>> any computer or IT system into which the email is received and/or opene= d. It >>> is the responsibility of the recipient to scan the email and no >>> responsibility is accepted for any loss or damage arising in any way fr= om >>> receipt or use of this email. Sporting Index Ltd is a company registere= d in >>> England and Wales with company number 2636842, whose registered office = is at >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd i= s >>> authorised and regulated by the UK Financial Services Authority (reg. n= o. >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any >>> financial promotion contained herein has been issued and approved by >>> Sporting Index Ltd. >> >> >> >> -- >> Harsh J >> www.sportingindex.com >> Inbound Email has been scanned for viruses and SPAM >> ********************************************************************** >> This email and any attachments are confidential, protected by copyright = and may be legally privileged. If you are not the intended recipient, then= the dissemination or copying of this email is prohibited. If you have rece= ived this in error, please notify the sender by replying by email and then = delete the email completely from your system. Neither Sporting Index nor t= he sender accepts responsibility for any virus, or any other defect which m= ight affect any computer or IT system into which the email is received and/= or opened. It is the responsibility of the recipient to scan the email and= no responsibility is accepted for any loss or damage arising in any way fr= om receipt or use of this email. Sporting Index Ltd is a company registere= d in England and Wales with company number 2636842, whose registered office= is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index L= td is authorised and regulated by the UK Financial Services Authority (reg.= no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). A= ny financial promotion contained herein has been issued >> and approved by Sporting Index Ltd. >> >> Outbound email has been scanned for viruses and SPAM > > > > -- > Harsh J > www.sportingindex.com > Inbound Email has been scanned for viruses and SPAM > ********************************************************************** > This email and any attachments are confidential, protected by copyright a= nd may be legally privileged. If you are not the intended recipient, then = the dissemination or copying of this email is prohibited. If you have recei= ved this in error, please notify the sender by replying by email and then d= elete the email completely from your system. Neither Sporting Index nor th= e sender accepts responsibility for any virus, or any other defect which mi= ght affect any computer or IT system into which the email is received and/o= r opened. It is the responsibility of the recipient to scan the email and = no responsibility is accepted for any loss or damage arising in any way fro= m receipt or use of this email. Sporting Index Ltd is a company registered= in England and Wales with company number 2636842, whose registered office = is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Lt= d is authorised and regulated by the UK Financial Services Authority (reg. = no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). An= y financial promotion contained herein has been issued > and approved by Sporting Index Ltd. > > Outbound email has been scanned for viruses and SPAM --=20 Harsh J www.sportingindex.com Inbound Email has been scanned for viruses and SPAM=20 = **********************************************************************=0D= =0AThis email and any attachments are confidential, protected by copyri= ght and may be legally privileged. If you are not the intended recipie= nt, then the dissemination or copying of this email is prohibited. If y= ou have received this in error, please notify the sender by replying by= email and then delete the email completely from your system. Neither = Sporting Index nor the sender accepts responsibility for any virus, or = any other defect which might affect any computer or IT system into whic= h the email is received and/or opened. It is the responsibility of the= recipient to scan the email and no responsibility is accepted for any = loss or damage arising in any way from receipt or use of this email. S= porting Index Ltd is a company registered in England and Wales with com= pany number 2636842, whose registered office is at Gateway House, Milve= rton Street, London, SE11 4AP. Sporting Index Ltd is authorised and re= gulated by the UK Financial Services Authority (reg. no. 150404) and Ga= mbling Commission (reg. no. 000-027343-R-308898-001). Any financial pr= omotion contained herein has been issued=20=0D=0Aand approved by Sporti= ng Index Ltd.=0D=0A=0D=0AOutbound email has been scanned for viruses an= d SPAM=0D=0A=