hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Yamijala <yhema...@thoughtworks.com>
Subject Re: hadoop trunk build failure - yarn, surefire related?
Date Tue, 11 Sep 2012 11:02:19 GMT
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.

Thanks
hemanth

On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <harsh@cloudera.com> wrote:

> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TBurton@sportingindex.com>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:harsh@cloudera.com]
> > Sent: 11 September 2012 11:36
> > To: user@hadoop.apache.org
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TBurton@sportingindex.com>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:harsh@cloudera.com]
> >> Sent: 11 September 2012 11:25
> >> To: user@hadoop.apache.org
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TBurton@sportingindex.com>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:stevel@hortonworks.com]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: user@hadoop.apache.org
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try  mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <TBurton@sportingindex.com>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed?  Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO] [snipped SKIPPED test groups]
> >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> >>> [INFO]
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 17.229s
> >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> >>> [INFO] Final Memory: 21M/163M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test
> (default-test) on
> >>> project hadoop-mapreduce-client-jobclient: Execution default-test of
> goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> >>> java.lang.reflect.InvocationTargetException; nested exception is
> >>> java.lang.reflect.InvocationTargetException: null:
> >>> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl
> >>> -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e
> >>> switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> please
> >>> read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>>
> >>>
> >>>
> >>> Inbound Email has been scanned for viruses and SPAM
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> www.sportingindex.com
> >> Inbound Email has been scanned for viruses and SPAM
> >> **********************************************************************
> >> This email and any attachments are confidential, protected by copyright
> and may be legally privileged.  If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system.  Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened.  It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email.  Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
>  Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001).  Any financial promotion contained herein has
> been issued
> >> and approved by Sporting Index Ltd.
> >>
> >> Outbound email has been scanned for viruses and SPAM
> >
> >
> >
> > --
> > Harsh J
> > www.sportingindex.com
> > Inbound Email has been scanned for viruses and SPAM
> > **********************************************************************
> > This email and any attachments are confidential, protected by copyright
> and may be legally privileged.  If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system.  Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened.  It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email.  Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
>  Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001).  Any financial promotion contained herein has
> been issued
> > and approved by Sporting Index Ltd.
> >
> > Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
>

Mime
View raw message