hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: hadoop trunk build failure - yarn, surefire related?
Date Tue, 11 Sep 2012 10:58:43 GMT
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.

I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk

On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TBurton@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute
which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TBurton@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then
ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop,
now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TBurton@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try  mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TBurton@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed?  Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be
legally privileged.  If you are not the intended recipient, then the dissemination or copying
of this email is prohibited. If you have received this in error, please notify the sender
by replying by email and then delete the email completely from your system.  Neither Sporting
Index nor the sender accepts responsibility for any virus, or any other defect which might
affect any computer or IT system into which the email is received and/or opened.  It is the
responsibility of the recipient to scan the email and no responsibility is accepted for any
loss or damage arising in any way from receipt or use of this email.  Sporting Index Ltd is
a company registered in England and Wales with company number 2636842, whose registered office
is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised
and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission
(reg. no. 000-027343-R-308898-001).  Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally
privileged.  If you are not the intended recipient, then the dissemination or copying of this
email is prohibited. If you have received this in error, please notify the sender by replying
by email and then delete the email completely from your system.  Neither Sporting Index nor
the sender accepts responsibility for any virus, or any other defect which might affect any
computer or IT system into which the email is received and/or opened.  It is the responsibility
of the recipient to scan the email and no responsibility is accepted for any loss or damage
arising in any way from receipt or use of this email.  Sporting Index Ltd is a company registered
in England and Wales with company number 2636842, whose registered office is at Gateway House,
Milverton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and regulated by the
UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).
 Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM



-- 
Harsh J

Mime
View raw message