hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahmood Naderan <nt_mahm...@yahoo.com>
Subject Re: Assertion error while builing hdoop 2.3.0
Date Fri, 07 Mar 2014 04:32:54 GMT
Thanks for the update. Let me ask a question before continuing the installation. It has been
stated

>>To get a Hadoop distribution, download a recent stable release from one of the Apache
Download Mirrors.

Do you mean the source package or the other?

hadoop-2.3.0-src.tar.gz  (14MB)
hadoop-2.3.0.tar.gz  (127MB)

 
Regards,
Mahmood



On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <ajisakaa@oss.nttdata.co.jp> wrote:
 
Hi Mahmood,

> I have downloaded hadoop-2.3.0-src and followed the guide from
> 
http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html

The documentation is still old, and you don't need to compile
the source code to build a cluster.

I built the latest document and uploaded to github.io. Please follow the 
following page.

http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html

Thanks,
Akira


(2014/03/06 11:08), Mahmood Naderan wrote:
> Stuck at this step.....
> Hope to receive any idea...
>
> Regards,
> Mahmood
>
>
> On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan
> <nt_mahmood@yahoo.com> wrote:
> Hi
> I have downloaded hadoop-2.3.0-src and followed the guide from
> http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
>
> The first command "mvn clean install -DskipTests" was successful.
> However wen I run
>
>     cd hadoop-mapreduce-project
>     mvn clean install assembly:assembly -Pnative
>
> At some point I get an error. Searching the error message on the web
> shows some Q&A on the mailing list archive but seems that they are
> related to developers. Please see the full messages below (sorry for
> long post).
>
> Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59
> sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
> Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
> testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 2.978 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
>
> testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
> Time elapsed: 0.255 sec  <<< FAILURE!
> java.lang.AssertionError: null
>      at org.junit.Assert.fail(Assert.java:92)
>      at org.junit.Assert.assertTrue(Assert.java:43)
>      at org.junit.Assert.assertNotNull(Assert.java:526)
>      at org.junit.Assert.assertNotNull(Assert.java:537)
>      at
> org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263)
>
> Running org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster
> Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec -
> in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies
> Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273
> sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics
> Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure
> Running org.apache.hadoop.mapreduce.v2.app.TestFail
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483
> sec - in org.apache.hadoop.mapreduce.v2.app.TestFail
> Running org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554
> sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp
> Running org.apache.hadoop.mapreduce.v2.app.TestKill
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046
> sec - in org.apache.hadoop.mapreduce.v2.app.TestKill
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272
> sec <<< FAILURE! - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl
> testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl)
> Time elapsed: 5.28 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<SETUP> but was:<RUNNING>
>      at org.junit.Assert.fail(Assert.java:93)
>      at org.junit.Assert.failNotEquals(Assert.java:647)
>      at org.junit.Assert.assertEquals(Assert.java:128)
>      at org.junit.Assert.assertEquals(Assert.java:147)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816)
>      at
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499)
>
> Running
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051
> sec - in
> org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl
> Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506
> sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
> Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647
> sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher
> Running
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959
> sec - in
> org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl
> Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797
> sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators
> Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881
> sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler
> Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103
> sec - in
> org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks
> Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363
> sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts
> Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents
> Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723
> sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
> Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877
> sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl
>
> Results :
>
> Failed tests:
>    TestCommitterEventHandler.testFailure:314 null
>    TestCommitterEventHandler.testBasic:263 null
>    TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816
> expected:<SETUP> but was:<RUNNING>
>
> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0
>
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Skipping hadoop-mapreduce
> [INFO] This project has been banned from the build due to previous failures.
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [
> 4.600 s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS
> [02:34 min]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS
> [01:08 min]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [
> 6.173 s]
> [INFO] hadoop-mapreduce-client-app ....................... FAILURE
> [11:20 min]
> [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
> [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
> [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
> [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
> [INFO] hadoop-mapreduce .................................. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 15:25 min
> [INFO] Finished at: 2014-03-06T18:35:49+03:30
> [INFO] Final Memory: 29M/126M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "native" could not be activated because
> it does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test)
> on project hadoop-mapreduce-client-app: ExecutionException; nested
> exception is java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: The forked VM terminated without saying
> properly goodbye. VM crash or System.exit called ?
> [ERROR] Command was/bin/sh -c cd
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app
> && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m
> -XX:+HeapDumpOnOutOfMemoryError -jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp
> /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :hadoop-mapreduce-client-app
>
>
> Regards,
> Mahmood
>
>
Mime
View raw message