hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohith Sharma K S <rohithsharm...@huawei.com>
Subject RE: Error with winutils.sln
Date Tue, 10 Feb 2015 11:41:11 GMT
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922

Thanks & Regards
Rohith Sharma K S

From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln

Thank you Rohit.

Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?

Thx,
Venkat.


On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <rohithsharmaks@huawei.com<mailto:rohithsharmaks@huawei.com>>
wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues.
I think it is explicitly removed the support.

But It is possible to compile successfully by  tweaking some of the files. Follow the below
instructions

1.         Apply the patch HADOOP-9922.patch to your 2.6 version

patch –p1 < HADOOP-9922.patch

2.        Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln

3.       Replace “x64” with “Win32” in

$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and

$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj

If in your machine native compilation does not happen because of cmake not installed or any
other reason then you will face issue while compiling hdfs project. So, for the sake of compiling
you can skip native compilation at hdfs.

4.          To skip native compilation, add “<skip>${skipTests}</skip>” or
“<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.

           <configuration>

                  <skip>${skipTests}</skip>

                  <target>

                    <mkdir dir="${project.build.directory}/native"/>

Note : there are 2 occurrences, you add at both 2 occurrence

And compile using “mvn clean install –DskipTests”

Hope this will help to compile.. enjoy with Hadoop!!!

Thanks & Regards
Rohith Sharma K S

From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<mailto:venkat.architect@gmail.com>]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Error with winutils.sln

Hello,

I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:

.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
parent: sun.misc.Launcher$AppClassLoader@647e05<mailto:sun.misc.Launcher$AppClassLoader@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator
-->
[DEBUG]   (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
/nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
/p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG]   (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG]   (f) classpathScope = runtime
[DEBUG]   (f) executable = msbuild
[DEBUG]   (f) longClasspath = false
[DEBUG]   (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG]   (f) session = org.apache.maven.execution.MavenSession@157dc72<mailto:org.apache.maven.execution.MavenSession@157dc72>
[DEBUG]   (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
/nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
/p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify
a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe
Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank
to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
(default targets) -- FAILED.

Build FAILED.

"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
(default target) (1) ->
(ValidateSolutionConfiguration target) ->
  D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify
a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe
Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank
to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]

    0 Warning(s)
    1 Error(s)

Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [  5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils)
on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value:
1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit
value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-common


Can someone please tell me how to correct this error and move forward?

Thanks,
Venkat.



Mime
View raw message