hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Oleksandr Shevchenko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15908) hadoop-build-tools jar is downloaded from remote repository instead of using from local
Date Wed, 07 Nov 2018 09:32:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677910#comment-16677910
] 

Oleksandr Shevchenko commented on HADOOP-15908:
-----------------------------------------------

Thanks [~ajisakaa] for the review. I missed this. I'll recheck this and submit a new patch.

> hadoop-build-tools jar is downloaded from remote repository instead of using from local
> ---------------------------------------------------------------------------------------
>
>                 Key: HADOOP-15908
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15908
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Oleksandr Shevchenko
>            Priority: Minor
>         Attachments: HADOOP-15908.001.patch
>
>
> HADOOP-12893 added "maven-remote-resources-plugin" to hadoop-project/pom.xml to verify
LICENSE.txt and NOTICE.txt files which includes "hadoop-build-tools" remote resource bundles.

> {code}
> <plugin>
>  <groupId>org.apache.maven.plugins</groupId>
>  <artifactId>maven-remote-resources-plugin</artifactId>
>  <version>${maven-remote-resources-plugin.version}</version>
>  <configuration>
>  <resourceBundles>
>  <resourceBundle>org.apache.hadoop:hadoop-build-tools:${hadoop.version}</resourceBundle>
>  </resourceBundles>
>  </configuration>
>  <dependencies>
>  <dependency>
>  <groupId>org.apache.hadoop</groupId>
>  <artifactId>hadoop-build-tools</artifactId>
>  <version>${hadoop.version}</version>
>  </dependency>
>  </dependencies>
>  <executions>
>  <execution>
>  <goals>
>  <goal>process</goal>
>  </goals>
>  </execution>
>  </executions>
>  </plugin>
> {code}
> If we build only some module we always download " hadoop-build-tools" from maven repository.
> For example run:
> cd hadoop-common-project/
> mvn test
> Then we will get the following output:
> {noformat}
> [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hadoop-annotations ---
> Downloading from apache.snapshots: http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots: http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/maven-metadata.xml
(791 B at 684 B/s)
> Downloading from apache.snapshots: http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-main/3.3.0-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots: http://repository.apache.org/snapshots/org/apache/hadoop/hadoop-main/3.3.0-SNAPSHOT/maven-metadata.xml
(609 B at 547 B/s)
> Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/maven-metadata.xml
> Downloaded from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/maven-metadata.xml
(791 B at 343 B/s)
> Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/hadoop-build-tools-3.3.0-20181022.232020-179.jar
> Downloaded from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-build-tools/3.3.0-SNAPSHOT/hadoop-build-tools-3.3.0-20181022.232020-179.jar
(0 B at 0 B/s)
> {noformat}
> If "hadoop-build-tools" jar doesn't exist in maven repository (for example we try to
build new version locally before repository will be created ) we can't build some module:
> For example run:
> cd hadoop-common-project/
> mvn test
> Then we will get the following output:
> {noformat}
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
(default) on project hadoop-annotations: Execution default of goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
failed: Plugin org.apache.maven.plugins:maven-remote-resources-plugin:1.5 or one of its dependencies
could not be resolved: Failure to find org.apache.hadoop:hadoop-build-tools:jar:3.2.0 in https://repo.maven.apache.org/maven2
was cached in the local repository, resolution will not be reattempted until the update interval
of central has elapsed or updates are forced -> [Help 1]
> {noformat}
> Therefore, we need to limit execution of the Remote Resources Plugin only in the root
directory in which the build was run.
> To accomplish this, we can use the "runOnlyAtExecutionRoot parameter"
> From maven documentation http://maven.apache.org/plugins/maven-remote-resources-plugin/usage.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message