flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From NicoK <...@git.apache.org>
Subject [GitHub] flink pull request #4939: [FLINK-4228][yarn/s3a] fix yarn resource upload s3...
Date Fri, 10 Nov 2017 16:15:09 GMT
Github user NicoK commented on a diff in the pull request:

    https://github.com/apache/flink/pull/4939#discussion_r150275387
  
    --- Diff: flink-yarn/pom.xml ---
    @@ -153,6 +159,63 @@ under the License.
     				</plugins>
     			</build>
     		</profile>
    +
    +		<profile>
    +			<!-- Hadoop >= 2.6 moved the S3 file systems from hadoop-common into hadoop-aws
artifact
    +				(see https://issues.apache.org/jira/browse/HADOOP-11074)
    +				We can add the (test) dependency per default once 2.6 is the minimum required version.
    +			-->
    +			<id>include_hadoop_aws</id>
    +			<activation>
    +				<property>
    +					<name>include_hadoop_aws</name>
    +				</property>
    +			</activation>
    +			<dependencies>
    +				<!-- for the S3 tests of YarnFileStageTestS3ITCase -->
    +				<dependency>
    +					<groupId>org.apache.hadoop</groupId>
    +					<artifactId>hadoop-aws</artifactId>
    +					<version>${hadoop.version}</version>
    +					<scope>test</scope>
    +					<exclusions>
    +						<exclusion>
    +							<groupId>org.apache.avro</groupId>
    +							<artifactId>avro</artifactId>
    +						</exclusion>
    --- End diff --
    
    makes sense, I guess


---

Mime
View raw message