flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Razvan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-9441) Hadoop Required Dependency List Not Clear
Date Tue, 05 Jun 2018 15:11:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Razvan updated FLINK-9441:
--------------------------
    Description: 
To be able to use Apache Flink with S3, a few libraries from Hadoop distribution are required
to be added to lib/ folder.

This list is partially documented in [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/aws.html] 
(Provide S3 FileSystem Dependency). But it refers to Hadoop 2.7 whereas Flink supports 2.8
also.

How to compose the dependecy list for Hadoop 2.8?

Is it possible to bundle the dependencies in a separate archive that users can download?

 

UPDATE:

  was:
To be able to use Apache Flink with S3, a few libraries from Hadoop distribution are required
to be added to lib/ folder.

This list is partially documented in [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/aws.html] 
(Provide S3 FileSystem Dependency). But it refers to Hadoop 2.7 whereas Flink supports 2.8
also.

So i would like to know how to compose the dependecy list for Hadoop 2.8 and update the documentation.

Also would it be possible to bundle the dependencies in a separate archive that users can
download?


> Hadoop Required Dependency List Not Clear
> -----------------------------------------
>
>                 Key: FLINK-9441
>                 URL: https://issues.apache.org/jira/browse/FLINK-9441
>             Project: Flink
>          Issue Type: Bug
>          Components: Build System, Configuration, Documentation
>    Affects Versions: 1.5.0, 1.4.2, 1.6.0
>            Reporter: Razvan
>            Priority: Blocker
>
> To be able to use Apache Flink with S3, a few libraries from Hadoop distribution are
required to be added to lib/ folder.
> This list is partially documented in [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/aws.html] 
(Provide S3 FileSystem Dependency). But it refers to Hadoop 2.7 whereas Flink supports 2.8
also.
> How to compose the dependecy list for Hadoop 2.8?
> Is it possible to bundle the dependencies in a separate archive that users can download?
>  
> UPDATE:



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message