flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-7973) Fix service shading relocation for S3 file systems
Date Wed, 08 Nov 2017 10:56:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16243703#comment-16243703
] 

ASF GitHub Bot commented on FLINK-7973:
---------------------------------------

Github user aljoscha commented on a diff in the pull request:

    https://github.com/apache/flink/pull/4961#discussion_r149635569
  
    --- Diff: flink-filesystems/flink-s3-fs-hadoop/README.md ---
    @@ -0,0 +1,27 @@
    +This project is a wrapper around Hadoop's s3a file system. By pulling a smaller dependency
tree and
    +shading all dependencies away, this keeps the appearance of Flink being Hadoop-free,
    +from a dependency perspective.
    +
    +We also relocate the shaded Hadoop version to allow running in a different
    +setup. For this to work, however, we needed to adapt Hadoop's `Configuration`
    +class to load a (shaded) `core-default-shaded.xml` configuration with the
    +relocated class names of classes loaded via reflection
    +(in the fute, we may need to extend this to `mapred-default.xml` and `hdfs-defaults.xml`
and their respective configuration classes).
    --- End diff --
    
    nit: "fute"


> Fix service shading relocation for S3 file systems
> --------------------------------------------------
>
>                 Key: FLINK-7973
>                 URL: https://issues.apache.org/jira/browse/FLINK-7973
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Stephan Ewen
>            Assignee: Nico Kruber
>            Priority: Blocker
>             Fix For: 1.4.0
>
>
> The shade plugin relocates services incorrectly currently, applying relocation patterns
multiple times.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message