flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9525) Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module
Date Mon, 06 Aug 2018 08:37:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569880#comment-16569880
] 

Till Rohrmann commented on FLINK-9525:
--------------------------------------

[~yew1eb] is this still an issue? If not, I will close this issue at the end of this week.

> Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module
> ----------------------------------------------------------------------
>
>                 Key: FLINK-9525
>                 URL: https://issues.apache.org/jira/browse/FLINK-9525
>             Project: Flink
>          Issue Type: Bug
>          Components: FileSystem
>    Affects Versions: 1.4.0, 1.5.0, 1.6.0
>            Reporter: Hai Zhou
>            Assignee: Hai Zhou
>            Priority: Major
>             Fix For: 1.5.3, 1.6.1, 1.7.0
>
>         Attachments: WX20180605-142414@2x.png
>
>
> if flink job dependencies includes `hadoop-common` and `hadoop-hdfs`, will throw runtime
error.
> like this case: [https://stackoverflow.com/questions/47890596/java-util-serviceconfigurationerror-org-apache-hadoop-fs-filesystem-provider-o].
> the root cause: 
> see  {{org.apache.flink.core.fs.FileSystem}}
> This class will load all available file system factories via {{ServiceLoader.load(FileSystemFactory.class)}}.

> Since  {{ META-INF / services / org.apache.flink.core.fs.FileSystemFactory }} file in
the classpath does not have an `org.apache.flink.runtime.fs.hdfs.HadoopFsFactory`, 
> and finaly only loaded one available {{LocalFileSystemFactory}} .
> more error messages see this screenshot.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message