flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chesnay Schepler (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-6842) Uncomment or remove code in HadoopFileSystem
Date Fri, 02 Jun 2017 19:13:04 GMT
Chesnay Schepler created FLINK-6842:

             Summary: Uncomment or remove code in HadoopFileSystem
                 Key: FLINK-6842
                 URL: https://issues.apache.org/jira/browse/FLINK-6842
             Project: Flink
          Issue Type: Improvement
          Components: Local Runtime
    Affects Versions: 1.4.0
            Reporter: Chesnay Schepler
            Priority: Minor

I've found the following code in {{HadoopFileSystem#getHadoopWrapperClassNameForFileSystem}}


Configuration hadoopConf = getHadoopConfiguration();
Class<? extends org.apache.hadoop.fs.FileSystem> clazz;
// We can activate this block once we drop Hadoop1 support (only hd2 has the getFileSystemClass-method)
//try {
//	clazz = org.apache.hadoop.fs.FileSystem.getFileSystemClass(scheme, hadoopConf);
//} catch (IOException e) {
//	LOG.info("Flink could not load the Hadoop File system implementation for scheme "+scheme);
//	return null;
clazz = hadoopConf.getClass("fs." + scheme + ".impl", null, org.apache.hadoop.fs.FileSystem.class);

if (clazz != null && LOG.isDebugEnabled()) {
	LOG.debug("Flink supports {} with the Hadoop file system wrapper, impl {}", scheme, clazz);
return clazz;

Since we don't support hadoop1 anymore the commented code should either be activated or removed.

This message was sent by Atlassian JIRA

View raw message