flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kenmy <...@git.apache.org>
Subject [GitHub] flink pull request #2576: [FLINK-4315] Remove Hadoop Dependency from flink-j...
Date Fri, 30 Sep 2016 10:50:52 GMT
GitHub user kenmy opened a pull request:


    [FLINK-4315] Remove Hadoop Dependency from flink-java

    This PR breaks public API. Don't merge it before 2.0.
    I have moved the org.apache.hadoop dependency from flink-java to flink-hadoop-compatibility.

    My changes are in https://github.com/apache/flink/compare/master...kenmy:FLINK-4315?expand=1
    I had to extract the hadoop dependency from flink-scala to avoid adding flink-hadoop-compatibility
as dependency into flink-scala. Since the flink-scala used some classes from flink-java, which
were transferred into flink-hadoop-compatibility.
    What has changed:
    - The FlinkHadoopEnvironment class has been created In flink-hadoop-compatibility, the
following methods from the class ExecutionEnvironment have been moved there:
    - - readHadoopFile
    - - readSequenceFile
    - - createHadoopInput
    - The ExecutionEnvironment object is passed to the constructor of FlinkHadoopEnvironment.
    - The classes that depend on hadoop were moved into the flink-hadoop-compatibility.
    - The JAPICmp was disabled for flink-scala and flink-java due the API changes. Perhaps
there is a better solution.
    Similar changes have been made for flink-scala.
    In flink-scala remained one reference to hadoop: Writeble in the trait org.apache.flink.api.scala.codegen.TypeInformationGen.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kenmy/flink FLINK-4315

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2576
commit 0435ab0c33315c38b83c2cb3eebe4e324a68318e
Author: Evgeny_Kincharov <evgeny_kincharov@epam.com>
Date:   2016-09-26T07:10:27Z

    [FLINK-4315] Hadoop dependencies were moved from flink-java and flink-scala


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.

View raw message