tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (Jira)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-4298) ShuffleHandler is not source compatible with Hadoop 3.3.0
Date Fri, 25 Jun 2021 10:50:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369401#comment-17369401
] 

Takanobu Asanuma commented on TEZ-4298:
---------------------------------------

[~abstractdog] Thanks for your reply. branch-0.9.2 can build with hadoop-3.2.2, and it also
can build with hadoop-3.3.0 with this PR. So I thought branch-0.9.x is also following Hadoop
3.x line.

We are trying to run Hive-3.1 on tez-0.9.x on Hadoop-3.3.0. Is it difficult to run tez-0.9.x
on Hadoop-3.3.0?

> ShuffleHandler is not source compatible with Hadoop 3.3.0
> ---------------------------------------------------------
>
>                 Key: TEZ-4298
>                 URL: https://issues.apache.org/jira/browse/TEZ-4298
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Jonathan Turner Eagles
>            Assignee: Jonathan Turner Eagles
>            Priority: Major
>             Fix For: 0.10.2
>
>         Attachments: TEZ-4298.001.patch, TEZ-4298.001.patch, TEZ-4298.002.patch
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> {noformat}
> mvn clean package -DskipTests -pl '!tez-ui' -Dhadoop.version=3.3.0
> [ERROR] COMPILATION ERROR : 
> [INFO] -------------------------------------------------------------
> [ERROR] tez/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java:[764,45]
incompatible types: com.google.protobuf.ByteString cannot be converted to org.apache.hadoop.thirdparty.protobuf.ByteString
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message