tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takanobu Asanuma (Jira)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-4298) ShuffleHandler is not source compatible with Hadoop 3.3.0
Date Mon, 28 Jun 2021 02:25:00 GMT

    [ https://issues.apache.org/jira/browse/TEZ-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17370388#comment-17370388
] 

Takanobu Asanuma commented on TEZ-4298:
---------------------------------------

Thanks for back-porting it and your comment, [~jeagles].
{quote}As far as running tez 0.9 releases on hadoop 3.3, that is problematic.
{quote}
Does it mean it would be difficult to run Hive-3.x(tez-0.9) on Hadoop-3.3? Or can Hive-3.x
run with tez-0.10?

BTW, Hadoop-3.3.1 may take care of the protobuf issues by HADOOP-16596 and HDFS-15790.

> ShuffleHandler is not source compatible with Hadoop 3.3.0
> ---------------------------------------------------------
>
>                 Key: TEZ-4298
>                 URL: https://issues.apache.org/jira/browse/TEZ-4298
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Jonathan Turner Eagles
>            Assignee: Jonathan Turner Eagles
>            Priority: Major
>             Fix For: 0.9.3, 0.10.2
>
>         Attachments: TEZ-4298.001.patch, TEZ-4298.001.patch, TEZ-4298.002.patch
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> {noformat}
> mvn clean package -DskipTests -pl '!tez-ui' -Dhadoop.version=3.3.0
> [ERROR] COMPILATION ERROR : 
> [INFO] -------------------------------------------------------------
> [ERROR] tez/tez-plugins/tez-aux-services/src/main/java/org/apache/tez/auxservices/ShuffleHandler.java:[764,45]
incompatible types: com.google.protobuf.ByteString cannot be converted to org.apache.hadoop.thirdparty.protobuf.ByteString
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message