From issues-return-43639-archive-asf-public=cust-asf.ponee.io@tez.apache.org Thu Jan 28 21:28:02 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 407A6180660 for ; Thu, 28 Jan 2021 22:28:02 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id A3E5A63A42 for ; Thu, 28 Jan 2021 21:28:01 +0000 (UTC) Received: (qmail 63007 invoked by uid 500); 28 Jan 2021 21:28:01 -0000 Mailing-List: contact issues-help@tez.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.apache.org Delivered-To: mailing list issues@tez.apache.org Received: (qmail 62988 invoked by uid 99); 28 Jan 2021 21:28:01 -0000 Received: from ec2-52-204-25-47.compute-1.amazonaws.com (HELO mailrelay1-ec2-va.apache.org) (52.204.25.47) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Jan 2021 21:28:01 +0000 Received: from jira2-he-de.apache.org (jira2-he-de.apache.org [168.119.33.54]) by mailrelay1-ec2-va.apache.org (ASF Mail Server at mailrelay1-ec2-va.apache.org) with ESMTPS id CEF313E99D for ; Thu, 28 Jan 2021 21:28:00 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id 23412C801F0 for ; Thu, 28 Jan 2021 21:28:00 +0000 (UTC) Date: Thu, 28 Jan 2021 21:28:00 +0000 (UTC) From: =?utf-8?Q?L=C3=A1szl=C3=B3_Bodor_=28Jira=29?= To: issues@tez.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (TEZ-4236) DAGClientServer is not really needed to be started/used in local mode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TEZ-4236?page=3Dcom.atlassian.j= ira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D172740= 11#comment-17274011 ]=20 L=C3=A1szl=C3=B3 Bodor commented on TEZ-4236: ----------------------------------- pushed to master, thanks [~ashutoshc]=C2=A0for the review! > DAGClientServer is not really needed to be started/used in local mode > --------------------------------------------------------------------- > > Key: TEZ-4236 > URL: https://issues.apache.org/jira/browse/TEZ-4236 > Project: Apache Tez > Issue Type: Improvement > Reporter: L=C3=A1szl=C3=B3 Bodor > Assignee: L=C3=A1szl=C3=B3 Bodor > Priority: Major > Fix For: 0.10.1 > > Attachments: TEZ-4236.01.patch, TEZ-4236.02.patch, TEZ-4236.03.pa= tch, TEZ-4236.04.patch, TEZ-4236.05.patch, TEZ-4236.06.patch > > > For a customer, we found that they try to run hive on tez local mode test= s, and due to strict firewall rules and security policy, the DagClientServe= r struggles to start or respond to connections (think about corporate lapto= ps here). Instead of investigating the network-related workarounds, let's f= ind another way and decide if DAGAppMaster really needs this server.=20 > LocalClient has an embedded [DAGAppMaster|https://github.com/apache/tez/b= lob/master/tez-dag/src/main/java/org/apache/tez/client/LocalClient.java#L65= ], so at the first sight, it doesn't make sense to rely on the network envi= ronment in terms of AM usage. Hopefully, AM can become more lightweight in = the long term if we try to eliminate pointless network usage.=20 -- This message was sent by Atlassian Jira (v8.3.4#803005)