From issues-return-138406-archive-asf-public=cust-asf.ponee.io@hive.apache.org Tue Oct 2 22:11:08 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 0BD9F180638 for ; Tue, 2 Oct 2018 22:11:07 +0200 (CEST) Received: (qmail 36149 invoked by uid 500); 2 Oct 2018 20:11:06 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 36116 invoked by uid 99); 2 Oct 2018 20:11:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 Oct 2018 20:11:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 4B8BCC08FC for ; Tue, 2 Oct 2018 20:11:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -108.3 X-Spam-Level: X-Spam-Status: No, score=-108.3 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_BADIPHTTP=2, NORMAL_HTTP_TO_IP=0.001, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id kOj_NIFCwVnZ for ; Tue, 2 Oct 2018 20:11:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 494DE5F5AB for ; Tue, 2 Oct 2018 20:11:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 8C91AE2639 for ; Tue, 2 Oct 2018 20:11:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id BBF9B23FB6 for ; Tue, 2 Oct 2018 20:11:00 +0000 (UTC) Date: Tue, 2 Oct 2018 20:11:00 +0000 (UTC) From: "Hive QA (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-17300) WebUI query plan graphs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-17300?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1663= 6057#comment-16636057 ]=20 Hive QA commented on HIVE-17300: -------------------------------- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0= m 0s{color} | {color:green} The patch does not contain any @author tags. {= color} | || || || || {color:brown} master Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 39s= {color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}= 7m 45s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 2= m 22s{color} | {color:green} master passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}= 1m 28s{color} | {color:green} master passed {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 3= 4s{color} | {color:blue} common in master has 65 extant Findbugs warnings. = {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 4= 0s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs w= arnings. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m = 2s{color} | {color:blue} ql in master has 2321 extant Findbugs warnings. {c= olor} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 3= 8s{color} | {color:blue} service in master has 48 extant Findbugs warnings.= {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1= m 49s{color} | {color:green} master passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 10s= {color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}= 2m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 2= m 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m = 24s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green}= 1m 23s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green}= 0m 0s{color} | {color:green} The patch has no whitespace issues. {color}= | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} = 6m 11s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1= m 48s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green}= 0m 13s{color} | {color:green} The patch does not generate ASF License war= nings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 35m 54s{colo= r} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Optional Tests | asflicense javac javadoc findbugs checkstyle compi= le | | uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16= .36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux | | Build tool | maven | | Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-14183/de= v-support/hive-personality.sh | | git revision | master / 499539f | | Default Java | 1.8.0_111 | | findbugs | v3.0.0 | | modules | C: common itests/hive-unit ql service U: . | | Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-14183/= yetus.txt | | Powered by | Apache Yetus http://yetus.apache.org | This message was automatically generated. > WebUI query plan graphs > ----------------------- > > Key: HIVE-17300 > URL: https://issues.apache.org/jira/browse/HIVE-17300 > Project: Hive > Issue Type: Sub-task > Components: Web UI > Affects Versions: 4.0.0 > Reporter: Karen Coppage > Assignee: Karen Coppage > Priority: Major > Labels: beginner, features, patch > Attachments: HIVE-17300.10.patch, HIVE-17300.10.patch, HIVE-17300= .10.patch, HIVE-17300.3.patch, HIVE-17300.4.patch, HIVE-17300.5.patch, HIVE= -17300.6.patch, HIVE-17300.7.patch, HIVE-17300.7.patch, HIVE-17300.8.patch,= HIVE-17300.8.patch, HIVE-17300.8.patch, HIVE-17300.8.patch, HIVE-17300.9.p= atch, HIVE-17300.patch, complete_success.png, full_mapred_stats.png, graph_= with_mapred_stats.png, last_stage_error.png, last_stage_running.png, non_ma= pred_task_selected.png > > > Hi all, > I=E2=80=99m working on a feature of the Hive WebUI Query Plan tab that wo= uld provide the option to display the query plan as a nice graph (scroll do= wn for screenshots). If you click on one of the graph=E2=80=99s stages, the= plan for that stage appears as text below.=20 > Stages are color-coded if they have a status (Success, Error, Running), a= nd the rest are grayed out. Coloring is based on status already available i= n the WebUI, under the Stages tab. > There is an additional option to display stats for MapReduce tasks. This = includes the job=E2=80=99s ID, tracking URL (where the logs are found), and= mapper and reducer numbers/progress, among other info.=20 > The library I=E2=80=99m using for the graph is called vis.js (http://visj= s.org/). It has an Apache license, and the only necessary file to be includ= ed from this library is about 700 KB. > I tried to keep server-side changes minimal, and graph generation is take= n care of by the client. Plans with more than a given number of stages (def= ault: 25) won't be displayed in order to preserve resources. > I=E2=80=99d love to hear any and all input from the community about this = feature: do you think it=E2=80=99s useful, and is there anything important = I=E2=80=99m missing? > Thanks, > Karen Coppage > Review request: https://reviews.apache.org/r/61663/ > Any input is welcome! -- This message was sent by Atlassian JIRA (v7.6.3#76005)