hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (HIVE-21846) Create a thread in TezAM which periodically fetches LlapDaemon metrics
Date Wed, 26 Jun 2019 07:04:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21846?focusedWorklogId=267308&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-267308
]

ASF GitHub Bot logged work on HIVE-21846:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 26/Jun/19 07:03
            Start Date: 26/Jun/19 07:03
    Worklog Time Spent: 10m 
      Work Description: asinkovits commented on pull request #683: HIVE-21846: Create a thread
in TezAM which periodically fetches LlapDaemon metrics
URL: https://github.com/apache/hive/pull/683#discussion_r297511069
 
 

 ##########
 File path: common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
 ##########
 @@ -4342,6 +4342,9 @@ private static void populateLlapDaemonVarsSet(Set<String> llapDaemonVarsSetLocal
         "Number of threads to use in LLAP task plugin client."),
     LLAP_DAEMON_DOWNLOAD_PERMANENT_FNS("hive.llap.daemon.download.permanent.fns", false,
         "Whether LLAP daemon should localize the resources for permanent UDFs."),
+    LLAP_TASK_SCHEDULER_AM_COLLECT_DAEMON_METRICS_MS("hive.llap.task.scheduler.am.collect.daemon.metrics",
"0ms",
+      new TimeValidator(TimeUnit.MILLISECONDS), "Collect llap daemon metrics in the AM every
given milliseconds." +
 
 Review comment:
   Yes, this makes sense, I've updated the description.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 267308)
    Time Spent: 1h 10m  (was: 1h)

> Create a thread in TezAM which periodically fetches LlapDaemon metrics
> ----------------------------------------------------------------------
>
>                 Key: HIVE-21846
>                 URL: https://issues.apache.org/jira/browse/HIVE-21846
>             Project: Hive
>          Issue Type: Sub-task
>          Components: llap, Tez
>            Reporter: Peter Vary
>            Assignee: Antal Sinkovits
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-21846.01.patch, HIVE-21846.02.patch
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> LlapTaskSchedulerService should start a thread which periodically fetches the LlapDaemon
metrics and stores them in the NodeInfo object.
> This should be just the first implementation - later we should find a way where we do
not need NxM requests between N TezAM and M LlapDaemon



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message