tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TAJO-275) Separating QueryMaster and TaskRunner roles in worker
Date Fri, 25 Oct 2013 06:27:30 GMT

    [ https://issues.apache.org/jira/browse/TAJO-275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805084#comment-13805084
] 

Hudson commented on TAJO-275:
-----------------------------

SUCCESS: Integrated in Tajo-trunk-postcommit #534 (See [https://builds.apache.org/job/Tajo-trunk-postcommit/534/])
TAJO-275: Separating QueryMaster and TaskRunner roles in worker. (Keuntae Park via jihoon)
(jihoonson: https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=5470bcea1ae3ec4c627f7f6fc7efa2c1c19e06cd)
* tajo-dist/src/main/bin/start-tajo.sh
* tajo-core/tajo-core-backend/pom.xml
* tajo-core/tajo-core-backend/src/main/resources/webapps/worker/queryplan.jsp
* tajo-core/tajo-core-backend/src/main/resources/webapps/admin/index.jsp
* tajo-dist/src/main/bin/stop-tajo.sh
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/GlobalEngine.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/TaskRunner.java
* tajo-core/tajo-core-backend/src/main/resources/webapps/worker/querydetail.jsp
* tajo-core/tajo-core-backend/src/main/resources/webapps/admin/query.jsp
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/TaskRunnerManager.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/TajoContainerProxy.java
* tajo-dist/src/main/bin/tajo-config.sh
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryMaster.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/TajoWorker.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/rm/YarnTajoResourceManager.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/TajoMasterService.java
* pom.xml
* tajo-dist/src/main/conf/tajo-env.sh
* tajo-core/tajo-core-backend/src/main/resources/webapps/worker/env.jsp
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryMasterManagerService.java
* tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/TajoTestingCluster.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/rm/WorkerResourceManager.java
* tajo-core/tajo-core-backend/src/main/resources/webapps/worker/index.jsp
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/rm/TajoWorkerResourceManager.java
* tajo-core/tajo-core-backend/src/main/proto/TajoMasterProtocol.proto
* tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/TajoResourceAllocator.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/TajoWorkerManagerService.java
* tajo-core/tajo-core-backend/src/main/resources/webapps/worker/querytasks.jsp
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/rm/WorkerResource.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/worker/Task.java
* tajo-dist/src/main/bin/tajo
* CHANGES.txt
* tajo-core/tajo-core-backend/src/main/resources/tajo-default.xml
* tajo-core/tajo-core-backend/src/main/resources/webapps/admin/cluster.jsp
* tajo-core/tajo-core-backend/src/main/proto/TajoWorkerProtocol.proto
* tajo-core/tajo-core-backend/src/main/proto/QueryMasterProtocol.proto
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryJobManager.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryInfo.java
* tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/QueryInProgress.java


> Separating QueryMaster and TaskRunner roles in worker
> -----------------------------------------------------
>
>                 Key: TAJO-275
>                 URL: https://issues.apache.org/jira/browse/TAJO-275
>             Project: Tajo
>          Issue Type: Improvement
>            Reporter: Keuntae Park
>            Assignee: Keuntae Park
>         Attachments: TAJO-275.patch, TAJO-275.patch_2
>
>
> In C++ implementation of Tajo worker,
> I think it is better to maintain Java code of QueryMaster and implement only TaskRunner
as C++ code, rather than implementing both QueryMaster and TaskRunner as C++ code.
> Accordingly, standby mode worker will have following 3 modes:
> 1) TaskRunner + QueryMaster (current implementation)
> 2) TaskRunner only (C++)
> 3) QueryMaster only (java)
> And,  most workers work as C++ TaskRunner, and 1 or 2 workers work as separate QueryMasters
(java process).
> For backward compatibility, default mode should be mode 1 (TaskRunner + QueryMaster)

> To achieve the goal, it needs to separate java TaskRunner and java QueryMaster Worker
first.
> (And then, implement C++ TaskRunner)



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message