Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@phoenix.apache.org
Date: Wed, 8 Feb 2017 18:39:41 +0000 (UTC)
From: "Enis Soztutar (JIRA)" <jira@apache.org>
To: dev@phoenix.apache.org
Message-ID: <JIRA.13010342.1475805761000.31181.1486579181786@Atlassian.JIRA>
In-Reply-To: <JIRA.13010342.1475805761000@Atlassian.JIRA>
References: <JIRA.13010342.1475805761000@Atlassian.JIRA> <JIRA.13010342.1475805761403@jira-lw-us.apache.org>
Subject: [jira] [Commented] (PHOENIX-3360) Secondary index configuration is
 wrong
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 08 Feb 2017 18:40:03 -0000


    [ https://issues.apache.org/jira/browse/PHOENIX-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858369#comment-15858369 ] 

Enis Soztutar commented on PHOENIX-3360:
----------------------------------------

bq. When ever one of the phoenix table region opened in the RS we are setting the property with ServerRpcControllerFactory
It is the Indexer setting the configuration. Even if there are no tables with index, do we still instantiate the Indexer? 
bq. With William Yang's patch the short-circuit write optimization will not work because the connection created is not a coprocessor connection.
That is a good point. We need the short circuit'ing logic, otherwise it is another cause for deadlocking the threads. 

> Secondary index configuration is wrong
> --------------------------------------
>
>                 Key: PHOENIX-3360
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3360
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>            Assignee: Rajeshbabu Chintaguntla
>            Priority: Critical
>             Fix For: 4.10.0
>
>         Attachments: PHOENIX-3360.patch, PHOENIX-3360-v2.PATCH
>
>
> IndexRpcScheduler allocates some handler threads and uses a higher priority for RPCs. The corresponding IndexRpcController is not used by default as it is, but used through ServerRpcControllerFactory that we configure from Ambari by default which sets the priority of the outgoing RPCs to either metadata priority, or the index priority.
> However, after reading code of IndexRpcController / ServerRpcController it seems that the IndexRPCController DOES NOT look at whether the outgoing RPC is for an Index table or not. It just sets ALL rpc priorities to be the index priority. The intention seems to be the case that ONLY on servers, we configure ServerRpcControllerFactory, and with clients we NEVER configure ServerRpcControllerFactory, but instead use ClientRpcControllerFactory. We configure ServerRpcControllerFactory from Ambari, which in affect makes it so that ALL rpcs from Phoenix are only handled by the index handlers by default. It means all deadlock cases are still there. 
> The documentation in https://phoenix.apache.org/secondary_indexing.html is also wrong in this sense. It does not talk about server side / client side. Plus this way of configuring different values is not how HBase configuration is deployed. We cannot have the configuration show the ServerRpcControllerFactory even only for server nodes, because the clients running on those nodes will also see the wrong values. 


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)