phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Agrawal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-4319) Zookeeper connection should be closed immediately
Date Mon, 20 Nov 2017 08:36:01 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-4319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258942#comment-16258942
] 

Prashant Agrawal commented on PHOENIX-4319:
-------------------------------------------

Actually we have CDH 4.9.2 running and we tried 4.13 but that is having Hbase as 1.3 so its
not working cause CDH 5.9.2 has 1.2.
More over we have tried back porting Hbase from 1.3 to hbase 1.2 with 4.13 Phoenix and that
is still having this issue where zk connections are getting leaked.

> Zookeeper connection should be closed immediately
> -------------------------------------------------
>
>                 Key: PHOENIX-4319
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4319
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.10.0
>         Environment: phoenix4.10 hbase1.2.0
>            Reporter: Jepson
>              Labels: patch
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> *Code:*
> {code:java}
>     val zkUrl = "192.168.100.40,192.168.100.41,192.168.100.42:2181:/hbase"
>     val configuration = new Configuration()
>     configuration.set("hbase.zookeeper.quorum",zkUrl)
>     val spark = SparkSession
>       .builder()
>       .appName("SparkPhoenixTest1")
>       .master("local[2]")
>       .getOrCreate()
>       for( a <- 1 to 100){
>       val wms_doDF = spark.sqlContext.phoenixTableAsDataFrame(
>         "DW.wms_do",
>         Array("WAREHOUSE_NO", "DO_NO"),
>         predicate = Some(
>           """
>             |MOD_TIME >= TO_DATE('begin_day', 'yyyy-MM-dd')
>             |and MOD_TIME < TO_DATE('end_day', 'yyyy-MM-dd')
>           """.stripMargin.replaceAll("begin_day", "2017-10-01").replaceAll("end_day",
"2017-10-25")),
>         conf = configuration
>       )
>       wms_doDF.show(100)
>     }
> {code}
> *Description:*
> The connection to zookeeper is not getting closed,which causes the maximum number of
client connections to be reached from a host( we have maxClientCnxns as 500 in zookeeper config).
> *Zookeeper connections:*
> [https://github.com/Hackeruncle/Images/blob/master/zookeeper%20connections.png]
> *Reference:*
> [https://community.hortonworks.com/questions/116832/hbase-zookeeper-connections-not-getting-closed.html]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message