spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pin_zhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-25804) JDOPersistenceManager leak when query via JDBC
Date Tue, 23 Oct 2018 00:34:00 GMT
pin_zhang created SPARK-25804:
---------------------------------

             Summary: JDOPersistenceManager leak when query via JDBC
                 Key: SPARK-25804
                 URL: https://issues.apache.org/jira/browse/SPARK-25804
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: pin_zhang


1. start-thriftserver.sh under SPARK2.3.1

2. Create Table and insert values

     create table test_leak (id string, index int);

     insert into test_leak values('id1',1)

3. Create JDBC Client query the table

import java.sql.*;

public class HiveClient {

public static void main(String[] args) throws Exception {

String driverName = "org.apache.hive.jdbc.HiveDriver";
 Class.forName(driverName);
 Connection con = DriverManager.getConnection( "jdbc:hive2://localhost:10000/default", "test",
"test");
 Statement stmt = con.createStatement();
 String sql = "select * from test_leak";
 int loop = 1000000;
 while ( loop -- > 0) {
 ResultSet rs = stmt.executeQuery(sql);
 rs.next(); 
 System.out.println(new java.sql.Timestamp(System.currentTimeMillis()) +" : " + rs.getString(1));
 rs.close();
 }
 con.close();
 }
}

4. Dump HS2 heap org.datanucleus.api.jdo.JDOPersistenceManager instances keep increasing.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message