hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guy le Mar (JIRA)" <j...@apache.org>
Subject [jira] Created: (HIVE-1816) Reporting of (seemingly inconsequential) transport exception has major impact on performance
Date Tue, 30 Nov 2010 22:00:11 GMT
Reporting of (seemingly inconsequential) transport exception has major impact on performance
--------------------------------------------------------------------------------------------

                 Key: HIVE-1816
                 URL: https://issues.apache.org/jira/browse/HIVE-1816
             Project: Hive
          Issue Type: Improvement
          Components: Drivers
    Affects Versions: 0.5.0
         Environment: Custom Java application using the Hive JDBC driver to connect to a Hive
server, execute a Hive query and process the results. 
            Reporter: Guy le Mar
            Priority: Minor


During the process of executing a hive query and then fetching the results, the following
stack track is continually output to seterr.
For the query I executed, 47Mb of this text was generated. As a consequence, the performance
of the application itself suffered.
(Redirecting stderr to file halved the time it took my application to fetch the results -
from 2 minutes down to 70 sec.)

Note, this also occurs if you use an application such as SQuirrel SQL (http://www.squirrelsql.org)
to execute a Hive query using the Hive JDBC driver.

The stack trace that is repeatedly reported is...

org.apache.thrift.transport.TTransportException
	at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.fillTokenizer(TCTLSeparatedProtocol.java:215)
	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.<init>(TCTLSeparatedProtocol.java:210)
	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.internalInitialize(TCTLSeparatedProtocol.java:336)
	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.initialize(TCTLSeparatedProtocol.java:417)
	at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:94)
	at org.apache.hadoop.hive.jdbc.HiveResultSet.initDynamicSerde(HiveResultSet.java:117)
	at org.apache.hadoop.hive.jdbc.HiveResultSet.<init>(HiveResultSet.java:74)
	at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:178)
	at com.quest.orahive.HiveJdbcClient.main(HiveJdbcClient.java:117)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message