hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Wong (JIRA)" <>
Subject [jira] Commented: (HIVE-1816) Reporting of (seemingly inconsequential) transport exception has major impact on performance
Date Tue, 30 Nov 2010 22:20:11 GMT


Steven Wong commented on HIVE-1816:

HiveResultSet stops using DynamicSerDe in 0.7, so this stack trace should not be possible
starting in 0.7.

> Reporting of (seemingly inconsequential) transport exception has major impact on performance
> --------------------------------------------------------------------------------------------
>                 Key: HIVE-1816
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Drivers
>    Affects Versions: 0.5.0
>         Environment: Custom Java application using the Hive JDBC driver to connect to
a Hive server, execute a Hive query and process the results. 
>            Reporter: Guy le Mar
>            Priority: Minor
> During the process of executing a hive query and then fetching the results, the following
stack track is continually output to seterr.
> For the query I executed, 47Mb of this text was generated. As a consequence, the performance
of the application itself suffered.
> (Redirecting stderr to file halved the time it took my application to fetch the results
- from 2 minutes down to 70 sec.)
> Note, this also occurs if you use an application such as SQuirrel SQL (
to execute a Hive query using the Hive JDBC driver.
> The stack trace that is repeatedly reported is...
> org.apache.thrift.transport.TTransportException
> 	at
> 	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.fillTokenizer(
> 	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.<init>(
> 	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.internalInitialize(
> 	at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.initialize(
> 	at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(
> 	at org.apache.hadoop.hive.jdbc.HiveResultSet.initDynamicSerde(
> 	at org.apache.hadoop.hive.jdbc.HiveResultSet.<init>(
> 	at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(
> 	at

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message