hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Biswajit Nayak <biswa...@altiscale.com>
Subject Re: Hive Cli ORC table read error with limit option
Date Tue, 01 Mar 2016 05:56:03 GMT
Thanks Gopal for the response.

Yes it is kerberos cluster.

After disabling the optimization in hive cli, it works with limit option.
Below is the DESC details of the table that you asked for.


*hive> desc formatted *testdb.table_orc*;*

*OK*

*# col_name            data_type           comment             *



*row_id              bigint                                  *

*a                int                                     *

*b                 int                                     *

*c               varchar(2)                              *

*d    bigint                                  *

*e         int                                     *

*f       bigint                                  *

*g               float                                   *

*h               int                                     *

*i                 int                                     *



*# Partition Information  *

*# col_name            data_type           comment             *



*year                int                                     *

*month               int                                     *

*day                 int                                     *



*# Detailed Table Information  *

*Database:           *testdb

*Owner:              *************   *

*CreateTime:         Mon Jan 25 22:32:22 UTC 2016  *

*LastAccessTime:     UNKNOWN              *

*Protect Mode:       None                 *

*Retention:          0                    *

*Location:           hdfs://***************:8020/hive/*testdb*.db/table_orc
 *

*Table Type:         MANAGED_TABLE        *

*Table Parameters:  *

* last_modified_by    **************          *

* last_modified_time  **************          *

* orc.compress        SNAPPY              *

* transient_lastDdlTime 1454104669          *



*# Storage Information  *

*SerDe Library:      org.apache.hadoop.hive.ql.io.orc.OrcSerde  *

*InputFormat:        org.apache.hadoop.hive.ql.io.orc.OrcInputFormat  *

*OutputFormat:       org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat  *

*Compressed:         No                   *

*Num Buckets:        7                    *

*Bucket Columns:     [f]       *

*Sort Columns:       []                   *

*Storage Desc Params:  *

* field.delim         \t                  *

* serialization.format \t                  *

*Time taken: 0.105 seconds, Fetched: 46 row(s)*

*hive> *



On Tue, Mar 1, 2016 at 10:55 AM, Gopal Vijayaraghavan <gopalv@apache.org>
wrote:

>
> > Failed with exception java.io.IOException:java.lang.RuntimeException:
> >serious problem
> > Time taken: 0.32 seconds
> ...
> > Any one faced this issue.
>
> No, but that sounds like one of the codepaths I put in - is this a
> Kerberos secure cluster?
>
> Try disabling the optimization and see if it works.
>
> set hive.fetch.task.conversion=none;
>
> If it does, reply back with "desc formatted <table>" & I can help you
> debug deeper.
>
> Cheers,
> Gopal
>
>
>

Mime
View raw message