hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "tangjunjie (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10260) hive 1.1.0 return NULL value
Date Wed, 15 Apr 2015 08:44:59 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495864#comment-14495864
] 

tangjunjie commented on HIVE-10260:
-----------------------------------

I know the root cause. This is because Table schema is differement from Table's parition schema.But
hive 0.10 always
use Table schema to serde row, hive 0.11 use parition  schema to serde row see https://issues.apache.org/jira/browse/HIVE-3833.


> hive 1.1.0 return NULL value
> ----------------------------
>
>                 Key: HIVE-10260
>                 URL: https://issues.apache.org/jira/browse/HIVE-10260
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.1.0
>         Environment: hive 1.1.0 hadoop 2.3.0
>            Reporter: tangjunjie
>
> hive 0.10 correct result:
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356
       2015-01-19 10:44:44
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356
       2015-01-19 10:35:58
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289
    2015-01-19 15:49:05
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      2015-01-19 14:26:28
> hive 1.1.0
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356
        NULL
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356
        NULL
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289
     NULL
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      NULL
> I found difference from log:
> In hive 1.1.0 
> DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string] separator=[[B@e50bca4]
nullstring=\N lastColumnTakesRest=false 
> In hive 0.10 
> DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type, sessn_chanl_id, gu_sec_flg,
detl_refer_page_type_id, detl_refer_page_value, detl_event_id, nav_refer_intrn_reslt_sum,
nav_intrn_reslt_sum, nav_refer_intrn_kw, nav_intrn_kw, detl_track_time, cart_track_time] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, bigint,
bigint, string, string, string, string, string, string, string, string, string] separator=[[B@116265c3]
nullstring=\N lastColumnTakesRest=false 
> You see hive 1.1.0 lost some column info. Why?   BTW, My meta database schema is hive
0.10 not update to hive 1.1.0.
> When I start hive 0.10 meta store and hive 1.1.0 remote connect it.Hive 1.1.0 return
right result.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message