hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "tangjunjie (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-10260) hive 1.1.0 retun NULL value
Date Wed, 08 Apr 2015 07:13:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

tangjunjie updated HIVE-10260:
------------------------------
    Description: 
hive 0.10 correct result:
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356  
     2015-01-19 10:44:44
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356  
     2015-01-19 10:35:58
UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289 
   2015-01-19 15:49:05
Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      2015-01-19 14:26:28

hive 1.1.0
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356  
      NULL
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356  
      NULL
UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289 
    NULL
Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      NULL


I found difference from log:
In hive 1.1.0 
DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string] separator=[[B@e50bca4]
nullstring=\N lastColumnTakesRest=false 

In hive 0.10 
DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type, sessn_chanl_id, gu_sec_flg,
detl_refer_page_type_id, detl_refer_page_value, detl_event_id, nav_refer_intrn_reslt_sum,
nav_intrn_reslt_sum, nav_refer_intrn_kw, nav_intrn_kw, detl_track_time, cart_track_time] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, bigint,
bigint, string, string, string, string, string, string, string, string, string] separator=[[B@116265c3]
nullstring=\N lastColumnTakesRest=false 

You see hive 1.1.0 lost some column info. Why?   BTW, My meta database schema is hive 0.10
not update to hive 1.1.0.


When I start hive 0.10 meta store and hive 1.1.0 remote connect it.Hive 1.1.0 return right
result.



  was:
hive 0.10 correct result:
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356  
     2015-01-19 10:44:44
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356  
     2015-01-19 10:35:58
UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289 
   2015-01-19 15:49:05
Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      2015-01-19 14:26:28

hive 1.1.0
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356  
      NULL
87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356  
      NULL
UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289 
    NULL
Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      NULL


I found difference form log:
In hive 1.1.0 
DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string] separator=[[B@e50bca4]
nullstring=\N lastColumnTakesRest=false 

In hive 0.10 
DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type, sessn_chanl_id, gu_sec_flg,
detl_refer_page_type_id, detl_refer_page_value, detl_event_id, nav_refer_intrn_reslt_sum,
nav_intrn_reslt_sum, nav_refer_intrn_kw, nav_intrn_kw, detl_track_time, cart_track_time] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, bigint,
bigint, string, string, string, string, string, string, string, string, string] separator=[[B@116265c3]
nullstring=\N lastColumnTakesRest=false 

You see hive 1.1.0 lost some column info. Why?   BTW, My meta database schema is hive 0.10
not update to hive 1.1.0.


When I start hive 0.10 meta store and hive 1.1.0 remote connect it.Hive 1.1.0 return right
result.




> hive 1.1.0 retun NULL value
> ---------------------------
>
>                 Key: HIVE-10260
>                 URL: https://issues.apache.org/jira/browse/HIVE-10260
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 1.1.0
>         Environment: hive 1.1.0 hadoop 2.3.0
>            Reporter: tangjunjie
>
> hive 0.10 correct result:
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356
       2015-01-19 10:44:44
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356
       2015-01-19 10:35:58
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289
    2015-01-19 15:49:05
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      2015-01-19 14:26:28
> hive 1.1.0
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   91501191044440048       7326356
        NULL
> 87FQEZT1UEDXJHJQPFFX7G7ET8S2DVPM        2357378283356   121501191035580028      7326356
        NULL
> UBDTK8D9XUZ9GRZU8NZNXDEG73D4PCZG        2362223711289   161501191549050061      14837289
     NULL
> Y49EY895ACABHS95DRQEE8DVFEB8JSE1        2360853052224   111501191426280023      115883224
      NULL
> I found difference from log:
> In hive 1.1.0 
> DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string] separator=[[B@e50bca4]
nullstring=\N lastColumnTakesRest=false 
> In hive 0.10 
> DEBUG lazy.LazySimpleSerDe: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized
with: columnNames=[date_id, chanl_id, sessn_id, gu_id, prov_id, city_id, landing_page_type_id,
landing_track_time, landing_url, nav_refer_tracker_id, nav_refer_page_type_id, nav_refer_page_value,
nav_refer_link_position, nav_tracker_id, nav_page_categ_id, nav_page_type_id, nav_page_value,
nav_srce_type, internal_keyword, internal_result_sum, pltfm_id, app_vers, nav_link_position,
nav_button_position, nav_track_time, nav_next_tracker_id, sessn_last_time, sessn_pv, detl_tracker_id,
detl_page_type_id, detl_page_value, detl_pm_id, detl_link_position, detl_position_track_id,
cart_tracker_id, cart_page_type_id, cart_page_value, cart_link_postion, cart_button_position,
cart_position_track_id, cart_prod_id, ordr_tracker_id, ordr_page_type_id, ordr_code, updt_time,
cart_pm_id, brand_code, categ_type, os, end_user_id, add_cart_flag, navgation_page_flag, nav_page_url,
detl_button_position, manul_flag, manul_track_date, nav_refer_tpa, nav_refer_tpa_id, nav_refer_tpc,
nav_refer_tpi, nav_refer_tcs, nav_refer_tcsa, nav_refer_tcdt, nav_refer_tcd, nav_refer_tci,
nav_refer_postn_type, nav_tpa_id, nav_tpa, nav_tpc, nav_tpi, nav_tcs, nav_tcsa, nav_tcdt,
nav_tcd, nav_tci, nav_postn_type, detl_tpa_id, detl_tpa, detl_tpc, detl_tpi, detl_tcs, detl_tcsa,
detl_tcdt, detl_tcd, detl_tci, detl_postn_type, cart_tpa_id, cart_tpa, cart_tpc, cart_tpi,
cart_tcs, cart_tcsa, cart_tcdt, cart_tcd, cart_tci, cart_postn_type, sessn_chanl_id, gu_sec_flg,
detl_refer_page_type_id, detl_refer_page_value, detl_event_id, nav_refer_intrn_reslt_sum,
nav_intrn_reslt_sum, nav_refer_intrn_kw, nav_intrn_kw, detl_track_time, cart_track_time] columnTypes=[string,
bigint, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, int, string, string, string, string,
string, string, int, string, string, string, bigint, string, string, string, string, string,
string, string, string, bigint, string, string, string, string, bigint, string, int, string,
string, string, int, string, string, int, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, string,
string, string, string, string, string, string, string, string, string, string, string, bigint,
bigint, string, string, string, string, string, string, string, string, string] separator=[[B@116265c3]
nullstring=\N lastColumnTakesRest=false 
> You see hive 1.1.0 lost some column info. Why?   BTW, My meta database schema is hive
0.10 not update to hive 1.1.0.
> When I start hive 0.10 meta store and hive 1.1.0 remote connect it.Hive 1.1.0 return
right result.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message