Return-Path: X-Original-To: apmail-incubator-sqoop-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-sqoop-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DCABE9DED for ; Mon, 12 Mar 2012 20:08:19 +0000 (UTC) Received: (qmail 89135 invoked by uid 500); 12 Mar 2012 20:08:19 -0000 Delivered-To: apmail-incubator-sqoop-dev-archive@incubator.apache.org Received: (qmail 89060 invoked by uid 500); 12 Mar 2012 20:08:19 -0000 Mailing-List: contact sqoop-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: sqoop-dev@incubator.apache.org Delivered-To: mailing list sqoop-dev@incubator.apache.org Received: (qmail 89042 invoked by uid 99); 12 Mar 2012 20:08:19 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Mar 2012 20:08:19 +0000 Received: from localhost (HELO mail-we0-f175.google.com) (127.0.0.1) (smtp-auth username kathleen, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Mar 2012 20:08:19 +0000 Received: by wera1 with SMTP id a1so3684025wer.6 for ; Mon, 12 Mar 2012 13:08:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.14.73 with SMTP id n9mr860927wic.16.1331582896695; Mon, 12 Mar 2012 13:08:16 -0700 (PDT) Received: by 10.216.226.100 with HTTP; Mon, 12 Mar 2012 13:08:16 -0700 (PDT) In-Reply-To: References: <20120301072739.GH20278@garfield> <20120301091731.GN20278@garfield> Date: Mon, 12 Mar 2012 13:08:16 -0700 Message-ID: Subject: Re: problems importing from oracle\ From: Kathleen Ting To: sqoop-dev@incubator.apache.org Cc: sqoop-user@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d04138cbb8bea0e04bb114d69 --f46d04138cbb8bea0e04bb114d69 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Bruce, FYI, this issue is now documented in the Sqoop Troubleshooting Guide: https://issues.apache.org/jira/browse/SQOOP-461 Regards, Kathleen On Wed, Mar 7, 2012 at 4:28 PM, Arvind Prabhakar wrote: > Hi Bruce, > > On Mon, Mar 5, 2012 at 6:50 PM, Bruce Bian wrote: > > any feedback on this?Shall I create a jira issue on this? > > > > > > On Thu, Mar 1, 2012 at 11:12 PM, Bruce Bian > wrote: > >> > >> Hi Jarcec, > >> After looking at the code of sqoop, my previous split-by problem is > caused > >> by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command= , > and > >> the following code in org.apache.sqoop.manager.DefaultManagerFactory > >> initialized a GenericJdbcManager instead of OracleManager even after > >> --connection-manager OracleManager is specified > >> > >> SqoopOptions options =3D data.getSqoopOptions(); > >> String manualDriver =3D options.getDriverClassName(); > >> if (manualDriver !=3D null) { > >> // User has manually specified JDBC implementation with --driver= . > >> // Just use GenericJdbcManager. > >> return new GenericJdbcManager(manualDriver, options); > >> } > >> Any reason why the code above appears before initializing the connecti= on > >> manager specified by the user?Shouldn't it be put even after the > connection > >> scheme is judged? > > This is by design of the current implementation. When you specify an > explicit driver, the builtin connection manager selection defaults to > the generic connection manager. This allows you to use Sqoop with > databases that have compliant JDBC drivers but are not directly > supported by Sqoop. > > Is there any particular reason why you must specify the --driver > option? By default the built in Oracle connection manager will chose > the very driver you are trying to pass in. > > Thanks, > Arvind > > > >> > >> > >> On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho > >> wrote: > >>> > >>> Ignored :-) > >>> > >>> I do not believe that you're hitting exactly SQOOP-204. It seems that > >>> SQOOP-204 has failed during creating Input Splits for your job. But > you seem > >>> to be dying after your job is being executed on hadoop cluster. > >>> > >>> I'm afraid that I do not know how to help you at the moment. Would yo= u > >>> mind upgrading on current 1.4.1 version? > >>> > >>> Jarcec > >>> > >>> On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote: > >>> > Hi Jarek , > >>> > Please ignore my first problem for getting no hdfs results as it > turns > >>> > out > >>> > to be my silly mistake during copying of the query. sorry for the > >>> > annoyance. > >>> > The second problem of adding --split-by turns out to be SQOOP-204, > but > >>> > it > >>> > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is > it? > >>> > > >>> > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian > >>> > wrote: > >>> > > >>> > > also when I'm adding the --split-by a.prod_inst_id to the sqoop > >>> > > command as > >>> > > in: > >>> > > QUERY=3D"SELECT a.*, > >>> > > > >>> > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > > c.cust_code,c.root_cust_code, > >>> > > > >>> > > > >>> > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > > FROM prc_idap_pi_root a > >>> > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > >>> > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > >>> > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > > etl.etl_para_cfg_detail > >>> > > WHERE para_id=3D84) AND \$CONDITIONS" > >>> > > sqoop import \ > >>> > > --verbose \ > >>> > > --driver oracle.jdbc.OracleDriver \ > >>> > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \ > >>> > > --username *** \ > >>> > > --password ****** \ > >>> > > --query "$QUERY" \ > >>> > > --split-by a.prod_inst_id \ > >>> > > --target-dir /home/wbian/test > >>> > > > >>> > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not > >>> > > properly > >>> > > ended" Exception is threw. > >>> > > And I'm testing this sqoop command on a stand-alone hadoop node. > >>> > > The output when adding the split-by is as follows: > >>> > > > >>> > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging= . > >>> > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password = on > >>> > > the > >>> > > command-line is insecure. Consider using -P instead. > >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory= : > >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory > >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory: > >>> > > com.cloudera.sqoop.manager.DefaultManagerFactory > >>> > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSiz= e > of > >>> > > 1000 > >>> > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManag= er > >>> > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1 > >>> > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generatio= n > >>> > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection > paramenters > >>> > > specified. Using regular API for making connection. > >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for > next > >>> > > query: 1000 > >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statemen= t: > >>> > > SELECT > >>> > > a.*, > >>> > > > >>> > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > > c.cust_code,c.root_cust_code, > >>> > > > >>> > > > >>> > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > > FROM prc_idap_pi_root a > >>> > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > >>> > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > >>> > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > > etl.etl_para_cfg_detail > >>> > > WHERE para_id=3D84) AND (1 =3D 0) > >>> > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for > next > >>> > > query: 1000 > >>> > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statemen= t: > >>> > > SELECT > >>> > > a.*, > >>> > > > >>> > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > > c.cust_code,c.root_cust_code, > >>> > > > >>> > > > >>> > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > > FROM prc_idap_pi_root a > >>> > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > >>> > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > >>> > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > > etl.etl_para_cfg_detail > >>> > > WHERE para_id=3D84) AND (1 =3D 0) > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns: > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_INST_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CRM_ASSET_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INTEGRATION_CD > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_CD > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_CODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PREPAY_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STOP_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UNINSTALL_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_ASSET_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_PROD_INST_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_ASSET_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_PROD_INST_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: COMP_PAR_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CENTREX_SUB_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_ACCESS_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_MONTHLY_HOURS > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_INSTALL_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_INSTALL_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_WATCH_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_PHONE_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_SPEED_RATE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_BUREAU_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_BUREAU_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_INTERNET_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ITEM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_GROUP_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_START_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_END_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONTINUE_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_YEAR_PAY_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ITEM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_START_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_END_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_POSTCODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_AREA_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_CD > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_001_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_002_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_003_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_004_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_005_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_006_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_007_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_008_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_009_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_010_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_011_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_012_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_013_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_014_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_015_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_016_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_017_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_018_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_019_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_020_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_021_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_022_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_023_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_024_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_025_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_026_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_027_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_028_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_029_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_030_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_031_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_032_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_033_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_034_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_035_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_036_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_037_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_038_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_039_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_040_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_TELEPHONE_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_UN_ACTIVE_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_ACTIVE_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PAY_CUST_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OWN_CUST_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USE_CUST_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_041_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_042_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: FREE_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_043_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: QUERY_PHONE_NUMBER_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_TMP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_BY > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_TMP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_BY > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUSI_KEY > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SRC_SYS > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_SUB_STAT_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_PACK_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEW_CUST_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_SEG_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UIM_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IMSI > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_START_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_END_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_EXP_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: VPN_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_BUREAU_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_GROUP_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_PROM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUILDING_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IVPN_NUM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID_CRM > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USER_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADD_GROUP_IID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_PROD_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACT_OP_RATE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_CD > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_UP_RATE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_DOWN_RAT= E > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_A > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_B > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_BUSI_TYPE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ATTR_USE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_163_ONLINENET > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ISP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_SPEED_RATE_AVL > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: RESTRICT_CHURN_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OPEN_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_ACTION_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONT_SYSAUTO_FLG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GUANGWANG_FLAG > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IPTV_PROM_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MOBILE_TERM_TYPE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_INTG_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_INTG_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: > SALE_POLICY_CONST_START_DT > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_NO > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADDR_ID > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: POSTCODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_RMND_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PRINT_TP > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MEDIA_TYPE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_CODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ROOT_CUST_CODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MDF_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_BUREAU_CODE > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_CD > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADM_SUB_BUREAU_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_NAME > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file: > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12= , > >>> > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:1= 2, > >>> > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12= , > >>> > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12, > >>> > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, > >>> > > CARRIER_PROD_INST_NUM:12, > >>> > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12, > >>> > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, > >>> > > GH_INSTALL_TP:12, > >>> > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, > DATA_PORTA_NUM:12, > >>> > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12, > >>> > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, > >>> > > DATA_INTERNET_FLG:12, > >>> > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12, > >>> > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12, > >>> > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, > >>> > > SUB_AGR_ID:2, > >>> > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, > >>> > > AGR_END_DT:93, > >>> > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, > >>> > > DEV_GRID_ID:2, > >>> > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12, > >>> > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1, > >>> > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1, > >>> > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1, > >>> > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1, > >>> > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1, > >>> > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1, > >>> > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1, > >>> > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1, > >>> > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1, > >>> > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1, > >>> > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12, > >>> > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12, > >>> > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12, > >>> > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, > >>> > > CREATE_BY:12, > >>> > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, > >>> > > PI_SUB_STAT_TP:12, > >>> > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, > IMSI:12, > >>> > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93, > >>> > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12, > >>> > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2, > >>> > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12, > >>> > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12= , > >>> > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, > >>> > > A_ACCESS_MODE:12, > >>> > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, > >>> > > A_ATTR_USE:12, > >>> > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12, > >>> > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:9= 3, > >>> > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12, > >>> > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12, > >>> > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12, > >>> > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12, > >>> > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:1= 2, > >>> > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12, > >>> > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12, > >>> > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12, > >>> > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is > >>> > > QueryResult.java > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing > >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is > >>> > > /usr/lib/hadoop > >>> > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core > jar > >>> > > at: > >>> > > /usr/lib/hadoop/hadoop-core.jar > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source fil= e: > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac wi= th > >>> > > args: > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -sourcepath > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -d > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -classpath > >>> > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > >>> > > > >>> > > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:= /usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contri= b-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/asp= ectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop= /lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/us= r/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-= 3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib= /commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/u= sr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0= .20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib= /jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.ja= r:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper= -runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/li= b/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr= /lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/= usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib= /hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr= /lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.= jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4= j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop= /lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoo= p/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/e= tc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.j= ar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/ho= me/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3= .0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/= ../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/comm= ons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/h= ome/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-c= dh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop= -1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0= -cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh= 3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../li= b/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbi= an/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-= cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/j= ava/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../h= base-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/u= sr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.= 1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/co= mmons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/= hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpc= lient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase= /bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net= -1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../l= ib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/b= in/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-as= l-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbas= e/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson= -xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib= /hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-= api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/b= in/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar= :/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/= jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/= bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1= .0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/..= /lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/= lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1= .2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/= bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api= -2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/.= ./lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:= /usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc= -0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-c= dh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../s= qoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqo= op-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > >>> > > Note: > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > >>> > > uses or overrides a deprecated API. > >>> > > Note: Recompile with -Xlint:deprecation for details. > >>> > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file: > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .cla= ss > >>> > > files > >>> > > in directory: > >>> > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae > >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile: > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.cla= ss > >>> > > -> QueryResult.class > >>> > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing > jar > >>> > > file > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > >>> > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query > >>> > > import. > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for > existing > >>> > > class: QueryResult > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load > jar > >>> > > through URL: > >>> > > > >>> > > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/Quer= yResult.jar!/ > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classload= er > >>> > > is > >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in > jar: > >>> > > QueryResult > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into > >>> > > current > >>> > > JVM: > >>> > > > >>> > > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/Quer= yResult.jar!/ > >>> > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader > for > >>> > > jar > >>> > > > >>> > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar= : > >>> > > java.net.FactoryURLClassLoader@1638fff7 > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using tabl= e > >>> > > class: > >>> > > QueryResult > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using > >>> > > InputFormat: > >>> > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.ja= r > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.ja= r > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > > >>> > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPS= HOT.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > >>> > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpat= h: > >>> > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > >>> > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics > with > >>> > > processName=3DJobTracker, sessionId=3D > >>> > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load > >>> > > native-hadoop > >>> > > library for your platform... using builtin-java classes where > >>> > > applicable > >>> > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: > job_local_0001 > >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db > >>> > > record > >>> > > reader for db product: ORACLE > >>> > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: > >>> > > SELECT > >>> > > a.*, > >>> > > > >>> > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > > c.cust_code,c.root_cust_code, > >>> > > > >>> > > > >>> > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > > FROM prc_idap_pi_root a > >>> > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > >>> > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > >>> > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > > etl.etl_para_cfg_detail > >>> > > WHERE para_id=3D84) AND ( 1=3D1 ) AND ( 1=3D1 ) > >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for ne= xt > >>> > > query: > >>> > > 1000 > >>> > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELEC= T > >>> > > a.*, > >>> > > > >>> > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > > c.cust_code,c.root_cust_code, > >>> > > > >>> > > > >>> > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > > FROM prc_idap_pi_root a > >>> > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > >>> > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > >>> > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > > etl.etl_para_cfg_detail > >>> > > WHERE para_id=3D84) AND ( 1=3D1 ) AND ( 1=3D1 ) > >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing > >>> > > auto-progress thread to quit. > >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for > >>> > > progress > >>> > > thread shutdown... > >>> > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progres= s > >>> > > thread > >>> > > is finished. keepGoing=3Dfalse > >>> > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress > thread > >>> > > shutdown detected. > >>> > > 12/03/01 15:24:32 INFO mapred.Task: > >>> > > Task:attempt_local_0001_m_000000_0 is > >>> > > done. And is in the process of commiting > >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task > >>> > > attempt_local_0001_m_000000_0 is > >>> > > allowed to commit now > >>> > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output o= f > >>> > > task > >>> > > 'attempt_local_0001_m_000000_0' to /home/wbian/test > >>> > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > >>> > > 12/03/01 15:24:32 INFO mapred.Task: Task > >>> > > 'attempt_local_0001_m_000000_0' > >>> > > done. > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1= 151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2= -SNAPSHOT.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.ja= r > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1= 151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_115= 3766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_115= 3759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151= 913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > >>> > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > >>> > > Deleted > >>> > > path > >>> > > > >>> > > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: map 100% reduce 0% > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: > job_local_0001 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: FileSystemCounters > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: FILE_BYTES_READ=3D37= 482 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: > FILE_BYTES_WRITTEN=3D96083 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Map-Reduce Framework > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Map input records=3D= 0 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Spilled Records=3D0 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: SPLIT_RAW_BYTES=3D87 > >>> > > 12/03/01 15:24:33 INFO mapred.JobClient: Map output records= =3D0 > >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 byt= es > >>> > > in > >>> > > 2.9865 seconds (0 bytes/sec) > >>> > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 > records. > >>> > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring > classloader: > >>> > > sun.misc.Launcher$AppClassLoader@28df6ccd > >>> > > > >>> > > Thanks&Regards, > >>> > > Bruce > >>> > > > >>> > > > >>> > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho > >>> > > wrote: > >>> > > > >>> > >> Hi Bruce, > >>> > >> would you mind sending entire sqoop command that you've used as > well > >>> > >> as > >>> > >> entire output that it generates with "--verbose" flag? > >>> > >> > >>> > >> Jarcec > >>> > >> > >>> > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote: > >>> > >> > Hi there, > >>> > >> > When I'm using sqoop free-form query import to import the data > >>> > >> > from > >>> > >> Oracle > >>> > >> > to HDFS with some ETL process in the query, the results in HDF= S > >>> > >> > contains > >>> > >> > nothing. > >>> > >> > The query is as follows: > >>> > >> > > >>> > >> > SELECT a.*, > >>> > >> > > >>> > >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > >>> > >> > c.cust_code,c.root_cust_code, > >>> > >> > > >>> > >> > >>> > >> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > >>> > >> > FROM prc_idap_pi_root a > >>> > >> > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt= _id > >>> > >> > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust= _id > >>> > >> > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > >>> > >> > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > >>> > >> etl.etl_para_cfg_detail > >>> > >> > WHERE para_id=3D84) AND \$CONDITIONS > >>> > >> > > >>> > >> > The same query has been executed successfully in oracle(withou= t > >>> > >> > the > >>> > >> > $CONDITIONS of course). Is it because the query contains > sub-query > >>> > >> > in > >>> > >> it? > >>> > >> > > >>> > >> > Thanks&Regards, > >>> > >> > Bruce > >>> > >> > >>> > > > >>> > > > >> > >> > > > --f46d04138cbb8bea0e04bb114d69--