Return-Path: X-Original-To: apmail-incubator-sqoop-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-sqoop-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 231D8921F for ; Thu, 1 Mar 2012 15:17:08 +0000 (UTC) Received: (qmail 13599 invoked by uid 500); 1 Mar 2012 15:17:08 -0000 Delivered-To: apmail-incubator-sqoop-dev-archive@incubator.apache.org Received: (qmail 13572 invoked by uid 500); 1 Mar 2012 15:17:08 -0000 Mailing-List: contact sqoop-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: sqoop-dev@incubator.apache.org Delivered-To: mailing list sqoop-dev@incubator.apache.org Delivered-To: moderator for sqoop-dev@incubator.apache.org Received: (qmail 3120 invoked by uid 99); 1 Mar 2012 15:12:45 -0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of weidong.ban@gmail.com designates 209.85.214.175 as permitted sender) Received-SPF: pass (google.com: domain of weidong.ban@gmail.com designates 10.182.122.7 as permitted sender) client-ip=10.182.122.7; Authentication-Results: mr.google.com; spf=pass (google.com: domain of weidong.ban@gmail.com designates 10.182.122.7 as permitted sender) smtp.mail=weidong.ban@gmail.com; dkim=pass header.i=weidong.ban@gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=3vrBpqTmMRau9fOcyu4MkSNmluWRh6DiGx5aNSneiLg=; b=QDfLl0rIUbU7HtP12MTM+HEPFpO0caivBnpUBRKuSmmC2vFN9LWg8P/SJodbWojWoK VZB5Dt76BO69jXfeKmhNgET+vMUdM7hmVFoimy4goqPPAeZmj9irCn8PWRBUybJ+PIuU PlgLI8xbDmXdlikDTEopfCiOR8g/hcXlEJ0Rs= MIME-Version: 1.0 In-Reply-To: <20120301091731.GN20278@garfield> References: <20120301072739.GH20278@garfield> <20120301091731.GN20278@garfield> Date: Thu, 1 Mar 2012 23:12:17 +0800 Message-ID: Subject: Re: problems importing from oracle\ From: Bruce Bian To: sqoop-user@incubator.apache.org, sqoop-dev@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d0447f076c7c66204ba2fe20a X-Virus-Checked: Checked by ClamAV on apache.org --f46d0447f076c7c66204ba2fe20a Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Jarcec, After looking at the code of sqoop, my previous split-by problem is caused by stating '--driver "oracle.jdbc.OracleDriver" ' in the sqoop command, and the following code in org.apache.sqoop.manager.DefaultManagerFactory initialized a GenericJdbcManager instead of OracleManager even after --connection-manager OracleManager is specified SqoopOptions options =3D data.getSqoopOptions(); String manualDriver =3D options.getDriverClassName(); if (manualDriver !=3D null) { // User has manually specified JDBC implementation with --driver. // Just use GenericJdbcManager. return new GenericJdbcManager(manualDriver, options); } Any reason why the code above appears before initializing the connection manager specified by the user?Shouldn't it be put even after the connection scheme is judged? On Thu, Mar 1, 2012 at 5:17 PM, Jarek Jarcec Cecho wrote= : > Ignored :-) > > I do not believe that you're hitting exactly SQOOP-204. It seems that > SQOOP-204 has failed during creating Input Splits for your job. But you > seem to be dying after your job is being executed on hadoop cluster. > > I'm afraid that I do not know how to help you at the moment. Would you > mind upgrading on current 1.4.1 version? > > Jarcec > > On Thu, Mar 01, 2012 at 04:59:48PM +0800, Bruce Bian wrote: > > Hi Jarek , > > Please ignore my first problem for getting no hdfs results as it turns > out > > to be my silly mistake during copying of the query. sorry for the > annoyance. > > The second problem of adding --split-by turns out to be SQOOP-204, but = it > > should already be fixed in 1.3.0 while i'm using 1.3.0-cdh3u3 or is it? > > > > On Thu, Mar 1, 2012 at 4:10 PM, Bruce Bian > wrote: > > > > > also when I'm adding the --split-by a.prod_inst_id to the sqoop > command as > > > in: > > > QUERY=3D"SELECT a.*, > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type= , > > > c.cust_code,c.root_cust_code, > > > > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > > FROM prc_idap_pi_root a > > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > etl.etl_para_cfg_detail > > > WHERE para_id=3D84) AND \$CONDITIONS" > > > sqoop import \ > > > --verbose \ > > > --driver oracle.jdbc.OracleDriver \ > > > --connect jdbc:oracle:thin:@10.239.47.36:1521/dx \ > > > --username *** \ > > > --password ****** \ > > > --query "$QUERY" \ > > > --split-by a.prod_inst_id \ > > > --target-dir /home/wbian/test > > > > > > A "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not > properly > > > ended" Exception is threw. > > > And I'm testing this sqoop command on a stand-alone hadoop node. > > > The output when adding the split-by is as follows: > > > > > > 14/03/01 15:24:21 DEBUG tool.BaseSqoopTool: Enabled debug logging. > > > 12/03/01 15:24:21 WARN tool.BaseSqoopTool: Setting your password on t= he > > > command-line is insecure. Consider using -P instead. > > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Loaded manager factory: > > > com.cloudera.sqoop.manager.DefaultManagerFactory > > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Trying ManagerFactory: > > > com.cloudera.sqoop.manager.DefaultManagerFactory > > > 12/03/01 15:24:21 INFO manager.SqlManager: Using default fetchSize of > 1000 > > > 12/03/01 15:24:21 DEBUG sqoop.ConnFactory: Instantiated ConnManager > > > com.cloudera.sqoop.manager.GenericJdbcManager@423e5d1 > > > 12/03/01 15:24:21 INFO tool.CodeGenTool: Beginning code generation > > > 12/03/01 15:24:21 DEBUG manager.SqlManager: No connection paramenters > > > specified. Using regular API for making connection. > > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next > > > query: 1000 > > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: > SELECT > > > a.*, > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type= , > > > c.cust_code,c.root_cust_code, > > > > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > > FROM prc_idap_pi_root a > > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > etl.etl_para_cfg_detail > > > WHERE para_id=3D84) AND (1 =3D 0) > > > 12/03/01 15:24:28 DEBUG manager.SqlManager: Using fetchSize for next > > > query: 1000 > > > 12/03/01 15:24:28 INFO manager.SqlManager: Executing SQL statement: > SELECT > > > a.*, > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type= , > > > c.cust_code,c.root_cust_code, > > > > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > > FROM prc_idap_pi_root a > > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > etl.etl_para_cfg_detail > > > WHERE para_id=3D84) AND (1 =3D 0) > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: selected columns: > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_INST_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CRM_ASSET_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INTEGRATION_CD > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_CD > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STD_PRD_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROD_SPEC_CODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PREPAY_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: STOP_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UNINSTALL_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_ASSET_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BILL_PROD_INST_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_ASSET_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CARRIER_PROD_INST_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: COMP_PAR_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CENTREX_SUB_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_ACCESS_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_MONTHLY_HOURS > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_INSTALL_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_INSTALL_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_WATCH_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_PHONE_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_SPEED_RATE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_BUREAU_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_BUREAU_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_INTERNET_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ITEM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_GROUP_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_START_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_END_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONTINUE_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_YEAR_PAY_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ITEM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEXT_PROM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_AGR_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_START_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGR_END_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: INSTALL_ADDR_POSTCODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_AREA_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_BUREAU_CD > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: AGENT_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_001_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_002_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_003_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_004_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_005_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_006_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_007_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_008_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_009_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_010_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_011_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_012_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_013_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_014_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_015_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_016_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_017_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_018_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_019_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_020_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_021_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_022_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_023_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_024_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_025_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_026_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_027_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_028_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_029_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_030_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_031_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_032_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_033_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_034_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_035_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_036_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_037_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_038_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_039_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_040_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GH_TELEPHONE_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_UN_ACTIVE_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_ACTIVE_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PAY_CUST_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OWN_CUST_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USE_CUST_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_STAT_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_041_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_042_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: FREE_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SERV_043_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: QUERY_PHONE_NUMBER_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_TMP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CREATE_BY > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_TMP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: LST_UPD_BY > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUSI_KEY > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SRC_SYS > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PI_SUB_STAT_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_PACK_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: NEW_CUST_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_SEG_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: UIM_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IMSI > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_START_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_END_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_EXP_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: VPN_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_BUREAU_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_GROUP_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: EJ_T_PROM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUILDING_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IVPN_NUM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_ID_CRM > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: USER_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADD_GROUP_IID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CDMA_PROD_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACT_OP_RATE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DEV_GRID_CD > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_UP_RATE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_EXPERIENCE_DOWN_RATE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_A > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_MODE_B > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_BUSI_TYPE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ATTR_USE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_163_ONLINENET > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ISP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: WB_SPEED_RATE_AVL > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: RESTRICT_CHURN_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PHS_SERIES_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: OPEN_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CHURN_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_ACTION_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: A_ACCESS_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_CONT_SYSAUTO_FLG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: GUANGWANG_FLAG > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: IPTV_PROM_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTA_ADDR > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: DATA_PORTB_ADDR > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MOBILE_TERM_TYPE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PROM_INTG_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_INTG_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SALE_POLICY_CONST_START_DT > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_NO > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADDR_ID > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: POSTCODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ACNT_RMND_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: PRINT_TP > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MEDIA_TYPE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: CUST_CODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ROOT_CUST_CODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: MDF_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: SUB_BUREAU_CODE > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_CD > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: ADM_SUB_BUREAU_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: BUREAU_NAME > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Writing source file: > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Table name: null > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: Columns: PROD_INST_ID:12, > > > CRM_ASSET_ID:12, INTEGRATION_CD:12, PI_STAT_NAME:12, STD_PRD_CD:12, > > > STD_PRD_NAME:12, PROD_SPEC_ID:2, PROD_SPEC_CODE:12, PREPAY_FLG:12, > > > INSTALL_DT:93, STOP_DT:93, UNINSTALL_DT:93, BILL_ASSET_IID:12, > > > BILL_PROD_INST_NUM:12, CARRIER_ASSET_IID:12, CARRIER_PROD_INST_NUM:12= , > > > COMP_PAR_IID:12, CENTREX_SUB_NUM:12, CUST_ID:12, ACNT_ID:12, > > > WB_ACCESS_TP:12, WB_MONTHLY_HOURS:12, WB_INSTALL_TP:12, > GH_INSTALL_TP:12, > > > GH_WATCH_TP:12, GH_PHONE_TP:12, DATA_PORTA_IID:12, DATA_PORTA_NUM:12, > > > DATA_PORTB_IID:12, DATA_PORTB_NUM:12, DATA_SPEED_RATE:12, > > > DATA_PORTA_BUREAU_NAME:12, DATA_PORTB_BUREAU_NAME:12, > DATA_INTERNET_FLG:12, > > > PROM_ITEM_ID:2, PROM_ID:2, PROM_GROUP_IID:12, PROM_NUM:12, > > > PROM_START_DT:93, PROM_END_DT:93, PROM_CONTINUE_FLG:12, > > > PROM_YEAR_PAY_FLG:12, NEXT_PROM_ITEM_ID:2, NEXT_PROM_ID:2, > SUB_AGR_ID:2, > > > AGR_ID:2, AGR_NAME:12, SUB_AGR_NAME:12, AGR_START_DT:93, AGR_END_DT:9= 3, > > > INSTALL_ADDR_ID:12, INSTALL_ADDR_POSTCODE:12, DEV_AREA_ID:2, > DEV_GRID_ID:2, > > > DEV_BUREAU_NAME:12, DEV_BUREAU_CD:12, AGENT_ID:2, AGENT_NAME:12, > > > SERV_001_FLG:1, SERV_002_FLG:1, SERV_003_FLG:1, SERV_004_FLG:1, > > > SERV_005_FLG:1, SERV_006_FLG:1, SERV_007_FLG:1, SERV_008_FLG:1, > > > SERV_009_FLG:1, SERV_010_FLG:1, SERV_011_FLG:1, SERV_012_FLG:1, > > > SERV_013_FLG:1, SERV_014_FLG:1, SERV_015_FLG:1, SERV_016_FLG:1, > > > SERV_017_FLG:1, SERV_018_FLG:1, SERV_019_FLG:1, SERV_020_FLG:1, > > > SERV_021_FLG:1, SERV_022_FLG:1, SERV_023_FLG:1, SERV_024_FLG:1, > > > SERV_025_FLG:1, SERV_026_FLG:1, SERV_027_FLG:1, SERV_028_FLG:1, > > > SERV_029_FLG:1, SERV_030_FLG:1, SERV_031_FLG:1, SERV_032_FLG:1, > > > SERV_033_FLG:1, SERV_034_FLG:1, SERV_035_FLG:1, SERV_036_FLG:1, > > > SERV_037_FLG:1, SERV_038_FLG:1, SERV_039_FLG:1, SERV_040_FLG:1, > > > PHS_SERIES_TP:12, GH_TELEPHONE_TP:12, DEV_UN_ACTIVE_FLG:12, > > > DEV_ACTIVE_DT:93, PAY_CUST_ID:12, OWN_CUST_ID:12, USE_CUST_ID:12, > > > PI_STAT_TP:12, SERV_041_FLG:12, SERV_042_FLG:12, FREE_TP:12, > > > SERV_043_FLG:12, QUERY_PHONE_NUMBER_TP:12, CREATE_TMP:93, CREATE_BY:1= 2, > > > LST_UPD_TMP:93, LST_UPD_BY:12, BUSI_KEY:12, SRC_SYS:12, > PI_SUB_STAT_TP:12, > > > PROM_PACK_TP:12, NEW_CUST_TP:12, CDMA_SEG_TP:12, UIM_NUM:12, IMSI:12, > > > SALE_POLICY_ID:2, SALE_POLICY_NUM:12, SALE_POLICY_START_DT:93, > > > SALE_POLICY_END_DT:93, SALE_POLICY_EXP_DT:93, SALE_POLICY_FLG:12, > > > VPN_NUM:12, SALE_BUREAU_ID:2, EJ_T_GROUP_IID:12, EJ_T_PROM_ID:2, > > > BUILDING_ID:2, IVPN_NUM:12, DEV_GRID_ID_CRM:12, USER_ID:12, > > > ADD_GROUP_IID:12, CDMA_PROD_TP:12, ACT_OP_RATE:12, DEV_GRID_CD:12, > > > WB_EXPERIENCE_UP_RATE:12, WB_EXPERIENCE_DOWN_RATE:12, A_ACCESS_MODE:1= 2, > > > A_ACCESS_MODE_A:12, A_ACCESS_MODE_B:12, A_BUSI_TYPE:12, A_ATTR_USE:12= , > > > A_163_ONLINENET:12, A_ISP:12, WB_SPEED_RATE_AVL:12, CHURN_FLG:12, > > > RESTRICT_CHURN_FLG:12, PHS_SERIES_NAME:12, OPEN_DT:93, CHURN_DT:93, > > > SUB_ACTION_TP:12, A_ACCESS_TP:12, PROM_CONT_SYSAUTO_FLG:12, > > > GUANGWANG_FLAG:12, IPTV_PROM_ID:2, DATA_PORTA_ADDR_ID:12, > > > DATA_PORTB_ADDR_ID:12, DATA_PORTA_ADDR:12, DATA_PORTB_ADDR:12, > > > MOBILE_TERM_TYPE:12, PROM_INTG_ID:12, SALE_POLICY_INTG_ID:12, > > > SALE_POLICY_CONST_START_DT:93, ACNT_NO:12, ADDR_ID:12, POSTCODE:12, > > > ACNT_RMND_TP:12, PRINT_TP:12, MEDIA_TYPE:12, CUST_CODE:12, > > > ROOT_CUST_CODE:12, MDF_NAME:12, SUB_BUREAU_CODE:12, BUREAU_CD:12, > > > ADM_SUB_BUREAU_NAME:12, BUREAU_NAME:12, > > > 12/03/01 15:24:28 DEBUG orm.ClassWriter: sourceFilename is > QueryResult.java > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Found existing > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > > 12/03/01 15:24:28 INFO orm.CompilationManager: HADOOP_HOME is > > > /usr/lib/hadoop > > > 12/03/01 15:24:28 INFO orm.CompilationManager: Found hadoop core jar > at: > > > /usr/lib/hadoop/hadoop-core.jar > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Adding source file: > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: Invoking javac with > args: > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -sourcepath > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -d > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/ > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: -classpath > > > 12/03/01 15:24:28 DEBUG orm.CompilationManager: > > > > /usr/lib/hadoop/conf:/usr/java/jdk1.6.0_16/lib/tools.jar:/usr/lib/hadoop:= /usr/lib/hadoop/hadoop-core-0.20.2-Intel.jar:/usr/lib/hadoop/lib/ant-contri= b-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/asp= ectjtools-1.6.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop= /lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/us= r/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-= 3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib= /commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/u= sr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0= .20.2-Intel.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib= /jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.ja= r:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper= -runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/li= b/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr= /lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/= usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib= /hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr= /lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.= jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4= j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop= /lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoo= p/lib/jsp-2.1/jsp-api-2.1.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../conf:/e= tc/zookeeper::/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-contrib-1.0b3.j= ar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/ant-eclipse-1.0-jvm1.2.jar:/ho= me/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/avro-1.5.4.jar:/home/wbian/sqoop-1.3= .0-cdh3u3/bin/../lib/avro-ipc-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/= ../lib/avro-mapred-1.5.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/comm= ons-io-1.4.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derbyclient.jar:/h= ome/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/derby.jar:/home/wbian/sqoop-1.3.0-c= dh3u3/bin/../lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/home/wbian/sqoop= -1.3.0-cdh3u3/bin/../lib/jackson-core-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0= -cdh3u3/bin/../lib/jackson-mapper-asl-1.7.3.jar:/home/wbian/sqoop-1.3.0-cdh= 3u3/bin/../lib/jopt-simple-3.2.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../li= b/ojdbc6.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../lib/oracle.jar:/home/wbi= an/sqoop-1.3.0-cdh3u3/bin/../lib/paranamer-2.3.jar:/home/wbian/sqoop-1.3.0-= cdh3u3/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../conf:/usr/j= ava/jdk1.6.0_16/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../h= base-0.90.1-Intel.jar:/usr/lib/hbase/bin/../hbase-0.90.1-Intel-tests.jar:/u= sr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.= 1.jar:/usr/lib/hbase/bin/../lib/avro-1.3.3.jar:/usr/lib/hbase/bin/../lib/co= mmons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/= hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpc= lient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase= /bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net= -1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../l= ib/guava-r06.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/b= in/../lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/bin/../lib/jackson-core-as= l-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbas= e/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson= -xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib= /hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-= api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/b= in/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar= :/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/= jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/= bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1= .0.3.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/..= /lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/= lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1= .2.16.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/= bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api= -2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/.= ./lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:= /usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/xmlenc= -0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/home/wbian/sqoop-1.3.0-c= dh3u3/bin/../sqoop-1.3.0-cdh3u3.jar:/home/wbian/sqoop-1.3.0-cdh3u3/bin/../s= qoop-test-1.3.0-cdh3u3.jar::/usr/lib/hadoop/hadoop-core.jar:/home/wbian/sqo= op-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > > Note: > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jav= a > > > uses or overrides a deprecated API. > > > Note: Recompile with -Xlint:deprecation for details. > > > 12/03/01 15:24:30 INFO orm.CompilationManager: Writing jar file: > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Scanning for .class > files > > > in directory: /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ce= ae > > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Got classfile: > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.cla= ss > > > -> QueryResult.class > > > 12/03/01 15:24:30 DEBUG orm.CompilationManager: Finished writing jar > file > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar > > > 12/03/01 15:24:30 INFO mapreduce.ImportJobBase: Beginning query impor= t. > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Checking for existing > > > class: QueryResult > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Attempting to load jar > > > through URL: > > > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/Quer= yResult.jar!/ > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Previous classloader i= s > > > sun.misc.Launcher$AppClassLoader@28df6ccd > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Testing class in jar: > > > QueryResult > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Loaded jar into curren= t > > > JVM: > > > > jar:file:///tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/Quer= yResult.jar!/ > > > 12/03/01 15:24:30 DEBUG util.ClassLoaderStack: Added classloader for > jar > > > > /tmp/sqoop-wbian/compile/d69e1619e55d0b073e22148d2df3ceae/QueryResult.jar= : > > > java.net.FactoryURLClassLoader@1638fff7 > > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using table > class: > > > QueryResult > > > 12/03/01 15:24:30 DEBUG mapreduce.DataDrivenImportJob: Using > InputFormat: > > > class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPS= HOT.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > > 12/03/01 15:24:30 DEBUG mapreduce.JobBase: Adding to job classpath: > > > file:/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > > > 12/03/01 15:24:30 INFO jvm.JvmMetrics: Initializing JVM Metrics with > > > processName=3DJobTracker, sessionId=3D > > > 12/03/01 15:24:30 WARN util.NativeCodeLoader: Unable to load > native-hadoop > > > library for your platform... using builtin-java classes where > applicable > > > 12/03/01 15:24:32 INFO mapred.JobClient: Running job: job_local_0001 > > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBInputFormat: Creating db recor= d > > > reader for db product: ORACLE > > > 12/03/01 15:24:32 DEBUG db.DataDrivenDBRecordReader: Using query: > SELECT > > > a.*, > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type= , > > > c.cust_code,c.root_cust_code, > > > > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > > FROM prc_idap_pi_root a > > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > etl.etl_para_cfg_detail > > > WHERE para_id=3D84) AND ( 1=3D1 ) AND ( 1=3D1 ) > > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Using fetchSize for next > query: > > > 1000 > > > 12/03/01 15:24:32 DEBUG db.DBRecordReader: Executing query: SELECT a.= *, > > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type= , > > > c.cust_code,c.root_cust_code, > > > > > > > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > > FROM prc_idap_pi_root a > > > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > etl.etl_para_cfg_detail > > > WHERE para_id=3D84) AND ( 1=3D1 ) AND ( 1=3D1 ) > > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Instructing > > > auto-progress thread to quit. > > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Waiting for > progress > > > thread shutdown... > > > 12/03/01 15:24:32 INFO mapreduce.AutoProgressMapper: Auto-progress > thread > > > is finished. keepGoing=3Dfalse > > > 12/03/01 15:24:32 DEBUG mapreduce.AutoProgressMapper: Progress thread > > > shutdown detected. > > > 12/03/01 15:24:32 INFO mapred.Task: Task:attempt_local_0001_m_000000_= 0 > is > > > done. And is in the process of commiting > > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > > > 12/03/01 15:24:32 INFO mapred.Task: Task attempt_local_0001_m_000000_= 0 > is > > > allowed to commit now > > > 12/03/01 15:24:32 INFO output.FileOutputCommitter: Saved output of ta= sk > > > 'attempt_local_0001_m_000000_0' to /home/wbian/test > > > 12/03/01 15:24:32 INFO mapred.LocalJobRunner: > > > 12/03/01 15:24:32 INFO mapred.Task: Task > 'attempt_local_0001_m_000000_0' > > > done. > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/573859330429113506_-1741598591_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-contrib-1.0b3.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/7638642621870028960_1049414085_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ant-eclipse-1.0-jvm1.2.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-8152943147738094801_962253230_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-1.5.4.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-4368993633898241236_1559298493_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-ipc-1.5.4.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/7339987112512937738_-1010335816_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/avro-mapred-1.5.4.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-6476952833578206474_381889696_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/commons-io-1.4.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/1044298657100329825_1467901247_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derby.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-2402003238185189826_-2100651766_1= 151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/derbyclient.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/2842797906428461850_-1239712881_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/hadoop-mrunit-0.20.2-CDH3b2= -SNAPSHOT.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/1877064831516271848_1716417027_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-core-asl-1.7.3.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/5906744787138366780_-1438185435_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jackson-mapper-asl-1.7.3.ja= r > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-3660896496909662405_-1849142665_1= 151913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/jopt-simple-3.2.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/6118620539126689785_1602440855_115= 3766507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/ojdbc6.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/-2434588653966011561_282814857_115= 3759507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/oracle.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/5859146340912417970_393723048_1151= 913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/paranamer-2.3.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/2631295317687370421_1240946466_115= 1913507/file/home/wbian/sqoop-1.3.0-cdh3u3/lib/snappy-java-1.0.3.2.jar > > > 12/03/01 15:24:32 INFO filecache.TrackerDistributedCacheManager: > Deleted > > > path > > > > /tmp/hadoop-wbian/mapred/local/archive/2514285904835319411_-1302817669_11= 51913507/file/home/wbian/sqoop-1.3.0-cdh3u3/sqoop-1.3.0-cdh3u3.jar > > > 12/03/01 15:24:33 INFO mapred.JobClient: map 100% reduce 0% > > > 12/03/01 15:24:33 INFO mapred.JobClient: Job complete: job_local_0001 > > > 12/03/01 15:24:33 INFO mapred.JobClient: Counters: 6 > > > 12/03/01 15:24:33 INFO mapred.JobClient: FileSystemCounters > > > 12/03/01 15:24:33 INFO mapred.JobClient: FILE_BYTES_READ=3D37482 > > > 12/03/01 15:24:33 INFO mapred.JobClient: FILE_BYTES_WRITTEN=3D960= 83 > > > 12/03/01 15:24:33 INFO mapred.JobClient: Map-Reduce Framework > > > 12/03/01 15:24:33 INFO mapred.JobClient: Map input records=3D0 > > > 12/03/01 15:24:33 INFO mapred.JobClient: Spilled Records=3D0 > > > 12/03/01 15:24:33 INFO mapred.JobClient: SPLIT_RAW_BYTES=3D87 > > > 12/03/01 15:24:33 INFO mapred.JobClient: Map output records=3D0 > > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes i= n > > > 2.9865 seconds (0 bytes/sec) > > > 12/03/01 15:24:33 INFO mapreduce.ImportJobBase: Retrieved 0 records. > > > 12/03/01 15:24:33 DEBUG util.ClassLoaderStack: Restoring classloader: > > > sun.misc.Launcher$AppClassLoader@28df6ccd > > > > > > Thanks&Regards, > > > Bruce > > > > > > > > > On Thu, Mar 1, 2012 at 3:27 PM, Jarek Jarcec Cecho >wrote: > > > > > >> Hi Bruce, > > >> would you mind sending entire sqoop command that you've used as well > as > > >> entire output that it generates with "--verbose" flag? > > >> > > >> Jarcec > > >> > > >> On Thu, Mar 01, 2012 at 03:22:14PM +0800, Bruce Bian wrote: > > >> > Hi there, > > >> > When I'm using sqoop free-form query import to import the data fro= m > > >> Oracle > > >> > to HDFS with some ETL process in the query, the results in HDFS > contains > > >> > nothing. > > >> > The query is as follows: > > >> > > > >> > SELECT a.*, > > >> > > b.acnt_no,b.addr_id,b.postcode,b.acnt_rmnd_tp,b.print_tp,b.media_type, > > >> > c.cust_code,c.root_cust_code, > > >> > > > >> > d.mdf_name,d.sub_bureau_code,d.bureau_cd,d.adm_sub_bureau_name,d.bureau_n= ame > > >> > FROM prc_idap_pi_root a > > >> > LEFT OUTER JOIN prc_idap_pi_root_acnt b ON a.acnt_id=3Db.acnt_id > > >> > LEFT OUTER JOIN prc_idap_pi_root_cust c ON a.cust_id=3Dc.cust_id > > >> > LEFT OUTER JOIN ocrm_vt_area d ON a.dev_area_id=3Dd.area_id > > >> > WHERE lst_upd_tmp >=3D (SELECT date_val - 1/240 FROM > > >> etl.etl_para_cfg_detail > > >> > WHERE para_id=3D84) AND \$CONDITIONS > > >> > > > >> > The same query has been executed successfully in oracle(without th= e > > >> > $CONDITIONS of course). Is it because the query contains sub-query > in > > >> it? > > >> > > > >> > Thanks&Regards, > > >> > Bruce > > >> > > > > > > > --f46d0447f076c7c66204ba2fe20a--