From dev-return-55448-archive-asf-public=cust-asf.ponee.io@phoenix.apache.org Fri Feb 15 02:08:08 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 9E3A1180626 for ; Fri, 15 Feb 2019 03:08:07 +0100 (CET) Received: (qmail 80380 invoked by uid 500); 15 Feb 2019 02:08:06 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 79908 invoked by uid 99); 15 Feb 2019 02:08:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Feb 2019 02:08:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 633B2C670E for ; Fri, 15 Feb 2019 02:08:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 83lzfnXA1i20 for ; Fri, 15 Feb 2019 02:08:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 55FFA5FE1F for ; Fri, 15 Feb 2019 02:08:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 196B0E27B9 for ; Fri, 15 Feb 2019 02:08:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 9316F244DF for ; Fri, 15 Feb 2019 02:08:00 +0000 (UTC) Date: Fri, 15 Feb 2019 02:08:00 +0000 (UTC) From: =?utf-8?Q?=E5=BC=A0=E5=BB=B6=E5=8F=AC_=28JIRA=29?= To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (PHOENIX-5140) TableNotFoundException occurs when we create local asynchronous index MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/PHOENIX-5140?page=3Dcom.atlass= ian.jira.plugin.system.issuetabpanels:all-tabpanel ] =E5=BC=A0=E5=BB=B6=E5=8F=AC updated PHOENIX-5140: ------------------------- Description:=20 First I create the table and insert the data: =C2=A0 ---- =C2=A0create table DMP.DMP_INDEX_TEST2 (id varchar not null primary key,nam= e varchar,age varchar); upsert into DMP.DMP_INDEX_TEST2 values('id01','name01','age01'); ---- =C2=A0 The asynchronous index is then created: =C2=A0 ---- create local index if not exists TMP_INDEX_DMP_TEST2 on DMP.DMP_INDEX_TEST2= (name) ASYNC; ---- =C2=A0 Because kerberos is enabled,So I need kinit HBase principal first,Then exec= ute the following command: =C2=A0 ---- HADOOP_CLASSPATH=3D"/etc/hbase/conf" hadoop jar /usr/hdp/3.0.0.0-1634/phoen= ix/phoenix-client.jar org.apache.phoenix.mapreduce.index.IndexTool --schema= DMP --data-table DMP_INDEX_TEST2 --index-table TMP_INDEX_DMP_TEST2 --outpu= t-path /hbase-backup2 ---- =C2=A0 But I got the following error: =C2=A0 ---- Error: java.lang.RuntimeException: org.apache.phoenix.schema.TableNotFoundE= xception: ERROR 1012 (42M03): Table undefined. tableName=3DDMP.DMP_INDEX_TE= ST2 at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:124) at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:50) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati= on.java:1688) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) Caused by: org.apache.phoenix.schema.TableNotFoundException: ERROR 1012 (4= 2M03): Table undefined. tableName=3DDMP.DMP_INDEX_TEST2 at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTableRegionLoca= tion(ConnectionQueryServicesImpl.java:4544) at org.apache.phoenix.query.DelegateConnectionQueryServices.getTableRegion= Location(DelegateConnectionQueryServices.java:312) at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java= :163) at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.jav= a:118) at org.apache.phoenix.compile.UpsertCompiler$UpsertValuesMutationPlan.exec= ute(UpsertCompiler.java:1202) at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:4= 08) at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:3= 91) at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStateme= nt.java:390) at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStateme= nt.java:378) at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepare= dStatement.java:173) at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepare= dStatement.java:183) at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:103) ... 9 more ---- =C2=A0 I can query this table and have access to it,It works well: =C2=A0 ---- select *=C2=A0from DMP.DMP_INDEX_TEST2; select *=C2=A0from DMP.TMP_INDEX_DMP_TEST2; drop table DMP.DMP_INDEX_TEST2; ---- =C2=A0 But why did my MR task make this mistake? Any Suggestions from anyone was: First I create the table and insert the data: ---- =C2=A0create table DMP.DMP_INDEX_TEST2 (id varchar not null primary key,nam= e varchar,age varchar); upsert into DMP.DMP_INDEX_TEST2 values('id01','name01','age01'); ---- The asynchronous index is then created: ---- create local index if not exists TMP_INDEX_DMP_TEST2 on DMP.DMP_INDEX_TEST2= (name) ASYNC; ---- Because kerberos is enabled,So I need kinit HBase principal first,Then exec= ute the following command: ---- HADOOP_CLASSPATH=3D"/etc/hbase/conf" hadoop jar /usr/hdp/3.0.0.0-1634/phoen= ix/phoenix-client.jar org.apache.phoenix.mapreduce.index.IndexTool --schema= DMP --data-table DMP_INDEX_TEST2 --index-table TMP_INDEX_DMP_TEST2 --outpu= t-path /hbase-backup2 ---- =C2=A0But I got the following error: ---- Error: java.lang.RuntimeException: org.apache.phoenix.schema.TableNotFoundE= xception: ERROR 1012 (42M03): Table undefined. tableName=3DDMP.DMP_INDEX_TE= ST2 at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:124) at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:50) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati= on.java:1688) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) Caused by: org.apache.phoenix.schema.TableNotFoundException: ERROR 1012 (4= 2M03): Table undefined. tableName=3DDMP.DMP_INDEX_TEST2 at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTableRegionLoca= tion(ConnectionQueryServicesImpl.java:4544) at org.apache.phoenix.query.DelegateConnectionQueryServices.getTableRegion= Location(DelegateConnectionQueryServices.java:312) at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java= :163) at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.jav= a:118) at org.apache.phoenix.compile.UpsertCompiler$UpsertValuesMutationPlan.exec= ute(UpsertCompiler.java:1202) at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:4= 08) at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:3= 91) at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStateme= nt.java:390) at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStateme= nt.java:378) at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepare= dStatement.java:173) at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepare= dStatement.java:183) at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoenix= IndexImportMapper.java:103) ... 9 more ---- I can query this table and have access to it,It works well: ---- select *=C2=A0from DMP.DMP_INDEX_TEST2; select *=C2=A0from DMP.TMP_INDEX_DMP_TEST2; drop table DMP.DMP_INDEX_TEST2; ---- =C2=A0But why did my MR task make this mistake? Any Suggestions from anyone > TableNotFoundException occurs when we create local asynchronous index > --------------------------------------------------------------------- > > Key: PHOENIX-5140 > URL: https://issues.apache.org/jira/browse/PHOENIX-5140 > Project: Phoenix > Issue Type: Bug > Affects Versions: 5.0.0 > Environment: > HDP : 3.0.0.0=EF=BC=8C HBase=C2=A0: 2.0.0=EF=BC=8C= phoenix=C2=A0: 5.0.0 and hadoop=C2=A0: 3.1.0 > Reporter: =E5=BC=A0=E5=BB=B6=E5=8F=AC > Priority: Major > Labels: IndexTool, localIndex, tableUndefined > Original Estimate: 48h > Remaining Estimate: 48h > > First I create the table and insert the data: > =C2=A0 > ---- > =C2=A0create table DMP.DMP_INDEX_TEST2 (id varchar not null primary key,n= ame varchar,age varchar); > upsert into DMP.DMP_INDEX_TEST2 values('id01','name01','age01'); > ---- > =C2=A0 > The asynchronous index is then created: > =C2=A0 > ---- > create local index if not exists TMP_INDEX_DMP_TEST2 on DMP.DMP_INDEX_TES= T2 (name) ASYNC; > ---- > =C2=A0 > Because kerberos is enabled,So I need kinit HBase principal first,Then ex= ecute the following command: > =C2=A0 > ---- > HADOOP_CLASSPATH=3D"/etc/hbase/conf" hadoop jar /usr/hdp/3.0.0.0-1634/pho= enix/phoenix-client.jar org.apache.phoenix.mapreduce.index.IndexTool --sche= ma DMP --data-table DMP_INDEX_TEST2 --index-table TMP_INDEX_DMP_TEST2 --out= put-path /hbase-backup2 > ---- > =C2=A0 > But I got the following error: > =C2=A0 > ---- > Error: java.lang.RuntimeException: org.apache.phoenix.schema.TableNotFoun= dException: ERROR 1012 (42M03): Table undefined. tableName=3DDMP.DMP_INDEX_= TEST2 > at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoen= ixIndexImportMapper.java:124) > at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoen= ixIndexImportMapper.java:50) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInforma= tion.java:1688) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) > Caused by: org.apache.phoenix.schema.TableNotFoundException: ERROR 1012 = (42M03): Table undefined. tableName=3DDMP.DMP_INDEX_TEST2 > at org.apache.phoenix.query.ConnectionQueryServicesImpl.getTableRegionLo= cation(ConnectionQueryServicesImpl.java:4544) > at org.apache.phoenix.query.DelegateConnectionQueryServices.getTableRegi= onLocation(DelegateConnectionQueryServices.java:312) > at org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.ja= va:163) > at org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.j= ava:118) > at org.apache.phoenix.compile.UpsertCompiler$UpsertValuesMutationPlan.ex= ecute(UpsertCompiler.java:1202) > at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java= :408) > at org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java= :391) > at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) > at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixState= ment.java:390) > at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixState= ment.java:378) > at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepa= redStatement.java:173) > at org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPrepa= redStatement.java:183) > at org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(Phoen= ixIndexImportMapper.java:103) > ... 9 more > ---- > =C2=A0 > I can query this table and have access to it,It works well: > =C2=A0 > ---- > select *=C2=A0from DMP.DMP_INDEX_TEST2; > select *=C2=A0from DMP.TMP_INDEX_DMP_TEST2; > drop table DMP.DMP_INDEX_TEST2; > ---- > =C2=A0 > But why did my MR task make this mistake? Any Suggestions from anyone -- This message was sent by Atlassian JIRA (v7.6.3#76005)