Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id DB411200D5F for ; Mon, 4 Dec 2017 01:01:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id D9AF9160C1A; Mon, 4 Dec 2017 00:01:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2BEDB160C0B for ; Mon, 4 Dec 2017 01:01:05 +0100 (CET) Received: (qmail 88898 invoked by uid 500); 4 Dec 2017 00:01:04 -0000 Mailing-List: contact issues-help@tajo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tajo.apache.org Delivered-To: mailing list issues@tajo.apache.org Received: (qmail 88889 invoked by uid 99); 4 Dec 2017 00:01:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Dec 2017 00:01:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 8A7421A093D for ; Mon, 4 Dec 2017 00:01:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.502 X-Spam-Level: X-Spam-Status: No, score=-99.502 tagged_above=-999 required=6.31 tests=[KAM_NUMSUBJECT=0.5, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id IBG_TLcUMrSB for ; Mon, 4 Dec 2017 00:01:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 47C715F523 for ; Mon, 4 Dec 2017 00:01:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 777BDE08C6 for ; Mon, 4 Dec 2017 00:01:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 29A5121064 for ; Mon, 4 Dec 2017 00:01:00 +0000 (UTC) Date: Mon, 4 Dec 2017 00:01:00 +0000 (UTC) From: "Hyunsik Choi (JIRA)" To: issues@tajo.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (TAJO-1905) Insert clause to partitioned table fails on S3 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 04 Dec 2017 00:01:06 -0000 [ https://issues.apache.org/jira/browse/TAJO-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16276161#comment-16276161 ] Hyunsik Choi commented on TAJO-1905: ------------------------------------ I rescheduled it to 0.13.0 because it seems not critical in main features of Tajo. If you want to finish it in 0.12.0, you can change back the fixed version to 0.12.0. > Insert clause to partitioned table fails on S3 > ---------------------------------------------- > > Key: TAJO-1905 > URL: https://issues.apache.org/jira/browse/TAJO-1905 > Project: Tajo > Issue Type: Sub-task > Components: QueryMaster, S3 > Reporter: Jinho Kim > Assignee: Jaehwa Jung > Fix For: 0.13.0 > > > Here is the error log > {noformat} > 2015-10-02 18:54:40,399 ERROR org.apache.hadoop.fs.s3a.S3AFileSystem: rename: src not found s3a://bucket/tpch-1g-p/lineitem/.staging/q_1443779192380_0001/RESULT/l_shipdate=1996-01-30 > 2015-10-02 18:54:51,357 ERROR org.apache.hadoop.fs.s3a.S3AFileSystem: rename: src not found s3a://bucket/tpch-1g-p/lineitem/.staging/q_1443779192380_0001/RESULT/l_shipdate=1993-11-09 > 2015-10-02 18:55:03,955 ERROR org.apache.tajo.querymaster.Query: No such file or directory: s3a://bucket/lineitem/l_shipdate=1994-02-02 > java.io.FileNotFoundException: No such file or directory: s3a://bucket/tpch-1g-p/lineitem/l_shipdate=1994-02-02 > at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:996) > at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:77) > at org.apache.hadoop.fs.FileSystem.getContentSummary(FileSystem.java:1467) > at org.apache.tajo.querymaster.Query$QueryCompletedTransition.getPartitionsWithContentsSummary(Query.java:550) > at org.apache.tajo.querymaster.Query$QueryCompletedTransition.finalizeQuery(Query.java:512) > at org.apache.tajo.querymaster.Query$QueryCompletedTransition.transition(Query.java:446) > at org.apache.tajo.querymaster.Query$QueryCompletedTransition.transition(Query.java:435) > at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) > at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) > at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46) > at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448) > at org.apache.tajo.querymaster.Query.handle(Query.java:874) > at org.apache.tajo.querymaster.Query.handle(Query.java:63) > at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:175) > at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:108) > at java.lang.Thread.run(Thread.java:745) > 2015-10-02 18:55:03,958 INFO org.apache.tajo.querymaster.Query: q_1443779192380_0001 Query Transitioned from QUERY_RUNNING to QUERY_ERROR > 2015-10-02 18:55:03,958 INFO org.apache.tajo.querymaster.Query: Processing q_1443779192380_0001 of type DIAGNOSTIC_UPDATE > 2015-10-02 18:55:03,958 INFO org.apache.tajo.querymaster.QueryMasterTask: Query completion notified from q_1443779192380_0001 final state: QUERY_ERROR > 2015-10-02 18:55:03,960 INFO org.apache.tajo.querymaster.QueryMasterTask: Stopping QueryMasterTask:q_1443779192380_0001 > 2015-10-02 18:55:03,960 INFO org.apache.tajo.querymaster.QueryMasterTask: Cleanup resources of all workers. Query: q_1443779192380_0001, workers: 1 > 2015-10-02 18:55:03,962 INFO org.apache.tajo.querymaster.QueryMasterTask: Stopped QueryMasterTask:q_1443779192380_0001 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)