Return-Path: X-Original-To: apmail-tez-issues-archive@minotaur.apache.org Delivered-To: apmail-tez-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C38E3101A3 for ; Mon, 2 Feb 2015 23:18:36 +0000 (UTC) Received: (qmail 27513 invoked by uid 500); 2 Feb 2015 23:18:34 -0000 Delivered-To: apmail-tez-issues-archive@tez.apache.org Received: (qmail 27450 invoked by uid 500); 2 Feb 2015 23:18:34 -0000 Mailing-List: contact issues-help@tez.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tez.apache.org Delivered-To: mailing list issues@tez.apache.org Received: (qmail 27440 invoked by uid 99); 2 Feb 2015 23:18:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Feb 2015 23:18:34 +0000 Date: Mon, 2 Feb 2015 23:18:34 +0000 (UTC) From: "Hitesh Shah (JIRA)" To: issues@tez.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (TEZ-2022) java.lang.IllegalStateException: Vertex: got invalid start event MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TEZ-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302304#comment-14302304 ] Hitesh Shah commented on TEZ-2022: ---------------------------------- Seems like multiple bugs, one of which would be a variation of TEZ-1893 where a user error is not caught and causes the AM to crash. > java.lang.IllegalStateException: Vertex: got invalid start event > ---------------------------------------------------------------- > > Key: TEZ-2022 > URL: https://issues.apache.org/jira/browse/TEZ-2022 > Project: Apache Tez > Issue Type: Bug > Reporter: Rajesh Balamohan > Attachments: TEZ-2022-DAG.png, TEZ-2022.applog.1.txt, TEZ-2022.applog.txt > > > Latest Tez (with tez-2020 patch) + Pig > When running pig with rank function, the following exception happens consistently > {code} > java.lang.IllegalStateException: Vertex: vertex_1422270854961_0113_1_03 [scope-47] got invalid start event > at com.google.common.base.Preconditions.checkState(Preconditions.java:145) > at org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:3178) > at org.apache.tez.dag.app.dag.impl.VertexImpl$StartWhileInitializingTransition.transition(VertexImpl.java:3170) > at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:362) > at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) > at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46) > at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448) > at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57) > at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1547) > at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:181) > at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1768) > at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1754) > at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:184) > at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:116) > at java.lang.Thread.run(Thread.java:744) > {code} > {code} > rawLogs = load '/tmp/logs/root/logs/application_1422270854961_0093/' using org.apache.tez.tools.TFileLoader() as (machine:chararray, key:chararray, line:chararray); > raw = FOREACH rawLogs GENERATE TRIM(REGEX_EXTRACT(machine, '(.*)_(\\d+)', 1)) as machine, key, line; > machines = FOREACH raw GENERATE machine; > distinctMachines = DISTINCT machines; > sortByMachines = ORDER distinctMachines BY machine; > ranked = RANK sortByMachines; > dump ranked; > {code} > Will attach the DAG and applog asap. -- This message was sent by Atlassian JIRA (v6.3.4#6332)