Mailing-List: contact commits-help@airflow.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airflow.incubator.apache.org
Date: Tue, 9 Aug 2016 07:05:20 +0000 (UTC)
From: "Nadeem Ahmed Nazeer (JIRA)" <jira@apache.org>
To: commits@airflow.incubator.apache.org
Message-ID: <JIRA.12995771.1470694196000.257798.1470726320558@Atlassian.JIRA>
In-Reply-To: <JIRA.12995771.1470694196000@Atlassian.JIRA>
References: <JIRA.12995771.1470694196000@Atlassian.JIRA> <JIRA.12995771.1470694196229@arcas>
Subject: [jira] [Comment Edited] (AIRFLOW-401) scheduler gets stuck without
 a trace
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 09 Aug 2016 07:05:25 -0000


    [ https://issues.apache.org/jira/browse/AIRFLOW-401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413070#comment-15413070 ] 

Nadeem Ahmed Nazeer edited comment on AIRFLOW-401 at 8/9/16 7:04 AM:
---------------------------------------------------------------------

scheduler in a loop for more than 7 hours. screenshot attached. 


was (Author: nadeem):
scheduler in a loop for more than 7 hours!

> scheduler gets stuck without a trace
> ------------------------------------
>
>                 Key: AIRFLOW-401
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-401
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: executor, scheduler
>    Affects Versions: Airflow 1.7.1.3
>            Reporter: Nadeem Ahmed Nazeer
>            Assignee: Bolke de Bruin
>            Priority: Minor
>         Attachments: Dag_code.txt, schduler_cpu100%.png, scheduler_stuck.png, scheduler_stuck_7hours.png
>
>
> The scheduler gets stuck without a trace or error. When this happens, the CPU usage of scheduler service is at 100%. No jobs get submitted and everything comes to a halt. Looks it goes into some kind of infinite loop. 
> The only way I could make it run again is by manually restarting the scheduler service. But again, after running some tasks it gets stuck. I've tried with both Celery and Local executors but same issue occurs. I am using the -n 3 parameter while starting scheduler. 
> Scheduler configs,
> job_heartbeat_sec = 5
> scheduler_heartbeat_sec = 5
> executor = LocalExecutor
> parallelism = 32
> Please help. I would be happy to provide any other information needed


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)