airflow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Riccomini <criccom...@apache.org>
Subject Re: Lock wait timeout exceeded
Date Tue, 29 Nov 2016 16:18:37 GMT
https://github.com/apache/incubator-airflow/pull/1907

On Mon, Nov 28, 2016 at 10:35 PM, Maxime Beauchemin
<maximebeauchemin@gmail.com> wrote:
> I just looked quickly and it looks like no index is defined on the XCom
> model beyond the PK. We should add a composite btree index on dag_id,
> task_id and execution_date. I don't think MySQL will let you include `key`
> in there as it's too long (512). The 3 other fields are plenty selective so
> that will work just as well.
>
> Creating the index straight in the db should fix the problem right away in
> your environment, but it'd be nice to add it to the model definition and
> generate the db migration script for it.
>
> Max
>
> On Mon, Nov 28, 2016 at 8:47 AM, Chris Riccomini <criccomini@apache.org>
> wrote:
>
>> Hey all,
>>
>> Starting to see this with some frequency:
>>
>> (_mysql_exceptions.OperationalError) (1205, 'Lock wait timeout
>> exceeded; try restarting transaction') [SQL: u'DELETE FROM xcom WHERE
>> xcom.`key` = %s AND xcom.execution_date = %s AND xcom.task_id = %s AND
>> xcom.dag_id = %s'] [parameters: (u'return_value',
>> datetime.datetime(2016, 11, 28, 15, 47),
>> 'gcs2bq_fraud.fraud_rules_executions',
>> 'db_monolith_fraud_fraud_rules_executions_partition_15m')]
>>
>> Haven't dug into yet. Anyone have any thoughts?
>>
>> Cheers,
>> Chris
>>

Mime
View raw message