openwhisk-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Thomas <>
Subject Supporting user-configurable warm action containers?
Date Thu, 31 May 2018 11:22:11 GMT
One of most frequent complaints[1][2][3] I hear from developers using
serverless platforms is coping with cold-start latency when dealing with
sudden bursts of traffic.

Developers often ask for a feature where they can set the number of warm
containers kept in the cache for a function. This would allow them to keep
a higher number of warm containers for applications with bursty traffic
and/or upgrade the cached number prior to an anticpated burst of traffic
arriving. This would be exposed by the managed platforms as a chargable

Is this something we could support on OpenWhisk? Ignoring the complexity
and feasibility of any solution, from a developer POV I can image having an
action annotation `max-warm` which would set the maximum number of warm
containers allowed in the cache.

Tyson is currently working on concurrent activation processing, which is
one approach to reducing cold-start delays[4]. However, there are some
downsides to concurrent activations, like no runtime isolation for request
processing, which might make this feature inappropraite for some users.

[4] -

James Thomas

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message