Jens Vestergaard rethinks a metaphor:
In February 2025 I wrote about building an event-driven ETL system in Microsoft Fabric. The metaphor was air traffic control: notebooks as flights, Azure Service Bus as the control tower, the Bronze/Silver/Gold medallion layers as the runway sequence. The whole system existed because Fabric has core-based execution limits that throttle how many Spark jobs run simultaneously on a given capacity SKU.
The post was about working around a constraint. You could not just fire all your notebooks at once. You needed something to manage the queue.
More than a year on, it is worth being honest about what held up and what has changed.
Read on to see what has changed in this past year and how Jens thinks of it today.