Press "Enter" to skip to content

Working with Blob Leases

Miles Cole explains how leasing works with Blob Storage and Data Lake Storage blobs:

Leased a blob? No, this isn’t some new car model with a great leasing offer. Blobs are files in ADLS / OneLake, and leasing is the process of temporarily holding an exclusive lock on one of those files. Does this sound useful in data engineering? Maybe not at first, but in this post I’ll show why understanding the extended features of object storage APIs like blob leases can be invaluable when building data systems that scale.

I’ve never actually done this, but it’s a smart way of preventing multiple job agents from picking up the same work.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.