Richard Swinbank gives us one method to perform recursive metadata discovery in Azure Data Factory:
Azure Data Factory’s Get Metadata activity returns metadata properties for a specified dataset. In the case of a blob storage or data lake folder, this can include
childItemsarray – the list of files and folders contained in the required folder. If you want all the files contained at any level of a nested a folder subtree, Get Metadata won’t help you – it doesn’t support recursive tree traversal. In this post I try to build an alternative using just ADF.
But before you get too invested in this technique, please read Richard’s spoiler.