Multi-Structured Data In U-SQL

Melissa Coates shows us how to use U-SQL to normalize JSON files in which different rows may have differing structures:

Handling the varying formats in U-SQL involves a few steps if it’s the first time you’ve done this:

1. Upload custom JSON assemblies  [one time setup]

2. Create a database   [one time setup]

3. Register custom JSON assemblies   [one time setup]

4. Upload JSON file to Azure Data Lake Store [manual step as an example–usually automated]

5. Run U-SQL script to “standardize” the JSON file(s) into a consistent CSV column/row format

Melissa then shows us how to do this step-by-step.