Ed Elliott has an update for us:
I recently published the latest version of the Spark Connect Dotnet library which includes support for the new
Variant
data type in Apache Spark 4.0 here. One of the new features of Spark 4.0 is theVariant
data type which is a faster way of processing Json data (see here).
Click through to see how it all works.