Ed Elliott digs into API details:
In the first two posts, we looked at how to run some Spark code, firstly against a local Spark Connect server and then against a Databricks cluster. In this post, we will look more at the actual gRPC API itself, namely
ExecutePlan,
Config
, andAddArtifacts
/ArtifactsStatus.
Click through to see how it all works, with plenty of C# code to guide you along the way.