Stithi Panigrahi does some troubleshooting:
Due to the potential impact on performance and storage costs, Azure Databricks clusters don’t capture networking logs by default. Follow the below instructions if you need to capture tcpdump to investigate multiple networking issues related to the cluster. These steps will capture a TCP dump on each cluster node–both driver and workers during the entire lifetime of the cluster.
Click through for an initiation script, which generates the actual script, which itself generates the TCP dumps.