Sangeet Agulia walks us through the cluster managers available within Spark:
Spark Offers three types of Cluster Managers :
1) Standalone
2) Mesos
3) Yarn
4) Kubernetes (experimental) – In addition to the above, there is experimental support for Kubernetes. Kubernetes is an open-source platform for providing container-centric infrastructure.
Read on for a description of the top three cluster managers.