Tomaz Kastrun shares some thoughts on IDEs for writing Spark code:
Let’s look into the IDE that can be used to run Spark.
Remember that Spark can be used with languages: Scala, Java, R, Python and each give you different IDE and different installations.
To Tomaz’s list, I’d add IntelliJ IDEA for Scala programming. I was never much a fan of Eclipse, but there are people who swear by it.