Xiaoyong Zhu introduces the new HDInsight Tool for IntelliJ:
This tools extends IntelliJ to support Spark job life cycle from create, author, debug and submit job to Azure cluster and view results. This IntelliJ HDInsight tool integrates well with Azure to allow user navigate HDInsight Spark clusters and view associated Azure storage account. To further boost productivity, the IntelliJ HDInsight tool also offers the capability to view Spark job history, display detailed job logs, and the job output to boost developer productivity. A few usability improvements have been implemented upon user preview feedback, which includes auto locate artifact, add intelligence to remember assembly location, caches spark logs, etc.
It looks like this is specifically designed for Spark-enabled clusters.