Ian Hellström shows how to create an sbt script to get the a particular version of Spark:
If you have already installed sbt on your machine, read on. If not, have a look here on how to set up your machine.
With sbt available, create a folder in which you can play around, your ‘sandbox’. I’ll assume you have created the folder under
/path/to/sandbox
. On Windows, also create a sub-folder inside it for Spark’s so-called warehouse directory. Let’s call that sub-folder ‘warehouse’.
Click through for more details.