Press "Enter" to skip to content

Join Hints in Spark 3

The Hadoop in Real World team shares some information on join hits in Spark SQL:

The join side with the hint will be broadcast regardless of the size limit specified in spark.sql.autoBroadcastJoinThreshold  property. If both sides of the join have the broadcast hints, the one with the smaller size (based on stats) will be broadcast.

Click through for examples of the four categories of join hints.