Landon Robinson works around an annoyance:
But DataFrames have not been given the same, clear route to convenient renaming of cached data. It has, however, been attempted and requested by the community:
– https://forums.databricks.com/questions/6525/how-to-setname-on-a-dataframe.html
– https://issues.apache.org/jira/browse/SPARK-8480However, with the below approach, you can start naming your DataFrames all you want. It’s very handy.
Read on to see the solution in action.