Gilbert Quevauvilliers wants one rename to rule them all:
Following on from my previous blog post this blog post I’m going to demonstrate how to bulk rename column names in a single step instead of having to rename them individually.
The reason this came about is because I had a set of data where the column names had the square brackets which I wanted to remove.
As shown below I have highlighted 2 column names with the square brackets.
Read on to see how you can perform somewhat-generic rename operations in Spark notebooks.