Kaushik Nath explains what a Delta Lake is and why it is beneficial:
Data lakes have generated a large amount of publicity as the new storage technology for our big data era. Because something new is always better, right?
All this hype around data lakes has ignored their inherent drawbacks and limitations. Well, I’m Not Here to create a debate by saying that no one should ever use data lakes. But I am saying that companies should enter into the data lake investment with eyes wide open. Otherwise it might lead to some serious complications.
Delta Lake is a concept intended to mitigate some of the issues with data lakes in general, turning them into data swamps.