Press "Enter" to skip to content

Day: March 7, 2025

Comparing Pandas to Other Libraries for Data Processing

Published 2025-03-07 by Kevin Feasel

Vidyasagar Machupalli performs a comparison:

As discussed in my previous article about data architectures emphasizing emerging trends, data processing is one of the key components in the modern data architecture. This article discusses various alternatives to Pandas library for better performance in your data architecture. 

Data processing and data analysis are crucial tasks in the field of data science and data engineering. As datasets grow larger and more complex, traditional tools like pandas can struggle with performance and scalability. This has led to the development of several alternative libraries, each designed to address specific challenges in data manipulation and analysis.

This is by no means a comprehensive test, but it does show off quite a few libraries that perform similar actions to Pandas.

Leave a Comment

Microsoft Fabric Shortcuts and Lakehouse Maintenance

Published 2025-03-07 by Kevin Feasel

Dennes Torres has a public service announcement:

I wrote about lakehouse maintenance before, about multiple lakehouse maintenances, published videos about this subject and provided sample code about it.

However, there is one problem: All the maintenance execution should be avoided over shortcuts.

The tables require maintenance in their original place. According to our solution advances, we start using shortcuts, lots of them. Our maintenance code should always skip shortcuts and make the maintenance only on the tables.

Click through to see how you can differentiate shortcuts from actual tables and write code to avoid shortcuts.

Leave a Comment

Custom Visual Dialog Boxes Broken in Power BI Desktop February 2025

Published 2025-03-07 by Kevin Feasel

Marco Russo has some bad news for us:

As one of the founders of OKVIZ—a company dedicated to producing custom visuals—I have been following the recent developments in Power BI Desktop with particular concern. This issue, however, extends beyond our company and affects many other organizations that rely on custom visuals to enhance their business intelligence solutions. For this reason, I use my blog on SQLBI to reach a larger audience.

Click through for the problem. Marco has an update that Microsoft pledges to have the problem fixed with the March release of Power BI Desktop.

Leave a Comment

Cleaning up Azure Container Registries

Published 2025-03-07 by Kevin Feasel

Jess Pomfret does a bit of cleanup work:

Azure Container Registries can easily become cluttered with many versions of images. Did you know that each ACR sku comes with a certain amount of storage included, and when you go over that, you’ll pay overage charges. Let’s look at how to check your current storage, keep your registry nice and tidy with an ACR clean-up task, and monitor the storage levels so you’ll never pay extra again!

It’s easy to run up the disk space usage with a container registry, especially if you have automated builds running.

Leave a Comment