Press "Enter" to skip to content

Day: June 23, 2025

Accessing Delta Lake via Spark Connect

Ed Elliott has some code for us:

I have just finished an update for the spark connect dotnet lib that contains the DeltaTable implementation so that we can now use .NET to maintain delta tables, over and above what we get out of the box by using DataFrame.Write.Format("delta"), this is an example of how to use the delta api from .NET:

Click through for the example, and you can learn more about Spark Connect from the Spark website and Ed has a .NET client for the task.

Leave a Comment

Transaction Control and Locking in PostgreSQL vs Oracle

Kellyn Gorman continues a series on PostgreSQL for Oracle DBAs:

Now that we finished Part 2 on physical data structures, storage and processes, it’s time to work our way into transaction control, locking and just a smidgen of performance insight.

This post is for Oracle DBAs who want to understand PostgreSQL’s transaction and locking mechanics, as well as how to monitor and tune performance without diving into execution plans just yet. Think of this as your quick-reference mental shift guide from Oracle to PostgreSQL.

Read on for some of the differences in the platforms.

Leave a Comment

Costs of Over-Instrumentation

Lenard Lim shares a warning:

If you’ve ever opened a product analytics dashboard and scrolled past dozens of unlabeled metrics, charts with no viewers, and events no one can explain—welcome to the world of metric sprawl.

In my roles at a MAANG company and a remittance fintech, I’ve seen product teams obsessed with instrumenting everything: every click, every scroll, every hover, every field. The thinking is, “Better to have it and not need it than need it and not have it.”

But there’s a hidden cost to this mindset. And it’s time we talk about it.

I personally tend toward wanting as much information as possible, though Lenard makes good points around the friction that adds, as well as potential degradations in user experience.

Leave a Comment

Creating a Power BI Date Picker without Custom Visuals

Boniface Muchendu lets users pick the date:

Many users need the ability to select a single date not a range to filter their entire report. While Power BI’s default slicer shows a long list of dates or uses relative filters like “Today” or “Yesterday,” these options can be limiting.

Additionally, relying on the filter pane often isn’t ideal for dashboards meant for end users, especially when the pane is hidden or locked. An on-screen date picker provides a more intuitive and controlled experience.

Read on to see how.

Leave a Comment

Getting Started with CF.Cumulus Community Edition

Matt Collins shares a deployment guide:

For those who have been following along with our product CF.Cumulus, we have been gearing up for some exciting developments and want to give more power and independence to users. As such, we’re putting together some comprehensive “How-to” guides to simplify the deployment process for Community Edition users.

This deployment guide walks you through setting up CF.Cumulus with the Azure Resources depicted below.

Click through for the guide.

Leave a Comment

Exfiltration Opportunities in Power Query

Oscar Martinez lays out the risks:

Data exfiltration is the act of moving sensitive data outside a trusted environment without authorisation. In the context of Power Query (the data transformation engine behind Excel, Power BI, dataflows, etc.), this means an insider could use a Power Query script to siphon data from secure sources (like databases) out to an external destination. Microsoft defines data exfiltration as the movement of sensitive business data outside a trusted boundary, whether intentionally or unintentionally.^1

Click through to learn more about what is possible, as well as practical tips on how to reduce this risk.

Leave a Comment

The FabricTools Powershell Module

Kamil Nowinski has a module for us:

In the world of Microsoft Fabric, DevOps is still maturing. Unlike Azure Data Factory (ADF), which has been around long enough to have established tooling – like the #ADFTools I developed 5 years ago – Fabric is new, broad, and complex, in a very positive way!

Microsoft Fabric integrates data engineering, warehousing, real-time analytics, and BI. With this scale, the need for solid DevOps tooling is more critical than ever.

Click through to read a little bit of the history behind the project, as well as what’s currently available. And it’s all free and open-source.

Leave a Comment