A Fine Slice Of SQL Server
Matthew Hicks makes an announcement:
We’re thrilled to announce an exciting new Preview capability in OneLake: you can now automatically read Delta Lake tables using Apache Iceberg compatible readers, with no need for migration, copying, or manual conversion. This enhancement gives data engineers and analytics teams unprecedented flexibility in how they access and interact with their data.
This is pretty neat, given that Iceberg is the other popular format for data lakes.
Leave a CommentVarun Jain makes a security announcement:
A Fabric workspace identity is an automatically managed service principal that can be associated with a Fabric workspace. Fabric workspaces with a workspace identity can securely read or write to firewall-enabled Azure Data Lake Storage Gen2 accounts through trusted workspace access for OneLake shortcuts. Fabric items can use the identity when connecting to resources that support Microsoft Entra authentication. Fabric uses workspace identities to obtain Microsoft Entra tokens without the customer having to manage any credentials.
Previously, a workspace identity was automatically assigned the workspace contributor role and had access to workspace items.
Read on to see what’s changing, why, and what you can do instead.
Leave a CommentJon Vöge continues a series on write-back options into Microsoft Fabric:
In that article, we took advantage of some of the built-in sample code from the User Data Function editor, as well as some great code examples from Sujata: Example User data functions for Translytical task flows · GitHub
The problem? All of these samples use SQL Databases in Fabric as the backend item.
Jon switches this from a SQL database into a Fabric Data Warehouse, and notes some of the challenges along the way.
Leave a CommentRayis Imayev streams some data:
In my post last week (https://datanrg.blogspot.com/2025/06/salesforce-cdc-data-integration.html), I talked about Salesforce Change Data Capture (CDC) event data streaming, where the initial event destination was file storage in Azure. But what if we anticipate a higher volume of incoming Salesforce source data or the addition of a new data feed? This could create the need for an alternative method of managing incoming events.
Read on to learn more.
Leave a CommentReitse Eskens tries out a tool for monitoring Microsoft Fabric installations:
Let me set the scene quickly for you. You’re working for an organisation where Fabric is in the process of being adopted or it’s already fully in use. Regardless of the number of capacities, workspaces, etc, you’re interested in what’s going on in your Fabric environment. You have questions like “Who is using the reports?”, “Who is changing settings in the Admin panel?” and “How is my capacity being used?”.
Read on for a single tool that can solve these sorts of questions.
Leave a CommentMiles Cole does a bit of testing:
First, let’s revisit the purpose of the benchmark: The objective is to explore data engineering engines available in Fabric to understand whether Spark with vectorized execution (the Native Execution Engine) should be considered in small data architectures.
Beyond refreshing the benchmark to see if any core findings have changed, I do want to expand in a few areas where I got great feedback from the community:
I really appreciate the approach behind this, both in terms of sticking to more realistic data sizes for many operations as well as performing this test given all of the recent improvements in each engine.
Leave a CommentCopy job has been a go-to tool for simplified data ingestion in Microsoft Fabric, offering a seamless data movement experience from any source to any destination. Whether you need batch or incremental copying, it provides the flexibility to meet diverse data needs while maintaining a simple and intuitive workflow.
We continuously refine Copy job based on customer feedback, enhancing both functionality and user experience. In this update, we’re introducing several key improvements designed to streamline your workflow and boost efficiency.
Click through to see what’s new.
Leave a CommentMiquella de Boer has an announcement:
Shortcut transformations is a new capability in Microsoft Fabric that simplifies the process of converting raw files, starting with .CSV files, into Delta tables. This feature eliminates the need for traditional ETL pipelines, enabling users to transform data directly on top of files with minimal setup.
Click through to see how it all works.
Leave a CommentHarmeet Gill shows us how we can bring our own keys to data in OneLake:
One of the highly requested features in Microsoft Fabric is now available: the ability to encrypt data in OneLake using your own keys. As organizations face growing data volumes and tighter regulatory expectations, Customer-Managed Keys (CMK) offer a powerful way to enforce enterprise-grade security and ensure strict ownership of encryption keys and access.
With Microsoft’s OneLake, we’ve built a unified data lake that’s open, secure, and ready for enterprise scale. Now, with support for CMK, we’re giving customers the power to take encryption into their own hands.
Read on to learn more about Microsoft’s default for data encryption, and how you can use your own keys to encrypt the data.
Leave a CommentSunitha Muthukrishna has an update:
Microsoft Fabric Extension for VS Code enables users to manage Fabric items efficiently from within VS Code. We are announcing two new features for Microsoft Fabric Extension for VS Code that allow you to manage Fabric items directly within your workspace. These enhancements are based on customer feedback, and we welcome further input to improve this product.
Click through to see what’s new in the product.
Leave a Comment