A Fine Slice Of SQL Server
Matthew Hicks makes an announcement:
We’re thrilled to announce an exciting new Preview capability in OneLake: you can now automatically read Delta Lake tables using Apache Iceberg compatible readers, with no need for migration, copying, or manual conversion. This enhancement gives data engineers and analytics teams unprecedented flexibility in how they access and interact with their data.
This is pretty neat, given that Iceberg is the other popular format for data lakes.
Comments closedVarun Jain makes a security announcement:
A Fabric workspace identity is an automatically managed service principal that can be associated with a Fabric workspace. Fabric workspaces with a workspace identity can securely read or write to firewall-enabled Azure Data Lake Storage Gen2 accounts through trusted workspace access for OneLake shortcuts. Fabric items can use the identity when connecting to resources that support Microsoft Entra authentication. Fabric uses workspace identities to obtain Microsoft Entra tokens without the customer having to manage any credentials.
Previously, a workspace identity was automatically assigned the workspace contributor role and had access to workspace items.
Read on to see what’s changing, why, and what you can do instead.
Comments closedKoen Verbeeck wants good requests:
I needed to run a PowerShell cmdlet in an Azure Devops pipeline. The cmdlet in question was New-AzRoleAssignment, but the cmdlet itself isn’t important. What is important is that I needed to pass the object ID of a service principal to the command. Even though I was pretty sure the syntax and everything was correct, I got a “Operation returned an invalid status code ‘BadRequest’” error when the PowerShell was run (inside an Azure PowerShell task):
Read on to see how Koen diagnosed and resolved the issue.
Comments closedJon Vöge continues a series on write-back options into Microsoft Fabric:
In that article, we took advantage of some of the built-in sample code from the User Data Function editor, as well as some great code examples from Sujata: Example User data functions for Translytical task flows · GitHub
The problem? All of these samples use SQL Databases in Fabric as the backend item.
Jon switches this from a SQL database into a Fabric Data Warehouse, and notes some of the challenges along the way.
Comments closedRayis Imayev streams some data:
In my post last week (https://datanrg.blogspot.com/2025/06/salesforce-cdc-data-integration.html), I talked about Salesforce Change Data Capture (CDC) event data streaming, where the initial event destination was file storage in Azure. But what if we anticipate a higher volume of incoming Salesforce source data or the addition of a new data feed? This could create the need for an alternative method of managing incoming events.
Read on to learn more.
Comments closedJosephine Bush tracks some errors:
Logging is a necessity in the database world, well, the entire tech world. You need to know what is happening in and around your databases. It’s easy to setup in Azure SQL DB.
Read on to learn more about the logging options available in Azure SQL DB, as well as how you can configure and view the log and audit results.
Comments closedReitse Eskens tries out a tool for monitoring Microsoft Fabric installations:
Let me set the scene quickly for you. You’re working for an organisation where Fabric is in the process of being adopted or it’s already fully in use. Regardless of the number of capacities, workspaces, etc, you’re interested in what’s going on in your Fabric environment. You have questions like “Who is using the reports?”, “Who is changing settings in the Admin panel?” and “How is my capacity being used?”.
Read on for a single tool that can solve these sorts of questions.
Comments closedIt’s ten o’clock. Do you know where your Kevin Wilkie is?:
In our last few posts, we’ve looked at how to:
Today, we’re diving into a different, but equally powerful question:
When are my Snowflake warehouses actually running?
Click through for the query and an example of it in action.
Comments closedCopy job has been a go-to tool for simplified data ingestion in Microsoft Fabric, offering a seamless data movement experience from any source to any destination. Whether you need batch or incremental copying, it provides the flexibility to meet diverse data needs while maintaining a simple and intuitive workflow.
We continuously refine Copy job based on customer feedback, enhancing both functionality and user experience. In this update, we’re introducing several key improvements designed to streamline your workflow and boost efficiency.
Click through to see what’s new.
Comments closedMiquella de Boer has an announcement:
Shortcut transformations is a new capability in Microsoft Fabric that simplifies the process of converting raw files, starting with .CSV files, into Delta tables. This feature eliminates the need for traditional ETL pipelines, enabling users to transform data directly on top of files with minimal setup.
Click through to see how it all works.
Comments closed