Press "Enter" to skip to content

Month: February 2021

Visualizing Infrastructure with Terraform Graph

Published 2021-02-10 by Kevin Feasel

Jonathan D’Aloia shows how we can visualize Terraform-based infrastructure with diagrams:

As can be seen from the image above we have every resource that is defined in the Terraform code that is to be deployed. At a first glance, it does appear that not all the information here is of such relevance, for example, the metadata referring to registry or root provider. However, if we look away from this we can begin to see how the Infrastructure model is going to look once it has been deployed.

We can see that we have one resource group called “example” which has an Azure SQL Server and also an Azure Storage account also both called “example” and that all of these resources directly link to the resource group. I would also point out that you can also see that Azure SQL database directly links to the SQL server giving a clear indication of which databases belong to which server.

Click through for an example as well as the process.

Comments closed

Tools for SQL Server Specialists

Published 2021-02-10 by Kevin Feasel

Chris Yates shares a list of useful tools:

Throughout my career, I’ve worked for companies that have allowed me to utilize some pretty nice tools. Whether they are vendor or community-related there are a plethora of options for all platforms and prices.

Some of the ones that I have a special place for can be found here, but I’ll specifically name a few below:

Click through for a structured approach to tooling.

Comments closed

Tools of the Trade

Published 2021-02-10 by Kevin Feasel

Mikey Bronowski shares some tool recommendations:

The main tool that I use every day is one I couldn’t live without: Todoist. For work related tasks, personal tasks, and just organizing life in general, Todoist is a to do list app that I’ve relied on to keep my sanity. If I think of something I need to do it immediately goes in the Misc category and I schedule it later. If I think of a blog post idea, it goes in the Ideas column of the Blog Topics category (and if it’s deemed a good idea will eventually go onto To Do, In Progress, and Complete). The free version has more than enough for my needs but if you want additional features or are trying to use it with a team there is a paid version available.

I’m a big fan of Todoist for reminding me what to do, as well as calendar entries for structure and making sure I limit my todo list size.

Mikey also provides great advice: create your own tools. They don’t have to be fancy, so long as they solve relevant problems.

Comments closed

Time-Saving Tips for Databricks

Published 2021-02-09 by Kevin Feasel

Robert Blackburn has a few tips for us:

Adding bigger or more nodes to your cluster increases costs. There are also diminishing returns. You do not need 64 cores if you are only using 10. But you still need a minimum that matches your processing requirements. If your utilization looks like this, you must increase the size of your cluster.

Click through for several good tips.

Comments closed

Technical and Productivity Tools

Published 2021-02-09 by Kevin Feasel

Steve Jones shares some tooling recommendations:

It’s blog party week for T-SQL Tuesday, and I think this is a good choice for a topic. The host this month is Mikey Bronowski, and his invitation is on tools. I work for a tools vendor, and I’ve used a lot of them in my life, so I want to share what I think in 2021. I’ll also say that Mikey has a good list in his invitation of what he uses. I especially like his use of PoSh things and Greenshot.

I’ve going to tackle this in a couple ways as I really have two parts of my job here, so I’ll look at tech tools and then productivity tools.

Read on for Steve’s list.

Comments closed

Statistics and Ascending Keys

Published 2021-02-09 by Kevin Feasel

Matthew McGiffen looks at a common problem with statistics:

The Ascending Key Problem relates to the most recently inserted data in your table which is therefore also the data that may not have been sampled and included in the statistics histograms. This sort of issue is one of the reasons it can be critical to update your statistics more regularly than the built-in automatic thresholds.

We’ll look at the problem itself, but also some of the mitigations that you can take to deal with it within SQL Server.

Click through for more detail.

Comments closed

Community Tooling for SQL Server

Published 2021-02-09 by Kevin Feasel

John McCormack reviews several community tools for SQL Server:

Statistics Parser is a web page which allows you to paste in the statistics time,io output from the SSMS messages tab, and it formats into neat tables showing how much IO happens for each table. It is immediately easier to read and you get a handy % column on the right hand side showing you which tables are being read the most. I find this really useful for query tuning because it lets me know where my biggest pain points are. For complex queries, which touch a lot of tables, it just makes it easy to see at a glance where you should initially focus your attention. It also shows worktable and workfile tables which serves as a handy hint that tempdb is in play.

John lists a half-dozen but really drives in on Statistics Parser.

Comments closed

Useful Tools for Blogging and Productivity

Published 2021-02-09 by Kevin Feasel

Eitan Blumin shares some recommendations of tools:

While I do feel that the tools that make my job the most awesome are those that help me with productivity, this month’s topic is a bit broader. Most of these, though, are widely known, so I’m not going to go into much detail about them.

Click through for Eitan’s suggestions. I use the majority of these (or at least some alternative) but there are some new and interesting ones for me.

2 Comments

Connecting Confluent and Databricks on Azure

Published 2021-02-08 by Kevin Feasel

Angela Chu, et al, take us through a streaming data ingestion process:

How do you process IoT data, change data capture (CDC) data, or streaming data from sensors, applications, and sources in real time? Apache Kafka® and Azure Databricks are widely adopted technologies in the industry, but they require specific skills and expertise to run. Leveraging Confluent Cloud and Azure Databricks as fully managed services in Microsoft Azure, you can implement new real-time data pipelines with less effort and without the need to upgrade your datacenter (or set up a new one).

This blog post demonstrates how to configure Azure Databricks to interact with Confluent Cloud so that you can ingest, process, store, make real-time predictions and gain business insights from your data.

Click through for a detailed demonstration.

Comments closed

Secure Cluster Connectivity in Azure Databricks

Published 2021-02-08 by Kevin Feasel

Abhinav Garg and Premal Shah have an announcement:

We’re excited to announce the general availability of Secure Cluster Connectivity (also commonly known as No Public IP) on Azure Databricks. This release applies to Microsoft Azure Public Cloud and Azure Government regions, in both Standard and Premium pricing tiers. Hundreds of our global customers including large financial services, healthcare and retail organizations have already adopted the capability to enable secure and reliable deployments of the Azure Databricks unified data platform. It allows them to securely process company and customer data in private Azure Virtual Networks, thus satisfying a major requirement of their enterprise governance policies.

Read on fore more detail about how this works.

Comments closed