A Fine Slice Of SQL Server
After a lengthy period in Public Preview it seems, the boffins at Microsoft have finally pushed Elastic Jobs for SQL Azure DB to general availability. Hooray!
But what are Elastic Jobs? And why would I want to use them in SQL Azure DB?
That’s one of the things you’ll learn in this post.
Comments closedPavel Borisov explains the importance of vacuuming your tables:
By default, all table data in Postgres are physically stored using the “heap” method. So every database is a set of 1Gb files (”segments”) and each file is logically split into 8Kb pages. Actual table rows are put into any page with enough free space.
When the row data is updated, a new version of a whole row is constructed and written (to any free space). The old one remains because, at the time of the update, the transaction is not completed and can be rolled back in the future. When the transaction is completed we’ll have two or several versions of the same row in the table. Cleaning old ones is by an asynchronous process called vacuum (and autovacuum).
Read on for more information about how this works and what you can (or should) do to help it along.
Comments closedSteven Sanderson performs feature selection:
As an R programmer, one of the fundamental tasks you’ll encounter is manipulating data frames. Whether you’re cleaning messy data or preparing it for analysis, knowing how to drop unnecessary columns is a valuable skill. In this guide, we’ll walk through the process of dropping columns from data frames in R, using simple examples to demystify the process.
Read on for three ways of doing this.
Comments closedMike Robbins shows off one feature of gh cli:
Checking out someone else’s pull request (PR) on GitHub is essential in collaborative software development, enabling thorough code reviews, local testing, and detailed feedback. This process allows developers to ensure the quality and functionality of the code before integration, identify and resolve potential conflicts, and maintain consistency across the project. By reviewing changes locally, team members can collaborate more effectively, offering insights and improvements that enhance the overall quality of the project. Additionally, local reviews support security audits and performance evaluations, ensuring that the code is not only functional but also optimized and secure.
I don’t use gh cli as much as I should (in part because 95+ percent of the time, I’m committing into one-man repos and use GitHub Desktop), but every time I do use it, I remember that it’s a nice CLI.
Comments closedDavid Seis shares tips from an upcoming talk:
PowerShell is an essential tool for SQL Server database administrators looking to streamline their workflow and automate repetitive tasks. When it comes to troubleshooting your SQL Server instances, PowerShell is an essential tool for the DBA toolbox.
As a versatile scripting language and command-line shell, PowerShell enables seamless integration of commands, arguments, variables, and modules with an interface and logic that SQL users would find pleasantly familiar. This blog post will guide you through the basics of PowerShell, demonstrate how to implement simple automation for routine database tasks, and explore advanced automation strategies to optimize your database management.
The post starts as a basic primer on Powershell but also includes plenty of notes on good ways to make use of the language as a DBA.
Comments closedErik Darling has Blondie stuck in my head:
The OR operator is a perfectly valid one to use in SQL statements. If you use an IN clause, there’s a reasonable chance that the optimizer will convert it to a series of OR statements.
For example,
IN(1, 2, 3)could end up being= 1 OR = 2 OR = 3without you doing a darn thing. Optimizers are funny like that. Funny little bunnies.The problem generally isn’t when asking for IN or OR for a single column, with a list of literal values, the problem is usually when you:
- Use OR across multiple where clause columns
- Use OR in a join clause of any variety
- Use OR to handle NULL parameters or variables
This is an excellent, detailed article and well worth the read.
Comments closedAndrew Pruski shows off Docker Build Cloud:
In a previous blog post we went through how to build a Docker container image from a remote (Github) repository.
Here we’re going to expand on that by actually building the image itself remotely, using Docker Build Cloud.
What we can do with Docker Build Cloud is instead of building the image locally and then having to push to a remote container registry (for example the Docker Hub), we can build remotely and then immediately push that image to the registry so that it is available for immediate use by say, our team members or deployment/testing pipelines.
Read on to see how it works.
Comments closedSteven Sanderson searches for subsets:
In data analysis, there often arises a need to extract the top N values within each group of a dataset. Whether you’re dealing with sales data, survey responses, or any other type of grouped data, identifying the top performers or outliers within each group can provide valuable insights. In this tutorial, we’ll explore how to accomplish this task using three popular R packages: dplyr, data.table, and base R. By the end of this guide, you’ll have a solid understanding of various approaches to selecting top N values by group in R.
Read on for the three examples.
Comments closedRuss Hyde shares items of interest:
R 4.4.0 (“Puppy Cup”) was released on the 24th April 2024 and it is a beauty. In time-honoured tradition, here we summarise some of the changes that caught our eyes. R 4.4.0 introduces some cool features (one of which is experimental) and makes one of our favourite {rlang} operators available in base R. There are a few things you might need to be aware of regarding handling
NULLandcomplexvalues.The full changelog can be found at the r-release ‘NEWS’ page and if you want to keep up to date with developments in base R, have a look at the r-devel ‘NEWS’ page.
Read on for a big note on tail-call recursion, an operator for coalescing, and a few more neat features.
Comments closedCamilo Reyes shows off an interface:
The
IAsyncEnumerableinterface was introduced to address the limitations of theIEnumerableinterface and theTaskclass. This way, you can stream asynchronous data and process it efficiently as soon as it becomes available.In this take, you will learn how to work with
IAsyncEnumerableto asynchronously stream a big table and extract the data in a ETL process. You will also learn the difference betweenIAsyncEnumerableandIEnumerableand how to useIAsyncEnumerablein your everyday work. Then, you will look at comparisons between the two different approaches and why one is better than the other in certain scenarios.
Read on for a demonstration and dive into how IAsyncEnumerable implementations compare to IEnumerable in terms of memory utilization.