A Fine Slice Of SQL Server
The Hadoop in Real World team has two methods of finding free space in HDFS:
It is a quite common need to find the available free space in HDFS. There are a couple of ways to find this information.
If you are using a cluster manager like Ambari or Cloudera Manager then you can go to the HDFS service and see this information in the summary section.
Click through for an image of that, as well as a command line technique.
Comments closedBryan Smith and Rob Saker share a pattern:
Disruptions in the supply chain – from reduced product supply and diminished warehouse capacity – coupled with rapidly shifting consumer expectations for seamless omnichannel experiences are driving retailers to rethink how they use data to manage their operations. Prior to the pandemic, 71% of retailers named lack of real-time visibility into inventory as a top obstacle to achieving their omnichannel goals. The pandemic only increased demand for integrated online and in-store experiences, placing even more pressure on retailers to present accurate product availability and manage order changes on the fly. Better access to real-time information is the key to meeting consumer demands in the new normal.
In this blog, we’ll address the need for real-time data in retail, and how to overcome the challenges of moving real-time streaming of point-of-sale data at scale with a data lakehouse.
It’s a cool scenario, at the least.
Comments closedDaniel Hutmacher builds a cloudless deployment pipeline:
I did some googling to see just how simple I could make a database deployment pipeline. I keep the DDL scripts in a git repository on the local network, but I can’t use Azure DevOps or any other cloud service, and I don’t have Visual Studio installed, so the traditional database project in SSDT that I know and love is unfortunately not an option for me.
So I googled a little, and here’s what I ended up doing.
Click through to see how Daniel was able to do it.
Comments closedKenneth Fisher fixes a problem:
One of the things I hate most about using remote desktop is when the resolution for the remote server is way off what the size of my window is. You end up with the scroll bars on the side and bottom of the screen and spend half your time moving the screen around so that you can find what you need. Open Notepad, scroll to the top of the screen so you can save it, then scroll to the bottom of the screen so you can switch to the Excel spreadsheet that’s hidden by the Notepad window, etc.
It turns out there is an easy setting that forces the resolution to match the window size. Even if you end up with really weird window sizes.
My fix historically was to use mRemoteNg, which did this for you.
Comments closedIonut Ilascu reports on a vulnerability:
Microsoft has fixed a vulnerability in Azure Container Instances called Azurescape that allowed a malicious container to take over containers belonging to other customers on the platform.
An adversary exploiting Azurescape could execute commands in the other users’ containers and gain access to all their data deployed to the platform, the researchers say.
This is fixed now, but it’s a good reminder that platform-as-a-service offerings can still have security problems (as we’ve also seen recently with Power Apps and Cosmos DB).
Comments closedErik Darling continues a series on interesting wait stats:
Hash spills are, as we’ll see, sometimes identified by a different wait than sort spills. In small quantities, spills are often not worth bothering with. But when they pile up, they can really cause some severe performance issues.
In this post, I want to show that both Hash Aggregate and Joins can cause the same wait type to show, along with some evidence that strings make things worse.
Click through for a good explanation of the wait stat you’re liable to see the most.
Comments closedAngela Henry wraps up a series:
Welcome to the final installment of our Azure Purview Series, focusing on Purview Data Map. The Purview Data Map is the foundation for data discovery and serves as the jumping-off point for all things data source related. It is the cloud-native platform-as-a-service (PaaS) that collects the metadata about your data sources and runs the scans to keep your metadata up to date.
Click through to see what’s available in Data Map and information on how to kick off and view scans.
Comments closedSoheil Bakshi gives us two methods to pad those numbers:
There are some cases that we want to add a leading zero to a digit, such as showing 01 instead of 1, 02 instead of 2 and so on. We have two options to do this in Power BI, doing it in Power Query or doing it with DAX.
Click through for the two methods, and for a bonus item which incidentally bolsters the argument that dates should be YYYY-MM-DD.
Comments closed