Let's Talk Expertise

Database Weekly for June 1, 2024 Problems displaying this newsletter? [View online](. [Database Weekly]( The Complete Weekly Roundup of SQL Server News by SQLServerCentral.com Hand-picked content to sharpen your professional edge Editorial  On Being an "Expert" I had the opportunity last week to present a session at [DataSaturdays Stockholm](. I can't say enough nice things about the event and the organizers. I presented on Query Store in SQL Server. In my mind, it's an entry-level to middle tier presentation. Most of the room was already working with Query Store, some quite extensively. To say I was a little surprised they'd come to hear me give a mid-level talk was an understatement. Happily, there was a lot of engagement from the audience. Fantastic questions. So good were the questions, that a few times, my answer was a pretty simple, "I don't know." Yeah, yeah. I'm supposed to be an "expert." I helped write[a book on Query Store](. So that means I know it all, right? Nope. In fact, I picked up a couple of bits of information from the event. I even had one of the attendees contact me afterwards to share some more information I didn't know. What the heck kind of "expert" does that make me? A pretty normal one. Without naming names, there was a moment once when I was standing next to one of THE experts on SQL Server. I mean a person that most of us know their name, for good reason. Another individual came up and asked a question. No details because I don't want anyone feeling embarrassed. Their response was "I don't know." Now, remember, I'm standing right next to them and I did know the answer. I actually thought it was an easy question. I was flabbergasted. This person was an expert. This person was one of the THE experts. I honestly just thought they knew pretty much everything. Yet, they simply didn't. No one does. So, while I know I let down a couple of people at the event in Stockholm because I wasn't able to answer their questions, I honestly don't feel too bad about it. I mean sure, I'd rather help than not. I'd rather have the answer than not. But I know full well, I don't know everything. I also know, however much I am considered to be an "expert," there are people out there who know a lot more than I do. They've spent more time and have dived deeper. They haven't written books and don't fly around the world teaching, but they sure as heck are experts on the topic. With all that in mind, my answer will sometimes be "I don't know." So I bring this up for two reasons. First, don't be surprised when the "expert" you counted on doesn't have all the answers. Second, don't beat yourself up because you don't have all the answers. None of us do. Just remember, my favorite definition of an expert is a person who is one page ahead of you in a book. They know more than you, right now. But you can catch up and pass them, making you the expert. Grant Fritchey [Join the debate, and respond to the editorial on the forums](  The Weekly News All the headlines and interesting SQL Server information that we've collected over the past week, and sometimes even a few repeats if we think they fit. AI/Machine Learning/Cognitive Services [Copilot Reminded Me How To Find a File Handle]( From SQLServerCentral Blogs Recently I was trying to delete a folder and kept ... [What We Learned from a Year of Building with LLMs (Part I)]( From O'Reilly Radar - Insight It’s an exciting time to build with large langua... [Industry- and AI-focused cloud transformation]( From Technology Review Feed - Tech Review Top Stories For years, cloud technology has demonstrated its a... [12 Key AI Patterns for Improving Data Quality (DQ)]( From Dataversity AI is the simulation of human intelligence in mach... [Why Google’s AI Overviews gets things wrong]( From Technology Review Feed - Tech Review Top Stories MIT Technology Review Explains: Let our writers un... [What We Learned from a Year of Building with LLMs (Part II)]( From O'Reilly Radar - Insight A possibly apocryphal quote attributed to many leaders reads: “Amateurs talk strategy and tactics. Professionals talk operations.” Where the tactical perspective sees a thicket of sui generis problems, the operational perspective... [The Download: Google’s AI Overviews nightmare, and improving search and rescue drones]( From Technology Review Feed - Tech Review Top Stories This is today’s edition of The Download, our w... Administration of SQL Server [SQL Server Management Studio 20 New Features and Functionality]( From MSSQL Tips Learn about some of the new features and functiona... [Snake draft sorting in SQL Server, part 4]( From Simple Talk In the previous posts in this series (part 1, part... [What happens when we drop a column on a SQL Server table? Where's my space?]( From SQLServerCentral Blogs This article was initially posted on SQLServerCent... [Reasons to Match Datatypes #39 - Table Partitioning]( From SQL Rod Ok, so I may have exaggerated and jumped a few just slightly with the numbering there for effect, but they all matter. Assume a heavily... [Lesson Learned #497:Understanding the Ordering of uniqueidentifier in SQL Server]( From Azure Database Support Blog Today, I worked on a service request that our customer asked about how SQL Server sorts the uniqueidentifier data type. We know that uniqueidentifier store globally unique identifiers (GUIDs).... [Encrypt and safeguard your SQL Server database backups]( From MSSQL Tips Learn about best practices to safeguard your SQL S... [Dynamic SQL Server stored procedure execution form in SSMS]( From MSSQL Tips Execute a stored procedure from SSMS and pass in p... [Upgrading SQL Server databases and changing compatibility levels]( From MSSQL Tips To take advantage of new features in SQL Server, u... [Lesson Learned #498:Understanding the Role of STATMAN in SQL Server and Its Resource Consumption]( From Azure Database Support Blog Today, I worked on a service request that our customer reported a performance issue and they reported that this query: SELECT StatMan([SC0], [LC0], [SB0000]) FROM (SELECT TOP 100 PERCENT [SC0],... Analysis Services / BI on the MS Stack [SQLBI+ updates in May 2023]( From SQLBI In 2023, we released the first draft of the Window... [Find the label of a variable in SAS]( From AllAnalytics Sometimes labels for variables get "dropped" durin... Azure SQL [Azure SQL DB standby replica is now generally available | Data Exposed]( From Azure SQL Learn more about enabling disaster recovery for Azure SQL Database at a lower cost using standby replica which does not incur license costs. Standby replica is Generally Available (GA).  Watch... Azure SQL Managed Instance [Azure Managed Instance SQL 2022 Update Policy. Well that potentially sucks.]( From SQL Rod Ah, SQL 2022, the release that finally brought box... Cloud - AWS [Optimized for low-latency workloads, Mistral Small now available in Amazon Bedrock]( From AWS News Blog Mistral Small, an efficient large language model, ... [AWS Weekly Roundup: LlamaIndex support for Amazon Neptune, force AWS CloudFormation stack deletion, and more (May 27, 2024)]( From AWS News Blog Last week, Dr. Matt Wood, VP for AI Products at Am... [Amazon EC2 high memory U7i Instances for large in-memory databases]( From AWS News Blog Unleash unparalleled power with U7i instances: up ... Computing in the Cloud (Azure, Google, AWS) [Public Cloud Spending 'to Eclipse the $1 Trillion Mark': Gartner]( From IT Pro - Microsoft Windows Information, Solutions, Tools Public cloud adoption is soaring, Gartner says. Fi... [How Changes to Cloud Egress Fees May — or May Not — Help You Save Money]( From IT Pro - Microsoft Windows Information, Solutions, Tools To truly optimize cloud data costs, organizations should adopt an analytics-based approach to data management. Data Mining / Data Analysis [Identifying time delays in batch manufacturing for accurate anomaly detection]( From AllAnalytics Batch manufacturing involves producing goods in ba... [Securing Data in Transit for Analytics Operations]( From Dataversity Most enterprises today store and process vast amo... Data Visualisation [Calculating data for visualization on stacked 100% bar]( From TomazTsql Calculating cumulative percentage or percentage per group for each time can sometimes be a task with a slight twist. Let’s check this with ggplot2 and tidyverse. Three (out of... Database Design, Theory and Development [Data Logistics Mandates: Devising a Plan to Ensure Long-Term Data Access]( From Dataversity Microsoft 365 has become the nucleus for many orga... DevOps and Continuous Delivery (CI/CD) [Why Your Business Needs Data Modeling and Business Architecture Integration]( From Dataversity In the contemporary business environment, the inte... ETL/SSIS/Azure Data Factory/Biml [Building a framework for orchestration in Azure Data Factory: Recap]( From MARTIN'S BLOG Frameworks are extremely useful when they are thou... Microsoft Fabric ( Azure Synapse Analytics, OneLake, ADLS, Data Science) [On-premises data with Data Factory in Microsoft Fabric]( From Guy in a Cube Do you have on-premises data like a SQL Server? Wa... [One Way to Invoke Fabric Data Factory Pipelines Using the Fabric REST API]( From AndyLeonard.blog() I’m an automation weenie, that’s a fact. It’... Oracle/PostgreSQL/MySQL/other RDBMS [Deepak Mahto: Code Conversion Chronicles – Trigger Order of processing in Oracle to PostgreSQL Migration.]( From Planet Postgres Database triggers allow encapsulation of multiple ... [semab tariq: Monitoring Replication Lag with PEM in Multi-Master Cluster]( From Planet Postgres Learn how to monitor replication lag in a PostgreS... [Laurenz Albe: Why do I have a slow COMMIT in PostgreSQL?]( From Planet Postgres © Laurenz Albe 2024 Sometimes one of our c... [Maintaining Query Folding when Merging with Different Data Types]( From Havens Consulting Video by: Reid HavensLearn how to maintain your qu... [Francesco Tisiot: Helping PostgreSQL® professionals with AI-assisted performance recommendations]( From Planet Postgres Since the beginning of my journey into the data wo... [Florent Jardin: An assistant to copy data from a remote server]( From Planet Postgres During the last PGSession organized by Dalibo, I w... [Umair Shahid: Protecting Personally Identifiable Information in PostgreSQL: A Critical Requirement for Financial Organizations]( From Planet Postgres Protect personally identifiable information (PII) ... [semab tariq: Setting Up a High Availability 3-Node PostgreSQL Cluster with Patroni on Ubuntu 24.04]( From Planet Postgres Learn how to set up a high-availability 3-node Pos... [Greg Nokes: Data Encryption in Postgres: A Guidebook]( From Planet Postgres When your company has decided it's time to invest ... [Optimizing MySQL: Deleting Data]( In the previous parts of these MySQL optimization series, we told you how query optimization works on a high level, then walked you through how you should optimize queries that insert, read, or update data. Remember the laws of physics? “What goes up, must come down”? Translated into database terms, that means “the data that is inserted, will (sometimes, eventually) need to be deleted.” In the last part of these MySQL optimization series, we will tell you how you should go about optimizing queries that delete data. Performance Tuning SQL Server [Lesson Learned #494: High number of Executions Plans for a Single Query]( From Azure Database Support Blog Today, I worked on a service request where our cus... [Profiling Query Performance In SQL Server With Extended Events The Easy Way]( From Erik Darling Data Profiling Query Performance In SQL Server With Ext... [A Query Writing And Tuning Exercise: Finding Duplicate Post Titles In Stack Overflow]( From Erik Darling Data ErikGPT I’m going to be totally open and honest with you, dear reader: I’ve been experimenting with… AI. See, I’m just a lonely independent consultant, and sometimes it’s just... [Replace SQL Cursors with Set Based Operations Including OUTPUT and MERGE]( From MSSQL Tips In this article, we look at various ways to avoid ... PowerPivot/PowerQuery/PowerBI [Dynamically refreshing (historical) partitions in Power BI Incremental Refresh Semantic Models using Fabric Semantic Link]( From Data – Marc I’ve heard the question pretty often from custom... [Install Power BI Desktop the RIGHT WAY! (2024)]( From Guy in a Cube Want to get started with Power BI but not sure how... [PowerBI premium capacity administration: dataset monitoring and tuning]( Over the years Power BI has evolved into a complex and varied ecosystem of tools and solutions, which in its turn demands several supporting roles: there are, of course, developers, data engineers and data scientists, but there is need for one more, i.e. a capacity administrator. Of course some of these roles may be covered by one person, but the roles are distinct in their nature as well. Professional Development [How important is having great soft skills as a Software Engineer for personal growth and career…]( From SQLServerCentral Blogs How important is having great soft skills as a Sof... [Why the masters and what lies ahead]( From SQLServerCentral Blogs I recently graduated with a Master’s in Strategi... [Some Frank Thoughts About Newsletters]( From AndyLeonard.blog() “We need to talk.” Actually, we don’t need t... [On-Prem vs. Private Cloud: What's the Difference?]( From IT Pro - Microsoft Windows Information, Solutions, Tools Defining on-prem vs. private cloud can be tricky due to varying interpretations and implementation practices, leading to blurred lines between the two concepts. [How to Get Executive Buy-In for IT Projects]( From IT Pro - Microsoft Windows Information, Solutions, Tools Executives often lack a deep technical background,... [Quick Reference Guide for Software for Development]( From IT Pro - Microsoft Windows Information, Solutions, Tools Modern software development is a complex, multi-fa... [Top 7 Programming Languages for IT Engineers to Learn]( From IT Pro - Microsoft Windows Information, Solutions, Tools  Security News and Issues [LevelBlue’s Theresa Lanowitz on New Trends in Cybersecurity]( From Past News - RSS Feeds I spoke with Theresa Lanowitz, Chief Evangelist at... [Ping Identity’s Patrick Harding on Preventing Identity Fraud]( From Past News - RSS Feeds I spoke with Patrick Harding, Chief Product Architect at Ping Identity, about how companies can prevent identity fraud in today’s AI-driven enterprise environment. As an identity and access management... [Crucial Cybersecurity Skills for Today's IT Pros]( From IT Pro - Microsoft Windows Information, Solutions, Tools  [Building a serverless secured dead drop]( From Ayende @ Rahien I ran into this fascinating article (I wrote anot... [Intel 471’s Brandon Hoffman on Operationalizing Threat Intelligence]( From Past News - RSS Feeds I spoke with Brandon Hoffman, Chief Strategy Officer at Intel 471, about the challenges and advantages of operationalizing threat intelligence. A core focus for Intel 471 is providing threat... T-SQL and Query Languages [New T-SQL Enhancements in SQL Server 2022 | Data Exposed: MVP Edition]( From Azure SQL Not yet up to speed on all the new T-SQL Enhancements available in SQL Server 2022 and Azure SQL Database? Want to learn nine new capabilities in just nine... [Snake draft sorting in SQL Server, part 2]( In my previous post, I showed how to borrow a snake draft concept from fantasy football, or a packing technique from the shipping industry, to distribute different portions of a workload to run in parallel. In the previous example, we determined a distribution order for databases based on size – though you can rank by literally any attribute (or combination of attributes). Once we’ve determined how to build out this order, we may want to store that data somewhere because, sometimes, the source of that data is not directly accessible. Tech News [Linux in the Metaverse: Building Virtual Worlds With Open-Source Tools]( From IT Pro - Microsoft Windows Information, Solutions, Tools Explore how Linux-based platforms and tools are sh... [Driving IT Projects: The Value of the Project Management Officer]( From IT Pro - Microsoft Windows Information, Solutions, Tools Project management officers can be a valuable resource as organizations take on complex, transformational projects, offering guidance and leadership. The Lighter Side [Structure is Structure]( From Daily WTF Back in the heady days of the DotCom Bubble, start... [What Cybersecurity Memes Reveal About the Industry]( From IT Pro - Microsoft Windows Information, Solutions, Tools Cybersecurity memes do more than entertain — they offer insights into the industry. This article examines five memes from the r/CybersecurityMemes/ subreddit, each highlighting different aspects of the field. Theory and Design [The CHECK() Constraint]( One of the many ways a relational table differs from the file structures used by pre-relational storage systems is that the tables, rows and columns can have constraints on them. This allows you to reduce the types of bad data that can be loaded into your tables. This lets the database do a lot of the work that you would’ve had to do an application code in the old days (and current times when using file-based storage). Virtualization and Containers/Kubernetes [How to Create Kubernetes Deployments and Services using YAML files and Kubectl]( From Simple Talk This article is about how to create Kubernetes Dep...  [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. Note: This is not the SQLServerCentral.com daily newsletter list, and unsubscribing to this newsletter will not stop you receiving the SQL Server Central daily newsletters. If you want to be removed from that list, you can follow the instructions on the daily newsletter. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -