Database Mirroring is Back in Azure SQL Database (2024-03-31 DBW)

Database Weekly for March 31, 2024 Problems displaying this newsletter? [View online](. [Database Weekly]( The Complete Weekly Roundup of SQL Server News by SQLServerCentral.com Hand-picked content to sharpen your professional edge Editorial  Database Mirroring is Back in Azure SQL Database [Database mirroring]( was a cool feature in SQL Server 2005. I guess it's still a feature, though it's listed as deprecated in the documentation. There is still a mirroring dialog in the SSMS database properties dialog in more recent versions of SQL Server, but I don't know if there is a good reason to use mirroring over Availability Groups. That's why I was surprised to see a public preview announcement of [Azure SQL Database Mirroring to Microsoft Fabric announcement](. Apparently you can easily move Azure SQL Database data to Fabric and have it written to Delta Parquet tables in OneLake. No ETL, no need to do the data conversion yourself, or at least not much of an effort. I suspect you still need to understand this and do some configuration for how your Parquet files will get written. If you go through the documentation, it's interesting (and annoying) to me that the docs keep saying replication. I hate when we've overloaded terms as mirroring and replication mean specific things in SQL Server, so I wish they would use some other term (copy, extract, ??) to describe what is happening. Whether this is useful to analytic workloads remains to be seen. I am curious what the people working with Fabric think of this feature. I wonder if this is useful, or if this might cause headaches or performance issues. Since this feature is in preview, I doubt anyone knows yet, but it will be interesting to see how this compares with Synapse Link and if it is more or less helpful. Moving data around for different purposes has always been a challenge. I know that some people might feel the costs involved in this aren't worth it. I know a lot of technical people that would say "I could do that." I have no idea what they costs are. but I know that a lot of people have spent a lot of hours managing ETL packages and adjusting them as schemas change and new requirements appear. I get the appeal of Synapse Link and this new Mirroring to Fabric features. I do wish this type of feature was more solidly built into the SQL Server instance. I suspect it will come at some point, and it's being tested and baked in Azure first. However, I hope that if/when it comes, that the feature has good tooling and some polish to its operation. We've had too many features in SQL Server that are partially built, with limited tooling, and a lack of performance characteristics that many of us would desire. Steve Jones - SSC Editor [Join the debate, and respond to the editorial on the forums](  The Weekly News All the headlines and interesting SQL Server information that we've collected over the past week, and sometimes even a few repeats if we think they fit. AI/Machine Learning/Cognitive Services [US requiring new AI safeguards for government use, transparency]( The White House said Thursday it is requiring federal agencies using artificial intelligence to adopt "concrete safeguards" by Dec. 1 to protect Americans’ rights and ensure safety as the government expands AI use in a wide range of applications. [Musk's Grok-1.5 AI chatbot to be available next week]( Elon Musk's artificial intelligence startup xAI's latest Grok-1.5 chatbot will be available on his social media platform X next week, the billionaire said in a post on X on Friday. [AI hallucinates software packages and devs download them – even if potentially poisoned with malware]( Simply look out for libraries imagined by ML and make them real, with actual malicious code. No wait, don't do that Administration of SQL Server [Leave it better than you found it]( At a previous gig, we had multiple dedicated jump boxes, and they’d have a dozen active or idle sessions at any given time. This made patching the jump boxes problematic, especially for shared client tools everyone always left open, like Management Studio, Visual Studio Code, the PowerShell ISE, and (yes) Notepad. And worse, it became everyone’s dumping ground for everything they needed to get into the data center, from patches and ISOs to JSON config files and Excel spreadsheets. So, I thought I would share some thoughts on how I’ve gotten better at using RDP, in an effort to leave no trace. Azure SQL [Public Preview: Azure SQL updates for late-March 2024]( From Azure Updates Public preview enhancements and updates released for Azure SQL in late-March 2024. Career, Employment, and Certifications [Vote for Workplace of the Year: Startups employ various methods in their commitment to culture]( Respect. Inclusion. Satisfaction. Employee-centric. Our judges for the Workplace of the Year category at the 2024 GeekWire Awards used a number of different words and phrases to describe what makes [Thoughts about gaining the Fabric Analytics Engineer Associate certification]( From Kevin Chant Reading Time: 2 minutes In this post I want to co... Cloud - AWS [AWS Weekly Roundup — Savings Plans, Amazon DynamoDB, AWS CodeArtifact, and more — March 25, 2024]( From AWS News Blog AWS Summit season is starting! I’m happy I will meet our customers, partners, and the press next week at the AWS Summit Paris and the week after at the... Cloud - Azure [Introducing Copilot in Azure SQL Database (Private Preview) | Data Exposed]( From Azure SQL In this episode of Data Exposed, we'll unveil new Copilot features in Azure SQL Database (Private Preview), designed to boost productivity for both database administrators and developers. Join us... [Public Preview: Next generation of general purpose service tier for Azure SQL Managed Instance]( From Azure Updates The next generation of general purpose service tie... [Public Preview: Azure SQL Database Mirroring in Microsoft Fabric]( From Azure Updates Mirroring Azure SQL Database provides an easy experience to continuously replicate SQL DB data directly into Microsoft Fabric. [General availability: Migration service in Azure Database for PostgreSQL]( From Azure Updates Seamlessly migrate PostgreSQL to Azure using a managed service for complete schema and data transfers, hassle-free. [Announcing GA of Advance Maintenance Notifications for Azure SQL Database]( From Azure SQL  We are pleased to announce the GA release of Advance Maintenance Notification for Azure SQL Databases.   What is advance maintenance notifications? Working along-side SQL Maintenance Windows, Advance planned notifications feature allows you... [Public preview: Maintenance window support for Azure SQL Database Hyperscale elastic pools]( From Azure SQL We are pleased to announce that the Hyperscale elastic pools preview now also supports configuring a specific maintenance schedule to use for a pool. This makes impactful maintenance events... [GA: Azure SQL Trigger support for Azure Functions]( From Azure Updates You can now build application logic in Azure Function apps which can be driven by the data from Azure SQL database Conferences, Classes, Events, and Webinars [Webcast: How to Secure SQL Server – End to End Security]( From SQLServerCentral Blogs On April 16, 2024, I will be giving another webcast; this one will be on SQL Server security. Sign up link As always, the registration is free. Here’s the... The... [Connect, share and learn at PASS Data Community Summit 2024]( Connect, share and learn with peers and thought leaders while celebrating all things data for a week of learning and networking opportunities. Join us on site in Seattle this November to watch hundreds of sessions from industry leaders spanning a huge range of topics and technologies. Previous speakers have included Bob Ward, Kimberley Tripp, Brent Ozar, Deborah Melkin, Kevin Kline and Steve Jones. Registration for PASS Data Community Summit 2024 (November 4-8) is officially open! Guarantee your place at the best possible price by taking advantage of launch pricing (closes May 7 at 11:59 PM PT). [SQLBits 2024- It’s Not Just a Wrap, It’s the Whole Burrito!]( From DBAKevlar So, this last week I had the opportunity to speak ... [SQL Down Under show 87 with guest Ronen Arierly discussing the importance of SQL Server internals is now published!]( From The Bit Bucket Today, another SQL Down Under show is published! T... [Apr 9 Webinar: Accelerating Success: De-risking and Streamlining Releases with Flyway Enterprise]( From SQLServerCentral Blogs UPDATE: This moved to Apr 9 Join me Tuesday, Apr 9 for a webinar, 10:00am CDT. You can register here and then come watch live with questions or get... The... [Atlanta Microsoft BI Group Meeting on April 1st (Real-Time Analytics with Microsoft Fabric: Unlocking the Power of Streaming Data)]( From Prologika (Teo Lachev's Weblog) Atlanta BI fans, please join us in person for the next meeting on Monday, April 1st at 6:30 PM ET. Aravinth Krishnasamy (Principal Architect at Ecolab) will provide an... [Join me In Boston May 10 For A Full Day Of SQL Server Performance Tuning Training]( From Erik Darling Data Spring Training This May, I’ll be presenting my full day training session The Foundations Of SQL Server Performance Tuning. All attendees will get free access for life to my... [Ryan Booz: PostgreSQL CFP PASS Data Community Summit]( From Planet Postgres The CFP for the 2024 PASS Data Community Summit is currently open, and we need you! Hosted in Seattle from November 4-8, we want to encourage even more participation... DMO/SMO/Powershell [Automating BCP with PowerShell]( I was talking with a good friend that has an environment with terabytes of information and to create a homolog or dev environment to him is a pain. He comes to me with a solution: a PowerShell script that gets only the first 1000 lines of each table, creates the inserts and schema files and runs in another server. I said to him. It´s crazy. We already have a solution that does that, BCP. So why not automate BCP? He agreed with me and then this article is how we did that. [PowerShell: How To Generate a Random Password (Revised Script)]( From IT Pro - Microsoft Windows Information, Solutions, Tools This revised PowerShell script provides improved functionality, adaptability, and interactivity compared to its predecessor. Learn how the script works. Data Privacy, Compliance, and Governance [Cloud server host Vultr rips user data licensing clause from ToS amid web 'confusion']( We know the average customer doesn't have a law degree, CEO tells us Data Science [What is Neural Thompson Sampling (NeuralTS)?]( From Statistical Odds & Ends Neural Thompson Sampling (NeuralTS) was introduced by Zhang et al. (2021) (Reference 1) as a way to introduce Thompson sampling (TS) to neural network prediction models. In this post,... [Using the Laplace method to approximate the posterior distribution of neural network parameters and outputs]( From Statistical Odds & Ends In this previous post, we described how the Laplac... Hardware [Western Digital Ships 24TB Red Pro Hard Drive For NASes]( From AnAndTech Nowadays highest-capacity hard drives are typically aimed at cloud service providers (CSPs) and enterprises, but this does not mean that creative professionals or regular users do not need them.... Microsoft Fabric ( Azure Synapse Analytics, OneLake, ADLS, Data Science) [Announcements from the Microsoft Fabric Community Conference]( From SQLServerCentral Blogs (Shameless plug: The price of my book “Deciphering Data Architectures: Choosing Between a Modern Data Warehouse, Data Fabric, Data Lakehouse, and Data Mesh” has dropped on Amazon to its... The... [Creating a Mirrored Azure SQL Database in Fabric]( From FourMoo Creating a Mirrored Azure SQL Database in Fabric This week they announced Announcing the Public Preview of Database Mirroring in Microsoft Fabric | Microsoft Power BI Blog | Microsoft... [Deployment Pipelines in Power BI and Fabric]( From Purple Frog Systems Deployment Pipelines in Power BI and Fabric were released in public preview way back in May 2020 and then made Generally Available in September 2020. Even with how long... [Creating a Single JSON File for Configuration using Notebooks]( From Simple Talk On the blog Fabric Notebook and Deployment Pipelines I explained a technique to keep notebooks configuration values in JSON files on lakehouses, a good solution from many different points... Oracle/PostgreSQL/MySQL/other RDBMS [David Wheeler: PGXN v2: Go or Rust?]( From Planet Postgres TL;DR: I’d like Postgres community input on a decision: Should we build PGXN v2 services and tools in Go or Rust? Context for the question and some weighing of... [Functions and Procedures: Learning PostgreSQL with Grant]( One of the most useful constructs in SQL Server is the stored procedure. It gives you a way to do several things. They truly are a useful tool. So, of course, I went straight to CREATE PROCEDURE in PostgreSQL, but I was suddenly hit with a revelation: procedures can’t return result sets. What the heck do we do to return results? Thankfully, Ryan Booz pointed me in the right direction, CREATE FUNCTION. We have functions in SQL Server. They are of course scalar, table valued or multi-statement table values (AKA, sort of evil). However, they’re not that similar in form or function to SQL Server’s procedures, so what’s going on in PostgreSQL? Performance Tuning SQL Server [Join Algorithm Limitations In SQL Server]( From Erik Darling Data Join Algorithm Limitations In SQL Server Going Further If this is the kind of SQL Server stuff you love learning about, you’ll love my training. I’m offering a 75%... PowerPivot/PowerQuery/PowerBI [Copilot for Power BI: Your Ultimate Copilot Guide]( From Guy in a Cube Have you used Copilot for Power BI? Do you know th... [Explosion Vs Erosion for Stacked Charts in Power BI!]( From Havens Consulting Video by: Reid HavensLearn about a recently released feature for Power BI that lets you choose how to add spaces between stacked chart categories. Either by "Exploding" or "Eroding"... [Introducing EXPAND and COLLAPSE for visual calculations in Power BI]( From SQLBI Introduction to the two basic visual context navigation functions in DAX: EXPAND and COLLAPSE. There functions are used in Power BI visual calculations. [Best Practices For Power BI On Databricks Webinar]( From Chris Webb's BI Blog I recently took part in a webinar with Denny Lee, Liping Huang and Marius Panga from Databricks on the subject of best practices for using Power BI on Databricks.... Product Reviews and Articles [The Flyway Migrate Command Explained Simply]( From Product learning – Redgate Software The 'Migrate' command automates the process of applying the database schema changes that are defined in migration scripts, while Flyway tracks the version of every copy of the database.... [Book Review: 100 SQL Server Mistakes]( From SQLServerCentral Blogs I was approached by Manning Publications and asked... Python [Aircraft Route Analysis]( In November, I wrote a post on analysing aircraft position telemetry with adsb.lol. At the time, I didn't have a clear way to turn a series of potentially thousands of position points for any one aircraft into a list of flight path trajectories and airport stop-offs. R Language [Mastering the map() Function in R: A Comprehensive Guide]( Whether you’re a novice or a seasoned R programmer, mastering map() can significantly streamline your workflow and enhance your code readability. In this guide, we’ll delve into the syntax, usage, and numerous examples to help you harness the full power of map(). [R dtplyr: How to Efficiently Process Huge Datasets with a data.table Backend]( In a world where compute time is billed by the second, make every one of them count. There are zero valid reasons to utilize a quarter of your CPU and memory, but achieving complete resource utilization isn't always a straightforward task. That is if you don't know about R dtplyr. [Little useless-useful R functions – Reverse Hello World]( From TomazTsql You know the feeling after long vacation and final... SQL Server News [Discontinuation of DBCC CLONEDATABASE for production use]( From Microsoft SQL Server Blog The use of DBCC CLONEDATABASE to create a copy of schema for production is being discontinued. Security News and Issues [Oh Snap! Canonical now doing manual reviews for new packages due to scam apps]( After repeatedly suffering issues with scam apps making it onto the Snap Store, Canonical maker of Ubuntu Linux have now decided to manually look over submissions. [PostgreSQL pioneer's latest brainchild promises time travel to dodge ransomware]( Michael Stonbraker on the neat side effects of putting an operating system on top of a database [10 Essential Measures To Secure Access Credentials]( From IT Pro - Microsoft Windows Information, Solutions, Tools In the face of evolving cybersecurity threats, use these 10 security measures to reduce the risk of unauthorized access and strengthen cyber resilience. Software Development [Automotive computer chip maker NXP rolls out new platform]( NXP (NXPI.O), opens new tab Semiconductors NV, the biggest maker of computer chips for cars, on Thursday said it had introduced a new platform that will simplify and speed up software development for its customers. [YOU CAN SAY THAT AGAIN!]( From Daily WTF In a first for me, this week we got FIVE unique submissions of the exact same bug on LinkedIn. In the spirit of the theme, I dug up a couple of unused submissions of older problems at LinkedIn as well. I guess there are more than the usual number of tech people looking for jobs. [EXCEPTIONAL STRING COMPARISONS]( From Daily WTF As a general rule, I will actually prefer code that is verbose and clear over code that is concise but makes me think. I really don't like to think if I don't have to. [Never Retire]( From Daily WTF We all know that 2038 is going to be a big year. In a mere 14 years, a bunch of devices are going to have problems. [Farewell .NET 7, support ends in May - we hardly knew you]( Standard Term Support means only 18 months before retirement [Software Development for the Education Sector: What Coders Need to Know]( From IT Pro - Microsoft Windows Information, Solutions, Tools Educational institutions have unique requirements for software development. Here's what developers focusing on the education sector must provide with their software solutions. [Why Test-Driven Development? (Part 2)]( As discussed in Part 1, by segregating our focus on developing code that behaves as expected from the focus on developing code that will be well structured, we have achieved the ability to eliminate wasteful and error prone manual chores. That by itself is a really big win, and I often use that aspect of TDD as a “I rest my case” argument in support of embracing TDD. But there is much more goodness coming our way as we continue mastering the TDD process. Let’s first look into the difficulties we’re facing when attempting to modify the code. [Video: Going with the GitHub Flow]( From 36 Chambers – The Legendary Journeys THE VIDEO THE SYNOPSIS In this video, cover the GitHub flow. We talk a bit about branching strategies and how GitHub development ought to look in a multi-developer situation.... T-SQL and Query Languages [Correlated Subqueries in SQL]( I’ve recently been brushing up on my SQL skills, as I’ve used the language for a while but less so recently. Through this process, I’ve found that I’m comfortable with the topics of complex joins, Common Table Expressions (CTEs), and nested subqueries. [Constructing Dynamic SQL with Parameters]( From Andy Broadsword When building dynamic SQL, safety is crucial. As we saw last week, we have the QUOTENAME function which can help when referencing object names. Another aspect to consider is use of parameters. Integrating... [The How To Write SQL Server Queries Correctly Cheat Sheet: INTERSECT And EXCEPT]( From Erik Darling Data Who Am I Kidding? I have never once seen anyone use these. The most glaring issue with them is that unlike a lot of other directives in SQL, these... [Pagination and ordering by large values]( From Simple Talk Pagination is a technique for limiting output. Think of Google search results, shopping the electronics category on Amazon, or browsing tagged questions on Stack Overflow. Nobody could consume all... [Pagination and ordering by large string values]( From SQLBlog.org I talk about a technique that can avoid expensive sorting to paginate by large string values. Tech News [Michigan nuclear plant aims to be first ever to reopen in US]( The Palisades Nuclear Plant won a $1.5B conditional federal loan to reopen. Plant owner Holtec aims to move fast — but the path ahead is murky. [Algorithms can aid price collusion, even if no humans actually talk to each other, US enforcers say]( The Department of Justice and Federal Trade Commission filed a statement of interest in a case alleging Atlantic City hotels colluded on prices through their use of a common algorithm. [Apple dismisses Microsoft monopoly comparisons]( The iPhone maker is coming out swinging following the recent DOJ suit [How a tiny 4-person startup, Supaglue, caught Stripe’s eye]( In Stripe’s annual letter, the company discussed several fast-growing areas, one of them being the “Revenue and Finance Automation” unit. Those are tools that help businesses manage billing, tax and revenue recognition. Stripe’s RFA unit will reach a $500 million annual run rate this year, the company said. [Global smartphone market set to rebound in 2024, report says]( Global smartphone shipments are expected to rebound 3% this year as easing inflation aids a demand recovery in emerging markets and the integration of generative AI attracts buyers to premium devices, a report by Counterpoint Research said on Thursday. [20 years of Gmail]( Gmail revolutionized email with fast search and a whole gigabyte of storage. But where’s it headed next? [First the Super Bowl, now this: Kansas City getting a Google bit barn]( Exact location, power source, and go-live date unknown. But don't worry, there'll be digital jobs [Microsoft Creates Tools to Stop Users From Tricking Chatbots]( From IT Pro - Microsoft Windows Information, Solutions, Tools Microsoft's Copilot recently generated weird and harmful responses, prompting new defenses to spot and block suspicious activity. [10 Best AI Collaboration Tools 2024]( From Past News - RSS Feeds AI collaboration tools revolutionize how teams can boost productivity, improve efficiency, and streamline communication. Check out our best picks. The post 10 Best AI Collaboration Tools 2024 appeared first on... [4 steps to improve root cause analysis]( Teams that follow observability standards, use monitoring tools, and foster a culture of collaboration can more quickly discover the root cause of system outages and performance issues. [Stay or Go? Navigating Tech Investment Decisions Amid Never-Ending M&A Activity]( From IT Pro - Microsoft Windows Information, Solutions, Tools This five-step guide will help organizations decide whether to continue with a vendor post-acquisition or switch to a new provider. The Lighter Side [AI could make better beer. Here’s how.]( From Technology Review Feed - Tech Review Top Stories Crafting a good-tasting beer is a difficult task. Big breweries select hundreds of trained tasters from among their employees to test their new products. But running such sensory tasting... [[Video] Office Hours: The Long One]( From Brent Ozar Unlimited You posted a lot of great questions at and I spent almost an hour covering these: Here’s what we covered: 00:00 Start 02:05 Kulstad: I’m using Ola Hallengren’s... Tools for Dev (SSMS, ADS, VS, etc.) [SSMS 20 and Central Management Server Connections]( From Callihan Data I had an issue querying servers with Central Manag...  [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. Note: This is not the SQLServerCentral.com daily newsletter list, and unsubscribing to this newsletter will not stop you receiving the SQL Server Central daily newsletters. If you want to be removed from that list, you can follow the instructions on the daily newsletter. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -