Generative AI in the Enterprise (2023-12-02 DBW)

Database Weekly for December 2, 2023 Problems displaying this newsletter? [View online](. [Database Weekly]( The Complete Weekly Roundup of SQL Server News by SQLServerCentral.com Hand-picked content to sharpen your professional edge Editorial  The Fake Speakers In the last few weeks, I've seen a few posts on social media from event organizers. The theme has been "we won't make up AI speakers", which I thought was some sort of joke about AI being used to write, and perhaps, deliver a presentation. After all, we're a long way from Max Headroom, and with all the AI stuff happening, maybe an AI actor could present something to an audience. It wasn't a joke and [the conference in question has been cancelled](. Apparently, the organizer said he generated a fake woman's profile with AI after a woman dropped out. He says this was a placeholder, which is possible, but it's not something I'd do at an event. I'd just note there is a hole in the speaker schedule and I was looking for someone else. There are also claims that previous conferences included fake profiles or profiles of women who dropped out or declined to speak. A number of tech speakers and execs dropped out of the conference after this news. There are quite a few people who look at the list of speakers and if there is not enough diversity, they may decide not to attend. There are even corporate policies at some companies that note that they don't support events that haven't made efforts to include a diverse set of speakers. I get that someone might struggle to get a diverse set of speakers (or employees), and despite their efforts, they end up with a homogenous group of people. I've seen this happen, and I know that timing, travel, topic, etc. sometimes mean that a session could end up with all men (or all women). It's unfortunate, but it happens. I also know that plenty of people don't want to disclose that they are considered someone of "diversity," which makes it hard for organizers to plan their schedule. However, I don't get putting fake profiles up on a site. Those aren't placeholders, those are deceitful actions that want to generate some publicity or hide the fact someone chose not to participate. It's the same when a speaker withdraws, though I know that updating the website with a cancellation sometimes doesn't take precedence. Speaking is a burden, it costs money, and at many events, I've seen speakers cancel for various reasons, including the need for them to be at work instead. Especially at more general events, like some of the DevOps conferences that choose managers to speak, I'm somewhat shocked at all the cancellations written on boards outside of conference rooms. The age of digital everything, with the added capabilities of AI, mean that I find myself trusting lots of "data" less and less. The images, videos, and especially text can, and often is, manipulated by someone for their own purposes. I'm not surprised at all the outrage and conspiracy views of the world when any sort of information can be faked. As someone who's tried hard to ensure data quality, as do most data professionals, it's disturbing to see the trend. I'm equally disturbed by the constant calls of fake news, not because facts are in dispute, but because someone doesn't like facts. There is fake news, there is bias and slant, and there is a difference of opinion, but I hope that most data professionals do their best to ensure the data they have is correct. After that, I hope people using that data do so honorably, without trying to deceive others by making something up. Steve Jones - SSC Editor [Join the debate, and respond to the editorial on the forums](  The Weekly News All the headlines and interesting SQL Server information that we've collected over the past week, and sometimes even a few repeats if we think they fit. AI/Machine Learning/Cognitive Services [Introduction to Azure OpenAI]( From Hasan Savran       AI is a widely discussed topic, an... [Video: What Does Azure ML Actually Give Us?]( From 36 Chambers – The Legendary Journeys THE VIDEO THE SYNOPSIS In this video, I answer a viewer question about what Azure ML provides for people who are already familiar with each step of the machine... [Generative AI in the Enterprise]( From O'Reilly Radar - Insight Generative AI has been the biggest technology story of 2023. Almost everybody’s played with ChatGPT, Stable Diffusion, GitHub Copilot, or Midjourney. A few have even tried out Bard or... [Causal Machine Learning for Creative Insights]( From Netflix TechBlog - Medium A framework to identify the causal impact of succe... Administration of SQL Server [PREEMPTIVE Waits in SQL Server]( From Callihan Data Have you ever been reviewing SQL Server waits and ... [Extended Events in Azure Data Studio]( From SQLServerCentral Blogs I know I can use extended events (xevents) in Azur... [SQL Server Cumulative Updates (CU) through the end of calendar year 2023]( From MS SQL Server Blog SQL Server 2022 RTM has completed one year after SQL Server GA release last November. Per the Modern Servicing Model Announcing the Modern Servicing Model for SQL Server -... [When an update doesn't update]( From SQLBlog.org I discuss reasons you might think a data change was successful when it wasn't - or vice-versa. [Write to backup block blob device failed. Device has reached its limit of allowed blocks.]( From SQL Undercover Picture this, you’re happily backing up your database to a Azure blob storage until suddenly it starts mysteriously failing with the error… Write to backup block blob device https://******... [Write to backup block blob device failed. Device has reached its limit of allowed blocks.]( From SQLServerCentral Blogs Picture this, you’re happily backing up your database to a Azure blob storage until suddenly it starts mysteriously failing with the error… Write to backup block blob device https://******... The... Azure Databricks, Spark and Snowflake [ORDER BY in Spark – How Global Sort Is Implemented, Sampling, Range Rartitioning and Skew]( From Large-Scale Data Engineering and Analytics in Cloud Global sorting is one the most important operations on data, and it is not only used to define how you can see the query result in UI but more... Azure SQL [Monitoring Azure TDE and Customer Keys. We're watching you Bill]( We really need to monitor so that we know what is going on, and more importantly, what is going on before our customers and bosses do. From this, we can then take actions, (preferably proactively) effectively swooping in and saving the day, albeit silently to our customers if we get it right. [Lesson Learned #455:Optimizing Connection Pooling for Application Workloads: Exploring Login Rates]( From Azure Database Support Blog We have a client asking us what the login rate per second is that I can achieve on a S0, S1, S2, and S3 database. It's a complicated question... Career, Employment, and Certifications [Tech Pros Quitting Over Salary Stagnation, Stress]( From IT Pro - Microsoft Windows Information, Solutions, Tools To retain top tech talent, organizations must look beyond financial compensation to provide growth opportunities and wellbeing. [Job Description of a DBA]( From SQLServerCentral Blogs I have curated the list of activities of a DBA or one can say Job Description of a DBA. DBA needs to adapt and keep learning new technologies The... The... Cloud - AWS [Getting started with new Amazon RDS for Db2]( From AWS News Blog I am pleased to announce that IBM and AWS have come together to offer Amazon Relational Database Service (Amazon RDS) for Db2, a fully managed Db2 database engine running... Computing in the Cloud (Azure, Google, AWS) [Hybrid Cloud Challenges and How to Avoid Them]( From Dataversity Hybrid cloud solutions are indispensable in achieving a balance between data security, scalability, and innovation for banking, fintech, artificial intelligence (AI), and machine learning (ML) industries. These sectors encounter... Conferences, Classes, Events, and Webinars [PostgreSQL Events – A Newbies Perspective: #PGSQLPhriday 014]( From SQLServerCentral Blogs For this month’s #PGSQLPhriday 014 blogging even... [My Post PASS Data Community Summit Thoughts]( From Deb the DBA It’s more than a week post PASS Data Community Summit and I’m finally getting around to sharing my thoughts. Personally, I had a blast. I was part of a... DMO/SMO/Powershell [How to Remove an Item From a PowerShell Array]( From IT Pro - Microsoft Windows Information, Solutions, Tools Learn two methods – an easy way and a hard way �... Data Privacy, Compliance, and Governance [The Emergence of Corporate Data Governance]( From Dataversity Within corporations, the theme of governance has been one of the most important themes for decades. Scholars have discussed and debated how corporations can be governed in order to... Data Visualisation [how to avoid the “Christmas tree effect”]( From Storytelling with Data  ... ETL/SSIS/Azure Data Factory/Biml [Warehouse Load Patterns – Part 1 – Requirements and General Patterns]( From Simple Talk No matter the ETL tool used, there are some basic patterns to follow when transferring data between systems. There are many data tools and platforms, but the basic patterns... Hardware [Best Portable SSDs: Holiday 2023]( From AnAndTech Once the domain of external, bus-powered hard drives, these days the market for external storage has been almost completely consumed by portable SSDs. Rapid technological advancements in NAND flash... MDX/DAX [IF, SWITCH And The Effect Of DAX Variables On Strict/Eager Evaluation]( From Chris Webb's BI Blog A lot of DAX performance problems relate to the use of strict and eager evaluation with the IF or SWITCH functions. It’s an incredibly complex, “it depends”, black-box type... Microsoft Fabric ( Azure Synapse Analytics, OneLake, ADLS, Data Science) [Fabric and Tabular Editor]( In my time working with Advancing Analytics, I’ve continued to use it with Databricks lakehouses and have even developed our own solution accelerator with Tabular Editor to get people up and running with Power BI semantic models on the lakehouse fast. [Testing Microsoft Fabric - Part 3]( From Jeff Taylor Sorry to disappoint you. In this post, we won't te... [Services that I recommend when working with Microsoft Fabric]( From Kevin Chant Reading Time: 4 minutes In this post I want to co... [Let’s look at using some PySpark in your first Microsoft Fabric Notebook]( From Guy in a Cube Not sure about Notebooks or PySpark in Microsoft F... [The future of customer understanding through Microsoft Fabric]( From Data – Marc In the many conversations I had over the past year... [Microsoft Fabric: Extended Source Control Features]( From Simple Talk The source control features in Microsoft Fabric are evolving every day. The PBIP feature included in Power BI allowed us to include source control on a SDLC process for... [An easy way to transform/clean your data using a Notebook in Microsoft Fabric]( From FourMoo In this blog post I am going to show you an easy way to clean your data (which is often fixing data issues or mis-spelt data) using the new... [Microsoft Fabric: Capacity Cost Management Part 2, Automate Pause/Resume Capacity with Azure Logic Apps]( From BI Insight In the previous blog post, I explained Microsoft Fabric capacities, shedding light on diverse capacity options and how they influence data projects. [Updates about Database Projects for Microsoft Fabric]( From Simple Talk comp A few weeks ago, I wrote a blog about Database Projects for Microsoft Fabric. It’s an interesting advance, but it was disappointing because it was only available in... [Fabric ride-along Week 1 – Reviewing the data]( From SQLGene – Learning SQL Slowly This is week 1 where I try to take Magic the Gathering draft data to learn Microsoft Fabric. Check out week 0 for some reasoning why. So, before I... [Spreading your SQL Server wings with Microsoft Fabric Data Warehouses]( From Kevin Chant Reading Time: 8 minutes In this post I want to cover spreading your SQL Server wings with Microsoft Fabric Data Warehouses. As part of a series of posts... Oracle/PostgreSQL/MySQL/other RDBMS [Unlocking Secure Connections: A Guide to PostgreSQL Authentication Methods]( Authentication is the process of verifying the identity of a user or system attempting to access a database. In the realm of PostgreSQL, authentication serves as the first line of defense, ensuring that only authorized individuals or applications gain entry. As the gateway to sensitive data, robust authentication is imperative, safeguarding against unauthorized access and fortifying the foundation of data protection. In this blog, we delve into the significance of authentication in PostgreSQL, unraveling its critical role in securing valuable information. Performance Tuning SQL Server [Optimizing SQL Server Query Plans With Row Count Spools In Them]( From Erik Darling Data Optimizing SQL Server Query Plans With Row Count S... [Indexing for substring search]( From SQLSunday A question from a client got me thinking. Relational databases (at least the ones I know and love) can’t really index for queries that use LIKE queries for a substring of a column value. If you want to search for strings beginning with a given string, a regular rowstore index will have you covered. If you’re looking for entire words or sentences, a full text index might be a good call. But because of the very way indexes work, you’ll never get great performance searching for just arbitrary parts of a string. [Optimizing Complex SQL Server Queries By Using Batch Mode]( From Erik Darling Data Optimizing Complex SQL Server Queries By Using Batch Mode  Going Further If this is the kind of SQL Server stuff you love learning about, you’ll love my training.... [Anatomy of a Window Function Execution Plan]( From Andy Broadsword After last week’s post I got to thinking that although we’ve looked at how to implement window functions, we haven’t peeked under the hood to see how they are executed. Then... [Optimizing SQL Server Query Plans With Table Spools In Them]( From Erik Darling Data Optimizing SQL Server Query Plans With Table Spools In Them  Going Further If this is the kind of SQL Server stuff you love learning about, you’ll love my... [Solving Date Range SQL Server Query Performance Issues with OPTION RECOMPILE]( From MSSQL Tips In this article, I demonstrate the issue of creating two SQL Server indexes to enhance performance, but the query optimizer only chooses one which doesn't help with performance. [Optimizing Common Table Expression Queries In SQL Server]( From Erik Darling Data Optimizing Common Table Expression Queries In SQL Server  Going Further If this is the kind of SQL Server stuff you love learning about, you’ll love my training. I’m... PowerPivot/PowerQuery/PowerBI [(Livestream Replay) Introducing Inforiver Analytics+ in Power BI (with Gopal)]( From Havens Consulting  [Area Chart in Power BI to Understand Data Changes Over Time]( From MSSQL Tips Learn how to create an area chart in Power BI to understand the intensity of a change and cumulative total values over time along with the different available formatting... [Power BI to Power AI – Part 3]( From Adatis This post is the third part of a blog series on the AI features of Power BI. Part 1 described three generally available AI features in Power BI: forecasting,... Product Reviews and Articles [Code Visibility: Browsing through Flyway Migration Files]( From Product learning – Redgate Software If you can convert a SQL file to HTML, then you ca... [SQL Prompt Tips–Using $surroundtext$ in a Snippet]( From SQLServerCentral Blogs A user on the SQL Community Slack was asking about what the $surroundtext$ variable. This post looks at how this can be used in snippets. This is part of... The... Product Upgrades and Releases [Announcing the new Amazon S3 Express One Zone high performance storage class]( From AWS News Blog The new Amazon S3 Express One Zone storage class i... [General Availability: Azure NetApp Files support for 2 TiB capacity pools]( From Azure Updates Azure NetApp Files now supports smaller 2 TiB capacity pool sizes, lowered from 4 TiB, when used with volumes using standard network features. [Analyze large amounts of graph data to get insights and find trends with Amazon Neptune Analytics]( From AWS News Blog I am happy to announce the general availability of Amazon Neptune Analytics, a new analytics database engine that makes it faster for data scientists and application developers to quickly... [Vector search for Amazon DocumentDB (with MongoDB compatibility) is now generally available]( From AWS News Blog Today, we are announcing the general availability of vector search for Amazon DocumentDB (with MongoDB compatibility), a new built-in capability that lets you store, index, and search millions of... [Vector engine for Amazon OpenSearch Serverless is now available]( From AWS News Blog Today we are announcing the general availability of the vector engine for Amazon OpenSearch Serverless with new features. In July 2023, we introduced the preview release of the vector... [Automatic restore testing and validation now available in AWS Backup]( From AWS News Blog Performing automatic game day testing of all your critical resources is an important step in determining that you are prepared to respond to ransomware or any data loss event.... Python [Python – Image Processing with OpenCV]( From Journey to SQL Authority with Pinal Dave OpenCV provides a comprehensive set of tools and algorithms for image processing, allowing you to easily manipulate and enhance images. First appeared on Python – Image Processing with OpenCV [Building Data Apps with Python’s Streamlit]( From Adatis Off-the-shelf solutions for interactive data app development such as Microsoft Power BI are great – they allow users to easily develop data apps using a GUI. However, Power BI’s... R Language [Understanding and Implementing Robust Regression in R]( If you’re familiar with linear regression in R, you’ve probably encountered the traditional lm() function. While this is a powerful tool, it might not be the best choice when dealing with outliers or influential observations [Unveiling the Magic of LOESS Regression in R: A Step-by-Step Guide with mtcars]( If you’ve ever found yourself grappling with noisy data and yearning for a smoother representation, LOESS regression might be the enchanting solution you’re seeking. In this blog post, we’ll unravel the mysteries of LOESS regression using the power of R, and walk through a practical example using the iconic mtcars dataset. [Little useless-useful R functions – How to make R-squared useless]( From TomazTsql Uselessness is such a long useless word! In statistics, R-squared is a statistical measure, that determines the proportion of variance in dependent variable that can be explained by the... SQL Server News [An Oracle feature I want in SQL Server]( From SQLBlog.org While I've very rarely been jealous of Oracle, 23c added something I really want in SQL Server. SQL Server on Linux [SQL Server Quickie #46 – SQL Server on Linux]( From SQLServerCentral Blogs Today I have uploaded SQL Server Quickie #46 to Yo... Security News and Issues [Breaking Laptop Fingerprint Sensors]( From Schneier on Security They’re not that good: Security researchers Jesse D’Aguanno and Timo Teräs write that, with varying degrees of reverse-engineering and using some external hardware, they were able to fool the Goodix... Software Development [All of Netflix’s HDR video streaming is now dynamically optimized]( From Netflix TechBlog - Medium by Aditya Mavlankar, Zhi Li, Lukáš Krasula and Christos BampisHigh dynamic range (HDR) video brings a wider range of luminance and a wider gamut of colors, paving the way for... [Comparing Two Scripts with kdiff3]( From SQLServerCentral Blogs I had a customer recently ask if SQL Compare could show them the differences in two scripts they’ve written. They weren’t using version control (tsk, tsk, shame), but saw... The... T-SQL and Query Languages [Set-Based vs Row-Based Database Code]( From DallasDBAs.com  [Mixing Grouping and Window Functions]( From Andy Broadsword We revisited window functions last week for T-SQL Tuesday. As we’re in that area there’s another example I thought was worth exploring. Can we group data whilst applying window functions in the same query? [SQL SERVER – T-SQL Fortune Cookies]( From Journey to SQL Authority with Pinal Dave Fortune cookies contain uplifting messages that bring a smile after a good meal. Did you know they likely originated in America, not China? First appeared on SQL SERVER – T-SQL... Tech News [Broadcom Layoffs Officially Above 2,100 Post-VMware Deal]( From IT Pro - Microsoft Windows Information, Solutions, Tools  [At GitHub Universe, Copilot Takes Center Stage, but Questions About the Platform Persist]( From IT Pro - Microsoft Windows Information, Solutions, Tools GitHub needs to convince non-developers that its p... [Developer Conference Axed After Fake Female Profiles Outcry]( From IT Pro - Microsoft Windows Information, Solutions, Tools Engineering leaders previously withdrew from DevTernity before the conference was canceled after the event organizer was accused of faking panelists to boost diversity. Testing Software [What is subsetting, what are the advantages, and how does it make test data management easier?]( From Simple Talk As data grows and databases become larger and more complicated, data subsetting provides a method of working with a smaller, lighter copy of a database to make development and testing faster and easier. In this article, James Hemson poses the questions; what exactly is data subsetting, how and why are developers using it – or not using it, and what’s prompting conversations about it? The Lighter Side [Making an image with generative AI uses as much energy as charging your phone]( From Technology Review Feed - Tech Review Top Stories Each time you use AI to generate an image, write a... [Using ThinOptics to Read Data]( From SQLServerCentral Blogs As I’ve aged, I find myself struggling to read m... [A New Word: Nighthawk]( From SQLServerCentral Blogs nighthawk – n. a recurring thought that only see... Tools for Dev (SSMS, ADS, VS, etc.) [SQL Server Management Studio improvements for Always Encrypted]( From Azure SQL A couple of months ago we released a new version o... [Amazon CodeWhisperer offers new AI-powered code remediation, IaC support, and integration with Visual Studio]( From AWS News Blog Today, we’re announcing the general availability of artificial intelligence (AI)-powered code remediation and infrastructure as code (IaC) support for Amazon CodeWhisperer, an AI-powered productivity tool for the IDE and... Virtualization and Containers/Kubernetes [Navigating SQL Server High Availability in Kubernetes for Improved Performance]( From Dataversity There’s a compelling rationale for SQL Server no...  [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. Note: This is not the SQLServerCentral.com daily newsletter list, and unsubscribing to this newsletter will not stop you receiving the SQL Server Central daily newsletters. If you want to be removed from that list, you can follow the instructions on the daily newsletter. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -