Manage OneLake Storage With PowerShell - Data Engineering with Fabric (2024-07-10)

SQLServerCentral Newsletter for July 10, 2024 Problems displaying this newsletter? [View online](. [SQL Server Central]( Featured Contents - [Manage OneLake Storage With PowerShell - Data Engineering with Fabric]( - [Redgate recommended in Bloor Test Data Management market update]( - [Docker Logging Guide Part 1: Basic Concepts and Importance]( - [From the SQL Server Central Blogs - Create a copy of an Azure SQL DB]( - [From the SQL Server Central Blogs - Exploring Windows Function Execution Plans]( - [Pro Encryption in SQL Server 2022: Provide the Highest Level of Protection for Your Data]( Question of the Day - [Reducing Backup and Restore History]( The Voice of the DBA  The Stretch Database Retirement Stretch Database is finally going away. It is being retired. It was deprecated on Nov 16, 2022, from SQL Server 2022. Effective Jul 9, 2024, the supporting Azure service is retired. I saw this in [an announcement on Jul 3]( though I hope anyone using this service has been seeing lots of reminders over the last couple of years. I know I'm getting MySQL retirement notices for one of my services and need to migrate some workloads this month. If you tried this service, you might have realized that the pricing didn't make sense for most of us. If you hadn't tried it, it worked by moving some of the data in your tables into Azure, where it could be queried if needed. It was an interesting idea, though most of us would have wanted this to work between two SQL Server instances, not between SQL Server on-premises and Azure. In any case, if you're on an older version of SQL Server, the recommendation is that you bring your data back on-premises. If you have SQL Server 2022, they recommend CETaS ([Create External Table as Select]( which lets you query data in Azure storage. This lets you put some data in text formats and query it as needed, reducing the use of expensive relational storage disks. Parquet is the recommended format here. There's also a weird mention of Fabric in the announcement, which doesn't seem to fit with the objective of the rest of article. I haven't worked with this enough to know how well this performs or what patterns might fit here. I do know that reducing the queries from clients, especially SELECT * and unbounded queries across all your data helps. If your clients always want to query all data in a table, then nothing works well. Building systems that query hot data by default, and filter away from warm/cold data is always helpful. Having some good indexing is also important. I don't know of anyone that uses Stretch Database, so I'm not sure how many people are affected here, but I hope they knew about this before Jul 9. Steve Jones - SSC Editor [Join the debate, and respond to today's editorial on the forums](   Featured Contents [SQLServerCentral Article]( [Manage OneLake Storage With PowerShell - Data Engineering with Fabric]( John Miner from SQLServerCentral Learn how to manage files and folders in Microsoft Fabric with PowerShell. [External Article]( [Redgate recommended in Bloor Test Data Management market update]( Additional Articles from Redgate Last year, Redgate announced the launch of their latest in test data management (TDM) technology – Redgate Test Data Manager. This year, they’re proud to have been recommended in Bloor’s 2024 Test Data Management Market Update! This paper highlights the increasing adoption of TDM technology among enterprise organizations and offers insight into the trends and approaches to look out for when looking for a TDM solution. [External Article]( [Docker Logging Guide Part 1: Basic Concepts and Importance]( Additional Articles from SimpleTalk Docker has gained popularity as a containerization platform that allows you to develop, deploy, and execute applications faster. It packages applications and their dependencies into standardized entities known as containers. These containers are lightweight, portable, and capable of operating independently. [Blog Post]( From the SQL Server Central Blogs - [Create a copy of an Azure SQL DB]( hellosqlkitty from SQLKitty Where I work, we will be migrating data from one set of databases into another. I will be making a copy of the destination databases to allow us to... [Blog Post]( From the SQL Server Central Blogs - [Exploring Windows Function Execution Plans]( Grant Fritchey from The Scary DBA There are quite a few different ways that you’re likely to see windows functions evidence themselves within your execution plan. Let’s take a look at one example. Windows Function... [Pro Encryption in SQL Server 2022]( [Pro Encryption in SQL Server 2022: Provide the Highest Level of Protection for Your Data]( Additional Articles from SQLServerCentral This in-depth look at the encryption tools available in SQL Server shows you how to protect data by encrypting it at rest with Transparent Data Encryption (TDE) and in transit with Transport Level Security (TLS). You will know how to add the highest levels of protection for sensitive data using Always Encrypted to encrypt data also in memory and be protected even from users with the highest levels of access to the database. The book demonstrates actions you can take today to start protecting your data without changing any code in your applications, and the steps you can subsequently take to modify your applications to support implementing a gold standard in data protection.   Question of the Day Today's question (by Steve Jones - SSC Editor):  Reducing Backup and Restore History How do I easily reduce the old data contained in the backup and restore tables in the msdb database? Think you know the answer? [Click here]( and find out if you are right.    Yesterday's Question of the Day (by Steve Jones - SSC Editor) The First Day of the Week If I run this, what day is the first day of the week? SET DATEFIRST 1 Answer: Monday Explanation: This returns Monday, regardless of the language. Ref: DATEFIRST - [ [Discuss this question and answer on the forums](    Database Pros Who Need Your Help Here's a few of the new posts today on the forums. To see more, [visit the forums](. --------------------------------------------------------------- SQL Server 2017 - Administration [side effects of giving permissions to run traces]( - Hi All, I would like to know the downsides of giving permissions to run traces in lower environments (DEV/QA/UAT). Our DB team has only two members: one supports PST hours, and the other supports IST hours. The PST resource is on leave for a month, so I have to cover both time zones as needed. […] [Select permission denied despite group having db_datareader]( - I am at a loss and could use a second pair of eyes. We have a Server with database A and database B, a windows security group (MyDom\MyGroupName) which is created with dbo schema as its default in both databases, and a service account in this group. MyDom\MyGroupName has db_datareader in both databases. There are […] SQL Server 2017 - Development [Split fields sql 2017]( - I am trying to split fields in sql 2017. The column holds the following. I am pulling the first 50 characters and now I need to split those into 2 fields. This is a test name1             3006       […] SQL Server 2016 - Administration [connection does not open from SSMS]( - Dear Friends, Would be grateful if anybody can advise why one of my servers, doesnt allow a connection anymore from SSMS on my terminal. The IP address is the unchanged. SQL server port was changed I remember, that i am anyways providing in with the IP as IP:portnumber..Thanks in advace. [How to improve index rebuild for very large table.]( - My online index rebuild job for a 200G table with 40mil rows took me up to 30hrs to complete, this is a once off activity done since we have an allocated downtime for server maintenance. I would want to know, is there any way for me to do it faster? I had an idea of […] SQL 2012 - General [SQL code needed for the WHERE clause..]( - I have a table with data appending on a daily basis. We plan to keep the set of data in this table for one full year and delete everything after August 1st of every year. I am stuck with the query logic to do this. The situations are like this: If today's date is August […] SQL Server 2019 - Administration [Database growth report by full back file and send by email in graph and or html]( - Hello Gurus, How I am in need of all databases growth in 10 instance and send the report by an email. What's the best way to accomplish such task. If anyone has scripts or point me to a website that would be very helpful. thanks in advance. [Backuips are failing]( - After CU 27 update in sql 2019 backups are failing and all mainnaytainence jobs are also faling . we did not find any error on sql logs , pls assist on ho wto resolve this  Message Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility Version 15.0.4375.4 for 64-bit Copyright (C) […] [Query Store with AOAG stuck on waiting]( - Hey Folks, I have a database on SQL 2019 CU24 in an AOAG with 1 primary and 2 secondary. I have enabled Query Store but it will not open and just shows Waiting on the primary. I have QS setup on standalone SQL 2016 databases and they seem to be working fine. Any help is […] SQL Server 2019 - Development [Web API Procedure will not run in SQL Server Agent Job]( - I have a stored procedure that pulls JSON data from a US government web API. The procedure executes fine manually but fails with the error below when executed from a job. I've checked permissions of the SQL Agent and ensured it has permission to execute sp_OACreate and sp_OAMethod procdures. Extremely grateful for any help or […] [Logic similar to EXIST to make all values the same if it meets a criteria]( - Hello everyone, I have a question. Please let me know if someone has any ideas. I need a logic with maybe EXIST(?) to check separately if for one Chain there is a field in REPLENTYPE with a value ‘SINGLE’ – I need all fields for this UPC at a specific Masterchainname to be ‘REPLENISHABLE’ for […] Reporting Services [SSRS Header not Keeping with report]( - Hi all, I have an SSRS report issue is when printing to PDF. i have a subreport that works fine, but when there is ONLY enough space for the header, it will stay at the bottom then the rest of the subreport continues on the next page. here is a screenshot of the subreport, mainly […] SQLServerCentral.com Website Issues [Weird redirect after reporting post]( - I just tried reporting this post: After clicking the 'Report post' button, I was redirected to this post: If I then return to the original spammy post, there is no indication that the report function worked. SQL Server 2022 - Administration [SQL Server 2022 Std edition eval version]( - Hi We are planning to upgrade our SQL Server 2014 Ent edition to 2022 Standard and i want to test Basic Availability Groups future. Is there a free evaluation version for SQL Server 2022 Standard edition? At least i could not find one Thank You SQL Server 2022 - Development [how to bulk insert a file on a azure sql server managed instance]( - Don't know if this is the right place for this topic. I have an internal azure sql server managed instance and am trying to read or write a file to the file system. As i understand, there is no file system on a sql server managed instance. Is there a way to add a file […]   [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -