Quick and Effective Migration Between CosmosDB Collections Using ADF (2024-03-25)

SQLServerCentral Newsletter for March 25, 2024 Problems displaying this newsletter? [View online](. [SQL Server Central]( Featured Contents - [Quick and Effective Migration Between CosmosDB Collections Using ADF]( - [Tinkering with Fabric Data Factory Framework Functionality]( - [From the SQL Server Central Blogs - Extracting PostgreSQL database metadata for presentation in Excel format]( - [From the SQL Server Central Blogs - Change Notebook Spark Session Time-Out in Microsoft Fabric]( - [T-SQL Fundamentals]( Question of the Day - [Join Limitations]( The Voice of the DBA  Another View of DevOps Chocolatey Solutions Engineer [Stephen Valdinger]( said, "DevOps isn’t something you do, but rather, it’s a way of doing things. What works for us here, may not work for you there, so you adjust." He then went on to say that DevOps is a way of working that reduces time to introduce changes, while at the same time making changes traceable, accountable, and revertable. I've seen many companies try to copy what another company has done, especially with regards to DevOps and software development. I see companies copy the organization of teams from [Amazon]( [Spotify]( or others. Often quite a bit of time and effort is spent changing the way your development team works, and often without a lot of success. DevOps is a lot like my studies of martial arts, where you learn some techniques, but it is up to you to implement and use those techniques in your own way. While we may practice in patterns, the actual use of the skill is up to the user. That's what DevOps really is, a goal and set of ideals you aim for, but the actual implementation varies from company to company. Most of us want to build better software, and most managers want better quality applications, but often we can't get out of our own way because either too many people are resistant to change, or there isn't any incentive to work in a better way. This might be from individual contributors or from management, but without both groups making an effort to improve the software development process and quality of code, we won't achieve much. To get better at software development, whether C# or SQL, you need to read and learn about how to write better code. You need to learn how to automate the testing, compilation, and deployment of your code to downstream systems. And then you need to discuss and debate what works well, what doesn't, and adjust how the team writes code. Not just you, but the team. We might also need to adjust how we store, package, test, and run code on other systems. We have to experiment in small ways, testing out new ideas, algorithms, designs, and more. In short, we need to be a team. I like the quote above, but I also hope most of you realize the "you" in that quote is not singular, but plural. Steve Jones - SSC Editor [Join the debate, and respond to today's editorial on the forums](   Featured Contents [SQLServerCentral Article]( [Quick and Effective Migration Between CosmosDB Collections Using ADF]( chandan.saxenaa@gmail.com from SQLServerCentral This document aims to explain the process of using ADF (Azure data Factory) to make a copy of a Cosmos DB (Instance A) collection into a new collection in another Cosmos DB Instance effectively and cost effectively. For example, here is our Instance A in the Data Explorer: Here is Instance B: We are looking […] [Technical Article]( [Tinkering with Fabric Data Factory Framework Functionality]( Additional Articles from DILM Suite I recently asked myself, “Self, is it possible to apply framework functionality to Fabric Data Factory?” I decided to investigate. From the SQL Server Central Blogs - [Extracting PostgreSQL database metadata for presentation in Excel format]( Rayis Imayev from Data Adventures (2024-Mar-16) I have been a big fan of using the Excel application for various tasks for more than half of my life. I believe it's the most widely used spreadsheet... [Blog Post]( From the SQL Server Central Blogs - [Change Notebook Spark Session Time-Out in Microsoft Fabric]( Koen Verbeeck from Koen Verbeeck You might know the feeling: you’re writing code in a Notebook in Microsoft Fabric and suddenly you have to leave your workstation for a while. Someone ran the doorbell... [T-SQL Fundamentals]( [T-SQL Fundamentals]( Additional Articles from SQLServerCentral Master Transact-SQL's fundamentals, and write correct, robust code for querying and modifying data with modern Microsoft data technologies, including SQL Server 2022, Azure SQL Database, and Azure SQL Managed Instance.   Question of the Day Today's question (by Steve Jones - SSC Editor):  Join Limitations I have a query that uses a RIGHT OUTER JOIN. Which join hint cannot be used with this query? Think you know the answer? [Click here]( and find out if you are right.    Yesterday's Question of the Day (by Steve Jones - SSC Editor) The Most CUs Which version of supported SQL Server has the most Cumulative Updates (count) (as of Mar 1, 2024)? Answer: SQL Server 2017 Explanation: SQL Server 2017 has 31 CUs (as of Mar 1, 2024). SQL Server 2019 has 25, and SQL Server 2022 has less. Eventually versions should have around 31-32 CUs. Ref: SQL Server 2017 Build List - [( [Discuss this question and answer on the forums](    Database Pros Who Need Your Help Here's a few of the new posts today on the forums. To see more, [visit the forums](. --------------------------------------------------------------- Administration - SQL Server 2014 [Strange Deadlock Graph showing multiple DB but isolated]( - Hi Experts, I am observing strange deadlock behaviour where one deadlock graph have 2 isolated databases involved. Can any experts here shed some light on this?  Regards SQL Server 2019 - Administration [How can we enhance statistics information collection]( - Currently we are collecting database statistics information using select * FROM sys.dm_db_index_physical_stats( 14, NULL, NULL, NULL, 'SAMPLED') For some larger databases this statement takes more than 23 minutes to complete. Is there anything we can do to speed up this process and collect the same data?  [when dc is down can we remove database in dr out of always on secondary replica]( - HI All, primary server is in always on secondary is a replica when primary DC is down due to unexpected power off , can we make the secondary database online by removing them from availability group when dc is down can we remove database in dr out of always on secondary replica thanks naga.rohitkumar [SQL server 2019 alwayson problem]( - Hi, I've SQL server 2019 STD always on set up with 2 nodes and file share witness (located on third server). yesterday we had an network issue that the main switch was down for 15 minutes. after the network is back i see that the whole SQL server alwayson cluster was deleted from the computers […] [Rebuilding/Reorganizing in a very transactional table]( - Hello masters, It's been quite some time since i last posted here but i encountered a really hard opponent. We've got this table, this table has around 50-60m rows of transactions and this is only in one month, we've got this daily process that moves the transactions from the main to the historic one (basically […] [Database Ownership - Does it Matter ?]( - From a practical standpoint, does it matter who is shown as the owner of a database ? What if it's a network user, and their account is deleted when they leave the company? [SSRS 2019 Migration]( - Hello everyone, i have been trying to migrate SSRS 2012 to 2019 using powershell script which i found here [ microsoft/ReportingServicesTools: Reporting Services Powershell Tools (github.com) ] Unfortunately the samples mentioned in the script is not helping as well. Pls find the options i have tried with it & their respective exception Can anyone pls help […] SQL Server 2019 - Development [EXEC (@SQL) AT QASERVERNAME; Fails with read-only database error.]( - All, Need a linked server guru.  Trying the following in a stored procedure: SET @SQL = 'DROP TABLE IF EXISTS DB_NAM.SCHMA_NAME.TBL_NAME'; IF @@SERVERNAME = 'QASERVERNAME' BEGIN; SET @HUBServerName = '[QAHUBSERVERNAME]'; EXEC (@SQL) AT QAHUBSERVERNAME; END; Then I get this: Msg 3906, Level 16, State 2, Line 10 Failed to update database "DB_NAM" because the database […] [ACCIDENTAL DUPLICATE...]( - Accidental Duplicate... my bad... [nested subqueries vs separate queries performance difference]( - Hi everyone I am looking at improving the performance of my queries. There is an approach I am considering but I don't know if it will actually improve things or not. I won't know until I try (which I will) but I am interested in getting some feedback from the community. Query 1 select * […] Reporting Services [pagename property for my tablix doesnt show fields]( - Hi , i went to set page name on a tablix mostly for naming worksheets when report is saved to excel.  From what i can see, ssrs is saying no dataset is attached to the tablix. Which isnt true. Can someone help? at the moment that total line is hidden and i'd have to ask […] [Using Parameter and Booksmarks together?]( - Hello, I have a SSRS 2016 Report with multiple tables on every pages. User should select a particular table and jump to the page of this table. Is it possible to do? I did not find any way to do it. Try: I create a textbox with a Action to Bookmark and the expression of […] SQL Server 2022 - Administration [case for 'DBCC TRACEON - Trace Flags']( - Please share a situation when enabling and taking further advantage of DBCC TRACEON - Trace Flags made a serious difference for you, solved a problem, etc. - in other words, in what situation did you ENABLE a certain Trace Flag and it helped you tremendously? (in what, how..) THANKS! [Log shipping setup failing with error - Access is denied]( - We are setting up a log shipping from the Dev to the Reporting Server. However, the GUI process is failing with the below error. Source VM: XXX-SQL-D Target VM: XXX-RPT-D-DB Error from Log File: Cannot open backup device '\\XXX-SQL-D\i$\MSSQL\Backup\LSTONY\LOG\LSTONY.bak'. Operating system error 5(Access is denied.). RESTORE FILELIST is terminating abnormally. (Microsoft SQL Server, Error: 3201) […] SQL Server 2022 - Development [very slow performance using WHERE on Oracle linked server]( - I have a linked server pointing to an Oracle instance using OraOLEDB.Oracle. The table contains about 40K rows. My issue is that while I can get fine performance doing a SELECT or DELETE with no WHERE clause, the moment I add a WHERE it is just horrible. Even selecting a single row takes 20+ minutes. […]   [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -