Airflow at Shopify, Production Readiness, Gatling vs JMeter, Netflix DevEx, Bug Bounty

In this issue, July 26, 2022 [View it in your browser.]( [Airflow at Shopify](#Shopify), [JetBrains Dev Envs](#JetBrains), [Production Readiness](#Production), [AWS Lambda Powertools](#AWS), [Gateway Load Balancer](#Gateway), [BLST Security](#BLST), [Gatling vs JMeter](#Gatling), [Alexa Skill Dev](#Alexa), [Making Decisions](#Decisions), [Netflix DevEx](#Netflix), [OSS Bug Bounty](#OSS) [Upcoming QCon 2022: What are the best practices & innovations the ML community is developing and creating?]( The “MLOps” track at the upcoming QCon conferences ([in-person]( or [online]() will deep-dive into declarative ML systems, distributed model training, scalable and low latency model inference, and ML observability to protect the downsides & ROI. Attend in-person at [QCon San Francisco]( (Oct 24-28) or online at [QCon Plus]( (Nov 29-Dec 9).  SPONSOR AD [DataStax]( [Going Cloud Native with Serverless Data]( Wondering how serverless can help with cloud app development? Join Pieter Humphrey and Artem Chebotko as they demystify serverless, cut through the hype, and explain why pairing serverless functions with a serverless, NoSQL database can boost your development agility, performance, and cost savings. Live Webinar, August 18th, 2022 - [Save your Seat](. [quality(80)/filters:no_upscale()/news/2022/07/alex-blewitt/en/resources/1alex-blewitt-infoq-1658297926723.jpeg]( [] [Obituary: Alex Blewitt]( It is with great sadness that we announce that InfoQ editor Dr. Alex Blewitt has unexpectedly passed away. (News) [( [] [Omar Sanseviero on Transformer Models and Democratizing Good ML Practices]( Live from the venue of the QCon London Conference we are talking with Omar Sansevier about Hugging Face, the limitations and biases of machine learning models, the carbon emitted when training large scale machine learning models, and democratizing good ML practices. (Podcast) [AI, ML & Data Engineering Latest Content]( TOP AI, ML & Data Engineering NEWS HEADLINES - [] [Google's Image-Text AI LIMoE Outperforms CLIP on ImageNet Benchmark]( [] [Shopify’s Practical Guidelines from Running Airflow for ML and Data Workflows at Scale]( Shopify engineering shared its experience in the company's blog post on how to scale and optimize Apache Airflow for running ML and data workflows. They shared practical solutions for the challenges they faced like slow file access, insufficient control over DAG, irregular level of traffic, resource contention among workloads, and more. (News) SPONSOR AD [Matillion]( [Close the Information Gap: How to Succeed at Analytics in the Cloud]( Download this guide to better understand what a data-driven business looks like and the dangers of having an information gap across data that's distributed, diverse, and dynamic. You'll also learn how cloud-native tools, platforms, and processes can help you close the information gap. [Download now](. [DevOps Latest Content]( TOP DevOps NEWS HEADLINES - [] [JetBrains Launches Containerized Development Environment Space On-Premises]( [] [Discovering the Versatility of OpenEBS]( OpenEBS provides storage for stateful applications running on Kubernetes, including dynamic local persistent volumes or replicated volumes using various "data engines". OpenEBS can address a wide range of applications, from casual testing and experimentation to high-performance production workloads (Article) [] [Panel: Real-World Production Readiness]( The panelists discuss production readiness, the “practice” of SRE, how data comes to production readiness, and strategies for resiliency. (Presentation with transcript included) Software Delivery Practices Evolve Fast, So Should Your Learning: [Attend QCon San Francisco Software Development (Oct 24-28)](. What are the major trends that matter right now in software development and technical leadership? Uncover emerging software trends and practices to solve your complex engineering challenges, without the product pitches. [Save your spot now!]( SPONSOR AD [D2iQ]( [Kubernetes Cheat Sheet | D2iQ]( Kubernetes adoption requires a lot of moving parts. In this cheatsheet, D2iQ Kubernetes experts walk you through what you need to know to achieve a push-button, self-healing Kubernetes deployment. [Download yours today](. [Cloud Latest Content]( TOP Cloud NEWS HEADLINES - [] [Amazon Redshift Serverless Generally Available to Automatically Scale Data Warehouse]( - [] [Microsoft Announces the General Availability of Its Gateway Load Balancer in All Regions]( - [] [Amazon Announces General Availability of EC2 M1 Mac Instances to Build and Test on macOS]( - [] [AWS Announces General Availability of its Cloud WAN for Centralized Workload Management]( [] [AWS Lambda Powertools for TypeScript Now Generally Available]( Amazon recently announced the general availability (GA) of AWS Lambda Powertools TypeScript. The set of utilities for Node.js Lambda functions helps developers follow best practices for tracing, structured logging, and custom metrics. (News) SPONSOR AD [Sleuth]( [[eBook] Going from Zero to One Hundred Deploys a Day]( The journey of elite teams at Amazon, Google, Netflix, and other top companies can be deconstructed into three distinct phases. Download this guide to learn what each phase of the journey towards CD and frequent deploys look like, and the milestones you need to hit to get there. [Download now](. [Development Latest Content]( TOP Development NEWS HEADLINES - [] [BLST Security Extends Support for OpenAPI Specification Table]( [] [Open-Source Testing: Why Bug Bounty Programs Should Be Embraced, Not Feared]( The growing importance of the Web3 ecosystem based on blockchains shows how important community test programs are. Some within the testing community see this trend as a threat. However, it is actually an opportunity. Bug bounties and open-source test contributions are a great tool for test teams, and there is every reason for testers to embrace this new trend rather than to fear it. (Article) SPONSOR AD [AblyRealtime]( [WebSocket challenges to building user engagement features]( Download our whitepaper to explore five aspects to consider if you're building scalable live features (chat, quizzes, Q&A sessions, etc.) using the WebSocket protocol. [Download now](. [Java Latest Content]( TOP Java NEWS HEADLINES - [] [Java News Roundup: Microsoft Joins MicroProfile and Jakarta EE, GlassFish, Payara, Micronaut]( [] [Gatling vs JMeter - What to Use for Performance Testing]( A performance tool with a graphical interface will probably be easier to use at the beginning, but the idea of a performance test as code is the future. Tests are readable and much easier to maintain. Many people are skeptical about Gatling because it requires learning a new programming language - Scala. However, Java is supported with the release of Gatling 3.7. (Article) SPONSOR AD [HiveMQ]( [MQTT vs. HTTP for IoT]( MQTT was designed for the Internet of Things whereas HTTP was created to make documents available across the internet. Explore the differences between the two protocols, performance, the advantages and disadvantages of each for IoT, and more. [Learn More](. [Mobile and IoT Latest Content]( [] [Amazon Introduces New APIs and SDKs for Alexa Skill Development]( At Alexa Live 2022, Amazon announced new APIs and SDKs for Alexa skill developers, including the Alexa Ambient Home Dev Kit, the Alexa Connect Kit SDK for Matter, Universal Device Commands, and more. (News) SPONSOR AD [OutSysstems]( [Humanize artificial intelligence for better process automation]( Intelligent Automation uses uniquely human strengths—like intuition and judgment—and combines them with intelligent tools like artificial intelligence (AI) and robotic process automation (RPA) to deliver superior organizational outcomes. Easily apply UX/UI templates and connect plus manage popular technology services. [Download the eBook to learn more](. [Architecture & Design Latest Content]( [] [Architectural Frameworks, Patterns, and Tactics Are No Substitute for Making Your Own Decisions]( Software frameworks greatly amplify a team’s productivity, but also make implicit decisions. The benefits and limitations must be understood because of the impact on the resulting system architecture. (Article) [Culture & Methods Latest Content]( TOP Culture & Methods NEWS HEADLINES - [] [The Future is Knowable before it Happens: an Impossible Thing for Developers]( [] [Scaling and Growing Developer Experience at Netflix]( An optimal Developer Experience will depend a lot on the company the developer is working for. This article discusses why and when changes to developer needs will occur, how to get ahead of them, and how to adapt when these changes are necessary. I talk through some of the experiences myself and peers have had at Netflix, identifying some key learnings and examples we have gained over the years. (Article) [] [Incidents, PRRs, and Psychological Safety]( Nora Jones discusses the context around PRRs and provides takeaways on how one can improve production reliability. (Presentation with transcript included) InfoQ Call for Contributors Write for InfoQ: Share knowledge, connect with the global software development community, and grow your career Are you an experienced senior software engineer or technical leader that is passionate about innovation, adoption of technologies, and the learning and sharing of knowledge with your peers? InfoQ content is written exclusively by software practitioners like yourself, with the goal of sharing inspiring content from real-world use cases, best practices used by innovator and early adopter companies, and news on emerging trends. [Join the InfoQ Writing Team](  SPONSORED CONTENT Latest White Papers [The DevSecGuide to Infrastructure as Code]( [SQL to NoSQL: Architecture Differences and Considerations for Migration]( You have received this message because you are subscribed to the "Top Content Newsletter". To stop receiving weekly updates on trends, please click the following link: [Unsubscribe]( Forwarded newsletter? [Register to get your own weekly newsletter.]( - - - C4Media Inc. (InfoQ.com), 2275 Lake Shore Boulevard West, Suite #325, Toronto, Ontario, Canada, M8V 3Y3