AI, ML, and Data Engineering Round-Up

A Collection of Top AI, ML, and Data Engineering News, Articles, Presentations September 2023 [InfoQ] AI, ML, and Data Engineering Round-Up Sponsored by [Redis] [Latest Content](#latest-content), [Top Viewed Content](#top-viewed-content), [Top News](#news), [Top Articles](#top-articles), [Top Presentations](#top-presentations-and-interviews) In this special newsletter we bring you up to date on all the new content and news related to AI, ML, and Data Engineering on InfoQ. We are also maintaining a portal page for this content on InfoQ at: [(. [] Latest Content on InfoQ [AI, ML, and Data Engineering InfoQ Trends Report - September 2023]( (articles, Sep 06, 2023) [Building Kafka Event-Driven Applications with KafkaFlow]( (articles, Sep 08, 2023) [Google Cloud Unveils AlloyDB AI: Transforming PostgreSQL with Advanced Vector Embeddings and AI]( (news, Sep 06, 2023) [Meta Open-Sources Code Generation LLM Code Llama]( (news, Sep 05, 2023) [Google Launches Three New Cloud Storage Options: Cloud Storage FUSE, Parallelstore, NetApp Volumes]( (news, Aug 29, 2023) [Redis Microservices for Dummies]( "Redis Microservices for Dummies" helps you understand the fundamentals of a microservices architecture, learn how to use Redis for messaging, storage, and caching, and design interservice communications while building new services. [Download now](. Sponsored content [Redis Microservices for Dummies]( [] Top Viewed Content on InfoQ [Mountpoint for Amazon S3 Now GA to Access Bucket Like Local File System]( (news, Aug 19, 2023) [Introduction to Mojo Programming Language]( (news, Jul 19, 2023) [Grab Reduces Traffic Cost for Kafka Consumers on AWS to Zero]( (news, Jul 28, 2023) [Pfizer Uses Serverless Architecture on AWS to Scale Processing of Digital Biomarkers]( (news, Jul 26, 2023) [GitHub Details Key Prompt Engineering Practices Used to Build Copilot]( (news, Jul 24, 2023) [] Top News [JetBrains Unveils AI Assistant for IntelliJ-Based IDEs and .NET Tools]( JetBrains, the software development company known for creating the IntelliJ IDEA, has announced the introduction of a new AI Assistant in its Early Access Program (EAP) builds for all IntelliJ-based IDEs and .NET tools. This significant addition is aimed at transforming the landscape of software development tools by integrating generative AI and large language models into JetBrains' products. [Google Releases Cloud SQL Enterprise Plus for MySQL and PostgreSQL]( Google Cloud recently announced the Cloud SQL Enterprise Plus edition for MySQL and PostgreSQL of the managed database service. The new edition provides performance optimizations for read and write operations, improved machine types and configurations, and an integrated SSD–backed data cache option. [Yelp Rebuilds Corrupted Cassandra Cluster Using Its Data Streaming Architecture]( Yelp created a solution to sanitize data from the corrupted Apache Cassandra cluster utilizing its data streaming architecture. The team explored many potential options to address the data corruption issue, however, ultimately had to move the data into a new cluster to remove corrupted records in the process. [Cache and Message Broker for Microservices]( Learn how caching with Redis Enterprise enables fast, simplified microservices applications, the top three caching patterns for microservices (and when to use them), and why using Redis Streams as a message broker not only reduces complexity but is also simpler to deploy than Kafka. [Download now](. Sponsored content [Cache and Message Broker for Microservices]( [Grammarly Replaces its in-House Data Lake with Databricks Platform Using Medallion Architecture]( Grammarly adopted the medallion architecture while migrating from their in-house data lake, storing Parquet files in AWS S3, to the Delta Lake lakehouse. The company created a new event store for over 6000 event types from 40 internal and external clients and, in the process, improved data quality and reduced the data-delivery time by 94%. [UC Berkeley Researchers Open-Source API-Calling Language Model Gorilla]( Researchers from UC Berkeley and Microsoft have open-sourced Gorilla, a large language model (LLM) that can write code to call APIs. In experiments measuring generated code accuracy, Gorilla outperforms several baseline models, including GPT-4. [] Top Articles [Creating Your Own AI Co-Author Using C++]( In this article we are going to present a GPT tool written in C++ to ease the pain of dealing with the task of editing editorial comments, showing how you can interface with ChatGPT via its API. [article]( [AI-Based Prose Programming for Subject Matter Experts: Will This Work?]( In this article, author Markus Völter discusses the future of programming using Large Language Model (LLM) tools like ChatGPT and GitHub’s Copilot for prose-to-code generation. [article]( [Leveraging Eclipse JNoSQL 1.0.0: Quarkus Integration and Building a Pet-Friendly REST API]( Eclipse JNoSQL 1.0.0 simplifies NoSQL integration with advanced features, standardized specifications, and Quarkus support, empowering developers with seamless data management capabilities. [article]( [Managing the Carbon Emissions Associated with Generative AI]( While likely somewhat overhyped, AI carbon emissions are still of concern and should be managed with appropriate best practices. [article]( [Redis Enterprise for Kubernetes and Microservice]( Download this solution brief to discover the data layer’s impact on performance and how Redis Enterprise can support your real-time applications. See where Kubernetes fits in a microservices architecture, discover the building blocks to successfully deploy cloud-native apps anywhere, and more. [Download now](. Sponsored content [Redis Enterprise for Kubernetes and Microservice]( [] Top Presentations [A Bicycle for the (AI) Mind: GPT-4 + Tools]( Sherwin Wu and Atty Eleti discuss how to use the OpenAI API to integrate large language models into your application, and extend GPT’s capabilities by connecting it to the external world via APIs. [Sherwin Wu and Atty Eleti]( [Streaming from Apache Iceberg - Building Low-Latency and Cost-Effective Data Pipelines]( Steven Wu discusses the design of the Flink Iceberg, comparing the Kafka and Iceberg sources for streaming and how the Iceberg streaming source can power many common stream processing use cases. [Steven Wu]( [Real-Time Machine Learning: Architecture and Challenges]( Chip Huyen discusses the value of fresh data as well as different types of architecture and challenges of online prediction. [Chip Huyen]( [A New Era for Database Design with TigerBeetle]( Joran Dirk Greef discusses pivotal moments in database design and how they influenced the design decisions for TigerBeetle, a distributed financial accounting database. [Joran Dirk Greef]( [Speed of Apache Pinot at the Cost of Cloud Object Storage with Tiered Storage]( Neha Pawar discusses how to query data on the cloud directly with sub-seconds latencies, diving into data fetch and optimization strategies, challenges faced and learnings. [Neha Pawar]( [Connect with InfoQ on Twitter]( [Connect with InfoQ on Facebook]( [Connect with InfoQ on LinkedIn]( [Connect with InfoQ on Youtube]( You have received this message because you are subscribed to the “Special Reports Newsletter”. To stop receiving this email, please click the following link: [Unsubscribe]( C4Media Inc. (InfoQ.com), 2275 Lake Shore Boulevard West, Suite #325, Toronto, Ontario, Canada, M8V 3Y3