Software Architecture and System Design News
Latest curated articles from top engineering blogs
Shopify
AWS811 articles
Meta's Post-Quantum Cryptography Migration Strategy
This article details Meta's comprehensive strategy for migrating to post-quantum cryptography (PQC) to protect against future quantum attacks. It outlines a multi-year, phased approach, emphasizing risk assessment, cryptographic inventory, and the adoption of PQC Maturity Levels to guide organizational readiness and deployment. The framework provides practical guidance for other organizations on transitioning critical systems to quantum-resistant standards.
Building Natural Language Interfaces with Large Language Models and OpenAPI Specs
This article explores how Spotify leveraged Large Language Models (LLMs) and OpenAPI specifications to create a natural language interface for their Ads API. It details the architecture and process of transforming API definitions into a conversational tool, highlighting the implications for API design, developer experience, and system integration without requiring extensive compiled code.
AWS Aurora Serverless v4: Faster Scaling and Improved Throughput for Database Workloads
AWS has significantly enhanced Aurora Serverless with Platform Version 4, offering 45% faster ramp-up during demand spikes and 30% higher throughput. These improvements stem from smarter scaling algorithms and better resource scheduling, making Aurora Serverless a more compelling option for dynamic and bursty workloads that benefit from automatic capacity adjustments.
Azure Integrated HSM: Hardware-Enforced Cryptographic Trust at Scale
This article discusses Azure Integrated HSM, a Microsoft-built hardware security module integrated into every new Azure server. It extends cryptographic trust from silicon to services, enhancing key protection by ensuring keys never leave the hardware boundary during use. This architecture shifts security enforcement from policy to hardware, addressing scalability and performance challenges of traditional centralized HSMs.
Migrating a High-Volume Metrics Pipeline to OpenTelemetry and Prometheus
This article details Airbnb's migration of a large-scale metrics pipeline from StatsD to OpenTelemetry and a Prometheus-based backend. It covers the architectural decisions, dual-write strategy, performance benefits of OTLP, the introduction of a streaming aggregation layer using vmagent for cost control and scalability, and a novel 'zero injection' solution for sparse counter accuracy issues.
Compute as the New Moat: Scaling AI Systems with Massive GPU Infrastructure
This article highlights how massive compute capacity, particularly GPU infrastructure, has become the critical limiting factor and competitive differentiator for frontier AI companies like Anthropic. It details Anthropic's strategic acquisition of significant compute resources, including a large-scale deal with SpaceX for NVIDIA GPUs, to support its ambitious product roadmap for AI agents. The core system design implication is the shift from model-centric development to infrastructure-centric scaling for advanced AI workloads.
Diagnosing CPU Bottlenecks and Network Driver Resets in Kubernetes on AWS
This article details Pinterest's complex journey to identify and resolve intermittent network connectivity issues in their Ray-based ML training jobs running on Kubernetes clusters backed by AWS EC2. The investigation uncovered CPU starvation affecting AWS ENA network drivers, leading to device resets and job crashes. The process highlights systematic debugging, profiling techniques, and the challenges of diagnosing transient performance bottlenecks in large-scale distributed systems.
Designing Reliable Embedded Bootloaders for System Recovery
This article discusses the critical role of bootloaders in embedded systems, emphasizing their importance for system reliability and recovery from firmware corruption or update failures. It compares architectural approaches across MCUs, Linux, and FPGA platforms, highlighting common pitfalls and best practices for robust bootloader design to ensure product resilience.
Smarter URL Normalization for Content Deduplication at Scale
Pinterest engineered the Minimal Important Query Param Set (MIQPS) algorithm to dynamically identify and strip irrelevant URL parameters, crucial for deduplicating content at their vast scale. This system reduces redundant processing by distinguishing between parameters that affect content (e.g., product ID) and those that are purely for tracking, ultimately improving efficiency and catalog quality. The solution leverages content fingerprinting and a multi-layer normalization strategy combining static rules with learned dynamic ones.
Architecting AI Coding Agents: Remote Control, Plugin Systems, and Cloud-Native CLI
This article explores the architectural shift in AI coding agents, moving from local, editor-bound sessions to more autonomous, cloud-based operations. It highlights Amp's Neo CLI redesign, which facilitates remote control, leverages a plugin system, and adopts a "compaction-first" architecture to manage long-running agent workflows efficiently, emphasizing the terminal's evolving role as a control surface for distributed agent systems.
The Evolution of AI Infrastructure: GaaS, MaaS, and TaaS
This article discusses the evolving landscape of AI infrastructure, highlighting the shift from traditional cloud computing to specialized 'as-a-Service' models like GPU-as-a-Service (GaaS), Model-as-a-Service (MaaS), and Token-as-a-Service (TaaS). It emphasizes how these models simplify AI development, reduce costs, and enhance scalability by abstracting away complex hardware and model management.
Automating RAG Quality: LLM-as-a-Judge for Hallucination Detection
This article discusses an architectural approach to ensuring RAG (Retrieval-Augmented Generation) pipeline quality by automating faithfulness metrics. It advocates for an "LLM-as-a-Judge" pattern, using a separate, more capable LLM to evaluate the responses of a production-facing "Student" LLM against retrieved context, thereby moving beyond manual spot-checks for hallucination detection.