Software Architecture and System Design News
Latest curated articles from top engineering blogs
Shopify
AWS23 articles
Cloudflare Blog Migration to EmDash: A Customer Zero Case Study in Scalable CMS Architecture
This article details Cloudflare's migration of its blog to EmDash, a new internal CMS built on Astro and Workers. It highlights the 'Customer Zero' philosophy, where Cloudflare dogfoods its own products to validate scale, security, and usability. The migration involved significant architectural decisions around caching, performance testing, and a phased rollout strategy to ensure zero downtime and high availability under variable traffic loads.
Optimizing AI Agent Resource Consumption and Billing for Complex Workflows
OpenAI's experience with GPT-5.6 Sol highlights critical challenges in resource management and billing for AI agents, particularly when dealing with complex, multi-step workflows involving tool calls. The unexpected token consumption, even during wait times, reveals the difficulty in predicting and modeling agentic workloads and underscores the need for more sophisticated cost estimation and architectural considerations for AI-driven systems. This case study provides insights into the operational challenges of deploying advanced AI models.
WhatsApp's Architecture for Billions: A Message Router Approach
This article highlights a key architectural design choice by WhatsApp: operating primarily as a message router without long-term server-side message storage, a stark contrast to Facebook Messenger. It delves into WhatsApp's historical architecture, leveraging Erlang for massive concurrent connections, and its impressive scalability achievements from early on, handling millions of connections per server.
Analyzing Internet Resiliency and Vulnerabilities in Q2 2026
This article from Cloudflare Radar provides a quarterly overview of major Internet disruption events, highlighting the fragility and interconnectedness of global network infrastructure. It details various causes of outages, including natural disasters, government interference, and technical failures like DNSSEC misconfigurations, offering insights into the real-world impacts on connectivity and the importance of resilient system design.
Spotify Podcast Ingestion Incident: Lessons in Reliability and Data Integrity
This article from Spotify Engineering details an incident involving reliability issues in their podcast content ingestion pipeline and video processing. It highlights critical lessons learned regarding data consistency, idempotency, and the importance of robust error handling in distributed systems, particularly when dealing with media content and diverse creator uploads. The incident underscores the complexity of maintaining service health and data integrity across a large-scale content platform.
Scaling Real-Time Copy-Trading: Distributed Order Mirroring with Block Aggregation
This article details the system design challenges and solutions for scaling a real-time copy-trading platform. It focuses on how to proportionally scale master trader orders across thousands of follower accounts with varying capital, and how to mitigate cascading slippage through a novel block order aggregation pattern to ensure fair execution prices in a distributed financial system.
Scaling a Caching System: Migrating from PostgreSQL to ClickHouse for Analytical Workloads
Momentic rearchitected its caching system, transitioning from PostgreSQL to ClickHouse, to handle billions of entries and millions of daily queries with low latency. This migration addressed PostgreSQL's limitations with high-write, high-read analytical workloads and lock contention, highlighting the architectural benefits of column-oriented databases for specific access patterns.
Migrating a Live Routing System with AI-Assisted Refactoring
This article details Datadog's migration of a live routing system from a legacy model to a relational one using AI-assisted refactoring. It highlights the challenges of safely changing critical infrastructure and how a shadow-testing approach, comparing AI-generated and legacy system outputs, ensured reliability during the transition.
Building a Scalable and Cost-Effective User Tracking Service at Delivery Hero
This article details Delivery Hero's journey in deprecating Google Analytics and developing an internal, highly scalable, and cost-effective user tracking platform. It covers the architectural decisions, challenges faced regarding data quality and real-time processing, and the strategies employed for testing, rollout, and continuous optimization. The system achieved superior data quality and lower costs compared to its predecessor.
Preventing Spark OOM Failures on Kubernetes: Lessons from Cloud Migration Misconfigurations
This article details a case study where migrating Spark batch pipelines to Azure Kubernetes Service (AKS) led to repeated Out-Of-Memory (OOM) failures. The root cause was identified as a combination of infrastructure misconfigurations: RAM-backed local scratch directories and forced executor co-location on a single node. It emphasizes the importance of validating infrastructure contracts during cloud migrations to avoid subtle, load-dependent issues.
Architecting for Cloud Provider Resiliency: Lessons from Railway's Google Cloud Outage
This article details an eight-hour platform-wide outage experienced by Railway, a platform built on Google Cloud, AWS, and bare-metal, due to an automated suspension of their GCP production account. It highlights critical architectural weaknesses where a single cloud provider became a single point of failure for core services like the network control plane, leading to a cascade across all environments. The incident underscores the importance of true multi-cloud/hybrid-cloud resilience beyond traditional multi-AZ/region strategies.
Uber's Core Architecture: Geospatial Indexing, Dispatch, and Real-time Data
This article dissects key architectural decisions powering Uber's real-time marketplace. It explores how Uber handles challenges like low-latency driver matching, dynamic pricing, and global scalability through innovations like the H3 geospatial indexing system, a sophisticated dispatch engine, and an event-driven architecture for real-time location tracking.