Software Architecture and System Design News
Latest curated articles from top engineering blogs
Shopify
AWS761 articles
Implementing a Circuit Breaker for AI Tool Calls to Prevent Cascading Failures
This article details the design and implementation of an MCP (Multi-protocol Communication Protocol) circuit breaker to prevent cascading failures in AI agent workflows. It focuses on how the circuit breaker pattern, a key distributed systems concept, can be applied to isolate flaky external tool calls and ensure system resilience. The post explores the state machine, failure handling, and configuration for robust operation at scale.
Architectural Strategy for Migrating Legacy Database-Centric Systems with Event Sourcing
This article outlines an architectural strategy for migrating legacy database-centric systems using events and progressive ownership transfer. It focuses on how to incrementally modernize monolithic applications by extracting functionalities and data, leveraging event-driven patterns to decouple services and manage data consistency during the transition.
Designing RAG Pipelines: Ingestion and Query Shifts
This article provides a detailed breakdown of the two distinct operational shifts in a Retrieval Augmented Generation (RAG) pipeline: ingestion (offline) and query time (live). It emphasizes the architectural decisions and potential failure points within each shift, focusing on critical steps like document parsing, chunking, embedding, and retrieval to ensure accurate and contextually relevant AI responses. Understanding these shifts is crucial for building robust and debuggable RAG systems.
System Design Glossary: Essential Concepts for Architects
This article serves as a crucial glossary, defining fundamental terms and concepts frequently encountered in system design and software architecture. It provides a shared reference for understanding complex distributed systems, architectural patterns, and scalability considerations, ensuring clarity across various system design discussions and analyses.
Smart Client SDK: Decoupling Frontend State & API Interactions for Enterprise Architecture
This article introduces the "Smart Client SDK" pattern, advocating for robust client-side architecture in enterprise B2B systems. It details a "Librarian/Menu" approach to decouple API fetch logic and state synchronization from UI components, promoting maintainability, testability, and framework independence.
Optimizing Hadoop Big Data Workloads on Arm-based AmpereOne Processors
This article explores the setup, tuning, and performance evaluation of Hadoop on AmpereOne Arm-based processors, highlighting their power efficiency and cost advantages for big data workloads. It delves into the architectural benefits of AmpereOne processors, Hadoop's compatibility with Arm, and provides practical guidance for deploying and optimizing Hadoop clusters on this infrastructure. The focus is on leveraging modern hardware for scalable and cost-effective big data processing.
Optimizing Large Pull Request Diffs at Scale
GitHub Engineering details their strategies for improving the performance of the 'Files changed' tab, particularly for large pull requests. This involved a multi-pronged approach combining component-level optimizations, UI virtualization, and broader rendering improvements to reduce DOM nodes, memory usage, and interaction latency, showcasing practical front-end architecture for highly interactive web applications at scale.
Vultr's AI-Powered Infrastructure Automation for Developer Portals
Vultr leverages Nvidia GPUs and AI agents to offer a cost-effective infrastructure automation platform, aiming to simplify infrastructure provisioning for developers through internal developer portals (IDPs). This approach shifts the platform engineering role from manual scripting to high-level architectural design, abstracting complex infrastructure details away from application developers. The system uses 'skill files' trained on organizational policies to automate deployments via API-driven AI agents.
Building a Real-time API Proxy for Cross-Platform LLM Tooling Interoperability
This article details the architecture and implementation of a local proxy designed to enable interoperability between Cursor IDE and GitHub Copilot. It explores the challenges of bypassing proprietary routing and transforming API request schemas in real-time to bridge two different AI model ecosystems. The solution highlights practical techniques for HTTP interception, payload manipulation, and AST cleansing within a proxy architecture.
Replacing Database Sequences at Scale: A Distributed ID Generation System
This article details Coupang's journey to replace legacy database sequences with a highly available, low-latency distributed ID generation system without breaking over 100 existing services. The solution leverages local application caching, server-side caching, and DynamoDB as the source of truth, optimizing for performance and availability over strict global ordering and gap-free IDs. It highlights practical design principles for large-scale migrations, emphasizing simplicity and backward compatibility.
Architectural Deep Dive into Claude Code's LLM Agent Loop
This article dissects the core `while(true)` loop powering Claude Code's AI coding agent, revealing its state machine architecture for managing complex interactions with large language models and tools. It highlights critical design decisions like avoiding recursion for stack overflow prevention and implementing streaming tool execution for significant performance gains, showcasing a robust approach to building interactive AI agents.
Ensuring Data Integrity in Observability Platforms
This article discusses common pitfalls in observability platforms that lead to inaccurate data and offers practical strategies to ensure the integrity and reliability of monitoring and logging systems. It emphasizes the importance of understanding data lifecycles, proper instrumentation, and architectural considerations to prevent 'lying' platforms.