Blog

Notes on engineering, platforms, and shipping product. Latest first.

• Interactive Architecture Models: Visualizing Distributed System Tradeoffs Sep 21, 2026
  Learn how interactive architecture models reveal distributed system tradeoffs, fault boundaries, and stateful flow bottlenecks before shipping code.
• Building Least-Privilege Filesystem Sandboxing for Autonomous Agent Runtimes Sep 18, 2026
  How Pizza Bot isolates background AI agent execution using explicit directory whitelisting, process separation, and tool-scoped subagents.
• Supervising Local Agent Daemons: Multi-Client SSE Architectures in Pizza Bot Sep 17, 2026
  How Pizza Bot uses supervised Node.js daemons, HTTP/SSE, and LangGraph checkpoints to build resilient, multi-client local AI workflows.
• Architecting Asynchronous Agent Workflows: Checkpoints and Approvals in Pizza Bot Sep 16, 2026
  Learn how Pizza Bot uses stateful LangGraph runtimes, SSE, and explicit action queues to build durable, asynchronous background AI agents.
• Distributed Systems Classics Every Platform Engineering Leader Must Master Sep 15, 2026
  Why platform engineering failures stem from ignoring classic distributed systems constraints like FLP impossibility, Lamport clocks, and CRDT limitations.
• Tiered KV Cache Offloading in vLLM v0.28.0: Breaking the GPU Memory Wall Sep 14, 2026
  How vLLM v0.28.0 breaks the GPU VRAM wall using native NVMe KV cache offloading, canonical CPU layouts, and Model Runner V2 disaggregation.
• Why Hiding Complexity Fails in Distributed Systems: Modularity vs. Modeling Sep 11, 2026
  Platform engineering leaders must distinguish between vertical modularity and horizontal modeling abstractions to build reliable distributed systems.
• Client-Side Determinism and Logit Control with WebLLM Sep 10, 2026
  How WebLLM brings OpenAI-compatible streaming, logit bias, and seed determinism directly to browsers via WebGPU and WebAssembly.
• Packaging Custom LLMs for the Edge with MLC and WebLLM Sep 09, 2026
  Learn how platform teams build edge CI/CD pipelines to package fine-tuned open-weight LLMs into MLC format for browser-native WebGPU execution.
• In-Browser LLM Execution: Zero-Refactoring Swapping with WebLLM Sep 08, 2026
  How WebLLM brings OpenAI API wire compatibility to WebGPU, enabling client-side LLM inference without refactoring frontend code.
• Swapping Cloud Endpoints for Browser GPUs: Zero-Backend Local Inference with WebLLM Sep 07, 2026
  Run open source LLMs directly inside client browsers using WebGPU and WebLLM without modifying application logic or paying backend token costs.
• Guaranteed Schema Output at the Edge: WASM-Driven JSON Generation in WebLLM Sep 04, 2026
  How WebLLM enforces strict JSON schemas in the browser using WebAssembly and WebGPU to eliminate client-side LLM parse errors without server validation.
• Client-Side LLM Execution: Architecting In-Browser AI Workflows with WebLLM Sep 03, 2026
  Execute open-source LLMs inside web browsers using WebLLM and WebGPU to eliminate cloud compute costs, preserve user privacy, and streamline frontend AI arch...
• Deterministic Secret State: Using keep.lock Manifests to Stop CI/CD Drift Sep 02, 2026
  Aligning secret state with Git commits using committed keep.lock manifests prevents build failures and runtime secret drift across engineering teams.
• Debugging Silent 200 OK Microservice Failures with Async Memory Snapshots Sep 01, 2026
  Silent 200 OK failures escape standard telemetry. Learn how asynchronous live memory snapshots isolate hidden state corruption without thread pauses.
• Branch-Aware Secrets Management: Aligning Env Scopes with Git Branches Aug 31, 2026
  Eliminate configuration drift across feature branches by pairing secrets directly to Git using versioned keep.lock manifests and CLI tools.
• Standardizing AI Agent Knowledge Across Heterogeneous Developer Toolchains Aug 28, 2026
  Platform engineering strategies for eliminating context drift across Cursor, Claude Code, and Codex using shared Model Context Protocol endpoints.
• Unifying Multi-Tool AI Workflows with Custom MCP Knowledge Routers Aug 27, 2026
  Eliminate context drift across Cursor, Claude Code, and ChatGPT by deploying central MCP knowledge routers for your engineering team.
• Two-Party Envelope Decryption and Zero-SDK Secret Injection Aug 25, 2026
  How zero-trust envelope decryption and process boundary injection solve developer secret sync without runtime SDKs or key rotation cascades.
• Managing Agent Context Drift with Shared Knowledge Layers Aug 24, 2026
  How platform engineering teams prevent context fragmentation across Claude, Cursor, and terminal agents using Model Context Protocol knowledge layers.
• Measuring Engineering Productivity Without Gaming the System: A Leader's Guide to the DX Core 4 Aug 21, 2026
  How the DX Core 4 framework combines DORA, SPACE, and DevEx to balance velocity, software quality, and developer experience.
• Zero-Trust Secrets Management: Stopping Key Rotation Cascades with Git-Native Workflows Aug 20, 2026
  How local-first encryption and two-party cryptographic revocation eliminate key rotation cascades during developer offboarding.
• How Read-Only AI Debugging Agents Change Production Incident Response Aug 19, 2026
  Platform engineering teams are moving from redeploy-and-log loops to ephemeral, read-only AI probing in live production environments.
• Debugging Production Without Redeploys: AI Agents and Non-Blocking Virtual Probes Aug 19, 2026
  How AI agents and read-only virtual probes eliminate speculative redeployments and capture live runtime state without pausing threads.