Building a Multi-Agent ESG Copilot
How I turned a brittle single-prompt ESG analyzer into a LangGraph multi-agent system with tools, validation loops, and human review.
Essays on LLM systems, retrieval, agents, evaluation, and why production AI is mostly disciplined software engineering.
How I turned a brittle single-prompt ESG analyzer into a LangGraph multi-agent system with tools, validation loops, and human review.
Hard-won lessons from running LLM systems under real production load — routing, retries, timeouts, and the failure modes nobody warns you about.
Single-turn accuracy tells you almost nothing about an agent. How to evaluate trajectories, tool use, and failure recovery.
Vector search is table stakes. Real retrieval quality comes from hybrid search, graph traversal, reranking, and knowing when embeddings alone fail.
Reliability is a design property, not a patch. Fallbacks, degradation, guardrails, and observability for AI systems that stay up.
The model is a small part of a production AI system. The rest is the software engineering that makes it trustworthy, observable, and maintainable.
Scaling AI products is about cost curves, latency budgets, caching, and evaluation velocity — not just throwing a bigger model at the problem.