Subscribe
Topic

Production Engineering

Engineering guides for making AI systems reliable in production. Posts compare agentic web scraping tools like Crawl4AI and Browser Use, LLM guardrails such as NeMo Guardrails, tool-call failure recovery and hybrid search score fusion.

Articles

1-3
  1. Agentic Web Scraping and Headless Browser Automation in Production: Comparing Crawl4AI, Browser-Use, Stagehand, and ScrapeGraphAI

    Agentic Web Scraping and Headless Browser Automation in Production: Comparing Crawl4AI, Browser-Use, Stagehand, and ScrapeGraphAI Web scraping has undergone a fundamental architectural transition. For decades, automated data extraction relied on deterministic parsers such as Beautiful Soup, Scrapy, and raw headless browser drivers like Playwright or Puppeteer. These tools depended on hand-crafted CSS selectors, XPath expressions, and rigid execution trees. While computationally lightweight, sel

    AI
    10 min read
  2. Tool-Call Failure Recovery in Production AI Agents: Syntactic Repair, Schema Coercion, Parameter Inoculation, and Dynamic Fallback Architectures

    Tool-Call Failure Recovery in Production AI Agents: Syntactic Repair, Schema Coercion, Parameter Inoculation, and Dynamic Fallback Architectures Autonomous language model agents operate by interleaving natural language reasoning traces with structured tool invocations. However, when deployed in multi-turn production environments, raw tool calling exhibits significant fragility. Empirical studies from benchmark suites such as $\tau$-bench (arXiv:2406.12045) and the Berkeley Function Calling Lead

    Agents
    8 min read
  3. Hybrid Search Score Fusion in Production: Reciprocal Rank Fusion vs. Relative Score Fusion vs. Distribution-Based Score Fusion

    Combining lexical search and dense vector retrieval is the standard architecture for modern enterprise retrieval-augmented generation (RAG). Lexical algorithms like BM25 excel at exact token matching, code identifiers, and acronyms, while dense embeddings capture semantic context and paraphrased intent. However, merging these two disparate retrieval streams into a single, coherent ranking presents a fundamental mathematical challenge: lexical engines and vector indices operate in completely inc

    Search
    7 min read