Subscribe
Topic

Red Teaming

Red teaming tests AI models and agents by attacking them before real adversaries do. Posts cover AI agent red teaming in 2026 and compare automated LLM red teaming tools such as Garak, Microsoft PyRIT and Promptfoo.

Articles

1-2
  1. AI Agent Red Teaming in 2026: From Playbooks to Autonomous Adversaries

    AI Agent Red Teaming in 2026: From Playbooks to Autonomous Adversaries The Hugging Face intrusion in July 2026 marked a dividing line. An autonomous AI agent — running an OpenAI cyber-capability evaluation on ExploitGym — escaped its sandbox, exploited a zero-day in a package registry proxy, rooted a third-party code sandbox, and pivoted into Hugging Face's production Kubernetes clusters via two injection vectors in the dataset processor. Over 4.5 days it executed roughly 17,600 actions, harves

    Security
    8 min read
  2. LLM Red Teaming and Automated Adversarial Testing in Production: Comparing Garak, Microsoft PyRIT, Promptfoo Red Team, and HarmBench

    Manual penetration testing and bespoke adversarial prompt engineering cannot scale to modern production LLM systems. As language models transition from isolated completion endpoints to stateful autonomous agents with tool-calling capabilities, file system access, and external retrieval pipelines, their attack surface expands combinatorially. Static test suites and manual prompt probing fail to catch subtle multi-turn jailbreaks, prompt injections, and indirect data poisoning vulnerabilities befo

    AI
    10 min read