AI
A route through the library rather than a dump of it. Items are drawn from the full AI collection, filtered to teaching material (news items are excluded) and ordered within each stage by depth signals โ whether the piece carries code, how substantial it is, and what readers actually open.
1
Start here
5 resourcesOrientation and first principles โ what the bug class is and how it behaves.
- GPT-5.5-Cyber built a zlib fuzzing lab in a dayLibrary built by GPT-5.5-Cyber for fuzzing zlib; it automatically generated harnesses across numerous entrypoints (including inflate, uncompress2, and MiniZip), configured ASan and UBSan builds, repurposed edge-case tests as seeds, and utilized compile-time variants like INFLATE_STRICT. This autonomous fuzzing campaign, a process that previously took weeks for skilled researchers, was completed in a single day, demonstrating a significant shift in vulnerability discovery capabilities.
- [tl;dr sec] #345 - Bug Rumors โ Exploits, Version Control DFIR, Agentic WormsAnalysis details how AI models struggle to review their own code, often missing bugs they introduce, and explores the diminishing effectiveness of traditional vulnerability disclosure timelines. A cheat sheet for version control digital forensics and incident response (DFIR) across GitHub, GitLab, Bitbucket, and Azure DevOps is provided, highlighting visibility gaps and configuration needs. The entry also discusses the challenge of false positives in security tools when benign traffic mimics attack patterns, and mentions a paper on self-replicating agentic worms.
- AI Agent Authentication in 2026: Web Bot Auth, ARD & OAuthLibrary for AI agent authentication that explains the stack of protocols including Agentic Resource Discovery (ARD), workload identity patterns like SPIFFE, Web Bot Auth for HTTP request signing, and OAuth for authorization. It details how these components work together to authenticate AI agents, preserve user delegation, and create auditable access, while warning against collapsing multiple identities into a single long-lived secret. The library also mentions blocking rotating scrapers using JA4 rules at the WAF.
- [tl;dr sec] #342 - Figma's Agentic Detection, Agent Identity, Uber's Agent-(E)DRLibrary for securing enterprise AI agents, uber/ADR, pairs an observability sensor with a two-tier detector to identify unsafe behaviors like credential exposure and prompt injection, benchmarked against 17 agent attack techniques and 133 MCP servers. This system, detailed in an arXiv paper and MLSys slides, aims to provide production security for AI agents by capturing telemetry and flagging policy violations.
- The Smart TV in Your LivingRoom Is a Node in the AIScraping EconomyAnalysis of Bright Data's SDK reveals how consumer devices, particularly smart TVs, are leveraged as residential proxy nodes for AI model data scraping. The SDK, embedded in apps from publishers like PlayWorks and Petflix, uses user consent to turn devices into exit nodes for web-scraping traffic. This circumvents datacenter IP blocking by services like Cloudflare, facilitating large-scale data harvesting for AI training. The analysis details the SDK's functionality, its connection to Bright Data's infrastructure using the legacy Luminati Networks domain, and the unauthenticated configuration fetching process.
2
Build depth
5 resourcesReal testing methodology, tooling, and writeups that show the work.
- Practical LLM Security Advice from the NVIDIA AI Red TeamLibrary summarizing NVIDIA AI Red Team findings, detailing common LLM application vulnerabilities. It addresses risks like remote code execution (RCE) from executing LLM-generated code (e.g., via `exec` or `eval`), insecure permissions in Retrieval-Augmented Generation (RAG) data stores leading to data leakage and prompt injection, and data exfiltration through active content rendering of Markdown or hyperlinks. Mitigation strategies include sandboxing dynamic code, rigorously managing RAG permissions, and sanitizing LLM output.
- [tl;dr sec] #333 - Perplexity's Bumblebee, Evading Cloud Logging, AI Vuln Hunting SpecLibrary for detecting malware in packages, agent configurations, and browser extensions, alongside techniques for evading cloud logging, and a specification for building custom AI security scanning systems. It details how formal methods are becoming more practical for AI-generated code, and how Microsoft's Agentic Secret Finder reduced false positives in GitHub's AI secret scanning by 75% through context extraction. The entry also covers the discovery of HTTP/2 Bomb, a DoS vulnerability affecting multiple web servers, and methods for disrupting AWS CloudTrail logging and abusing cloud logging services for defense evasion and visibility.
- Leaking Secrets in the Age of AILibrary for identifying AI-related secret leakage in public code repositories. The analysis found that `.ipynb` notebook files and configuration files like `mcp.json` and `.env` are particularly prone to exposing secrets from emerging AI vendors, impacting numerous companies. This research highlights critical gaps in current secrets scanning tools and practices, especially concerning the handling of AI development artifacts.
- Detecting AI-specific threats in Claude Enterprise from the Compliance API: a prefilter + LLM-as-judge pipeline with Sigma rulesLibrary for detecting AI-specific threats within Claude Enterprise, leveraging the Compliance API through a prefilter and LLM-as-judge pipeline with Sigma rules. It focuses on detecting indirect prompt injection via ingested content, jailbreaks, system prompt extraction, exfiltration preparation, and sensitive output disclosure, differentiating these threats from standard SaaS security concerns by analyzing conversation content rather than just perimeter events.
- Would You Click โAcceptโ? Automatically detecting malicious Azure OAuth applications using LLMsTool for detecting malicious Azure OAuth applications, leveraging insights from homoglyph attacks and analysis of real-world campaigns. This pipeline identifies suspicious applications by comparing their characteristics against a baseline of legitimate integrations, flagging deviations in publisher verification, homepage URLs, and application owner domains. The research highlights common gaps in Azure service principal management and the risk of consent fatigue, leading to potential privilege escalation and persistent access for attackers.
3
Go deep
8 resourcesNovel research, edge cases, and the techniques that push the class forward.
- Prompt Injection Attacks on Agentic Coding Assistants: A Systematic AnalysisAnalysis of prompt injection vulnerabilities affecting agentic AI coding assistants like Claude Code, GitHub Copilot, and Cursor, which integrate LLMs with external tools and protocols such as MCP. This work synthesizes findings from 78 studies, detailing 42 attack techniques including input manipulation, tool poisoning, and protocol exploitation. It identifies that over 85% of attacks succeed against current defenses, often enabling arbitrary code execution and system compromise through vulnerabilities in skill-based architectures and protocol ecosystems.
- Prompt Injection 2.0: Hybrid AI ThreatsLibrary for analyzing Prompt Injection 2.0, which combines LLM manipulation with traditional exploits like XSS and CSRF. It builds upon Preamble's research and mitigation technologies, evaluating them against contemporary threats such as AI worms and multi-agent infections. The library analyzes how these hybrid attacks bypass security controls, referencing CVE-2024-5565 and DeepSeek XSS exploits, and proposes architectural solutions involving prompt isolation and runtime security.
- s1ngularity's Aftermath: AI, TTPs, and Impact in the Nx Supply Chain AttackAnalysis of the s1ngularity Nx supply chain attack details novel TTPs used by AI-powered malware to exfiltrate secrets, including GitHub and npm tokens. The attack progressed through three phases: initial public leakage of thousands of corporate secrets, abuse of leaked GitHub tokens to expose private repositories, and a final phase publishing more repositories. The malware leveraged AI CLIs like Claude and Gemini to identify and exfiltrate sensitive files, impacting over 1,700 users with public secret leakage and hundreds more through the exposure of private repositories.
- EchoLeak: First Real-World Zero-Click Prompt Injection ExploitWriteup of EchoLeak (CVE-2025-32711), the first zero-click prompt injection exploit targeting Microsoft 365 Copilot. This vulnerability allowed unauthenticated data exfiltration via a crafted email by chaining multiple bypasses, including evading XPIA classifiers, using reference-style Markdown, exploiting auto-fetched images, and abusing a Microsoft Teams proxy within the content security policy. The paper analyzes defense failures and proposes mitigations such as prompt partitioning and enhanced filtering, providing generalizable lessons for secure AI copilots.
- Building an Open-Source AI-Powered Auto-Exploiter with a 1.7B Parameter Model: No Paid APIs RequiredLibrary for building an open-source, AI-powered autonomous penetration testing agent. This system utilizes a 1.7 billion parameter qwen3:1.7b model, LangChain, and LangGraph for local execution, eliminating API costs and data exfiltration. It functions as a ReAct agent, independently scanning networks with Nmap, searching for exploits using searchsploit, mirroring them, analyzing code with `inspect_exploit_code`, setting up listeners with `start_listener`, and executing commands via `execute_shell_command` to achieve autonomous exploitation.
- Microsoft Copilot: From Prompt Injection to Exfiltration of Personal Information ยท Embrace The RedWriteup detailing a Microsoft 365 Copilot vulnerability where prompt injection, automatic tool invocation, and ASCII smuggling were combined to exfiltrate personal information. The exploit chain leveraged malicious emails or shared documents to trigger Copilot's processing, enabling it to access and send sensitive data like emails and MFA codes to attacker-controlled domains via disguised hyperlinks.
- Off Guard: Breaking LiteLLM from authentication bypass to cloud compromiseLibrary that exploits authentication bypasses in LiteLLM, including CVE-2026-59822 which allows unauthenticated access to MCP sessions via arbitrary Bearer tokens. It also details how default master keys or no authentication enable pre-authentication RCE, and how unauthenticated admin access is possible. Post-authentication credential theft is achievable via the pass-through endpoint feature.
- LLM-Driven Reverse Engineering vs Iterative LLM ObfuscationLibrary for developing LLM-aware obfuscation techniques against reverse engineering tools like Claude Opus 4.6, building on research into LLM-driven analysis versus iterative LLM obfuscation. This work benchmarks Claude Opus against binaries obfuscated with the Tigress obfuscator, exploring static-analysis defenses by developing vibecoded countermeasures that exploit context windows, budget caps, and shortcut biases to increase LLM analysis costs.