Detecting malicious pull requests at scale with LLMs | Datadog

What this post added

This post details the initial build of Datadog's LLM-powered system, nicknamed BewAIre, for detecting malicious pull requests in real-time. It covers the ingestion and preprocessing of PRs, the inference process using LLMs to reason about code intent, and the generation of security signals. The post highlights the importance of prompt engineering and data tuning for accuracy, the challenges and solutions for working with LLM context windows, and the continuous testing against real-world exploits. It also mentions the system's availability in Preview for Static Code Analysis (SAST) customers.