BlogsDatadogSynthetic Monitoring for Acceptance Tests

Synthetic Monitoring for Acceptance Tests

Synthetic Monitoring for Acceptance Tests

1
posts
2023

Datadog migrated its internal acceptance tests from a custom Puppeteer-based runner to its own Synthetic Monitoring product. This involved developing a CLI tool (`datadog-ci`) to trigger and manage synthetic tests from CI environments, aiming to reduce flakiness, improve maintainability, and decrease test execution time. The migration process involved identifying pain points through developer surveys and implementing a solution that leverages the existing Synthetic Monitoring platform for recording and executing user interactions.

2023

How we migrated our acceptance tests to use Synthetic Monitoring | Datadog

6/30/2023

This post details the migration of Datadog's internal acceptance tests from a custom Puppeteer-based runner to the Synthetic Monitoring product. It describes the pain points of the previous system (flakiness, manual scripting, maintenance overhead, long execution times) and the solution implemented, which involved developing the `synthetics-ci` CLI tool (later generalized to `datadog-ci`) to integrate Synthetic Monitoring into CI/CD pipelines. The post highlights the challenges of migrating a large codebase with many developers and the benefits of using a dedicated product for synthetic testing.