Pattern-Based Log Generator for Realistic Load

[TheSafo]

PR by Bits for Dev Agent Session

You can ask for changes by mentioning @DataDog in a comment.

Feedback (especially what can be better) welcome in #code-gen-feedback!

---

What does this PR do?

This pull request introduces a new patterned variant to the file generator that creates realistic, deterministic log sequences instead of purely random logs. The generator precomputes a cache of common operational patterns including HTTP success responses, transient API failures, background job execution, and slow database queries.

Motivation

Users requested a log generator capable of producing more realistic load patterns that reflect actual application behavior. The patterned generator builds on existing file generator infrastructure while maintaining determinism through seeding, enabling repeatable testing scenarios with authentic log lifecycle sequences.

Related issues

This implements the feature request for pattern-based log generation to improve load testing realism and repeatability.

Additional Notes

• The implementation includes four distinct pattern types: HTTP success, HTTP error, background job, and database slow query sequences
• Pattern distribution is configurable via weights to control the relative frequency of each pattern type
• All sequences are deterministically generated from a seed, ensuring reproducible test runs
• The generator respects throughput limits via the existing throttle infrastructure
• Example configuration is provided in examples/lading-patterned-filegen.yaml
• Comprehensive test coverage validates request ID consistency across sequences and cache building with default settings

[datadog-datadog-prod-us1]

Bits AI Dev Agent Status: ✅ Done [Fix CI Errors]

Status History (2 entries)

2025-11-03 16:30:23 UTC ✅ Processed user query
2025-11-08 04:47:52 UTC ❎️ Stopped monitoring for CI failures due to age of PR

You can ask for changes by mentioning @DataDog in a comment.