Skip to content

chore(ci_visibility): fix test isolation for xdist and Docker worktree#17458

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 5 commits intomainfrom
gnufede/xdist-pr2-test-fixes
Apr 14, 2026
Merged

chore(ci_visibility): fix test isolation for xdist and Docker worktree#17458
gh-worker-dd-mergequeue-cf854d[bot] merged 5 commits intomainfrom
gnufede/xdist-pr2-test-fixes

Conversation

@gnufede
Copy link
Copy Markdown
Member

@gnufede gnufede commented Apr 10, 2026

Summary

Test isolation fixes that make the ci_visibility, pytest, and testing test suites robust when running with --ddtrace -n auto in the outer session.

Depends on: #17457 (_suspend()/_resume() API)

ci_visibility suite

  • Add tests/ci_visibility/conftest.py with an autouse _ci_visibility_isolation fixture using _suspend()/_resume() so the outer CIVisibility singleton is never stopped by tests that call enable()/disable() directly.
  • Replace the _disable_ci_visibility fixture in api_client/_util.py with the same pattern.
  • Fix TestUploadGitMetadata: mock _get_git_dir() to avoid silent FAILED status from git worktrees in Docker.
  • Fix test_ci_visibility_service_enable_without_service: mock ci.tags() and DEFAULT_SPAN_SERVICE_NAME so the expected service name is deterministic regardless of outer git/env context.
  • Fix test_encoder.py: replace index-based span access with type-based lookup (xdist does not guarantee ordering); remove PYTEST_XDIST_WORKER env leakage.

pytest/testing suites

  • Wrap inline_run() in test_pytest.py with _suspend()/_resume() so the outer CIVisibility instance survives inner sessions' disable()/enable() cycles.
  • Remove PYTEST_XDIST_WORKER/PYTEST_XDIST_TESTRUNUID leakage from inner runs so inline_run() tests are not misidentified as xdist workers.
  • Add monkeypatch.delenv("PYTEST_XDIST_WORKER") in test_pytest_benchmark.py.

Test plan

  • ci_visibility::ci_visibility venvs eef30c1, 1f30a84 pass
  • ci_visibility::pytest venvs 16b0319, 407c34d pass
  • CI green

Stacked PRs

  1. chore(ci_visibility): add _suspend/_resume and live xdist env detection #17457 — production plugin fixes (base of this PR)
  2. This PR — test isolation fixes
  3. ci: enable --ddtrace and xdist for pytest, ci_visibility, and testing suites #17459 enable --ddtrace -n auto in riotfile (depends on this PR)

🤖 Generated with Claude Code

gnufede and others added 2 commits April 10, 2026 13:36
…e xdist env detection

Four sources of module-level bleed-through prevented running the ddtrace
plugin in the outer pytest process when inline_run() starts inner sessions:

1. PYTEST_XDIST_WORKER_VALUE frozen at import time — add is_xdist_worker_env()
   which reads os.environ live so inner inline_run() sessions (which clear
   PYTEST_XDIST_WORKER from the env) correctly detect they are not workers.

2. skipped_suites and skip_pytest_runtest_protocol never reset between
   inline_run() calls — reset both in pytest_configure() for every new
   main-process session (guarded by not hasattr(config, "workerinput")).

3. CIVisibility singleton has no isolation support — add _suspend()/_resume()
   class methods that remove/restore _instance, enabled, and the service
   registry pointer without going through stop()/start() on the outer
   session's instance. enable() and disable() are unchanged.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…orktree

ci_visibility suite:
- Add tests/ci_visibility/conftest.py with an autouse _ci_visibility_isolation
  fixture using the new _suspend()/_resume() API so the outer CIVisibility
  singleton is never stopped by tests that call enable()/disable() directly.
- Replace the _disable_ci_visibility fixture in api_client/_util.py with the
  same _suspend()/_resume() pattern so TestTestVisibilityAPIClientBase tests
  are properly isolated when running with --ddtrace in the outer session.
- Fix TestUploadGitMetadata: mock _get_git_dir() to avoid silent FAILED status
  from git worktrees in Docker (the real call returns '' in that environment).
- Fix test_ci_visibility_service_enable_without_service: mock ci.tags() and
  DEFAULT_SPAN_SERVICE_NAME so the expected service name is deterministic
  regardless of the outer git/env context.
- Fix test_encoder.py: replace index-based span access with type-based lookup
  (xdist does not guarantee ordering); remove PYTEST_XDIST_WORKER leakage.

pytest/testing suites:
- Wrap inline_run() in test_pytest.py with _suspend()/_resume() so the outer
  CIVisibility instance survives inner sessions' disable()/enable() cycles.
- Remove PYTEST_XDIST_WORKER/PYTEST_XDIST_TESTRUNUID leakage from inner runs
  so inline_run() tests are not misidentified as xdist workers.
- Add monkeypatch.delenv("PYTEST_XDIST_WORKER") in test_pytest_benchmark.py.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@datadog-datadog-prod-us1-2
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1-2 bot commented Apr 10, 2026

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7222b1d | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

@gnufede gnufede changed the title test(ci_visibility,pytest): fix test isolation for xdist and Docker worktree chore(ci_visibility): fix test isolation for xdist and Docker worktree Apr 10, 2026
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 10, 2026

Performance SLOs

Comparing candidate gnufede/xdist-pr2-test-fixes (2c410e7) with baseline gnufede/xdist-pr1-plugin-fixes (3ea8971)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 102.818µs (SLO: <130.000µs 📉 -20.9%) vs baseline: +0.4%

Memory: ✅ 43.841MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%


✅ add_inplace_aspect

Time: ✅ 101.045µs (SLO: <130.000µs 📉 -22.3%) vs baseline: -1.9%

Memory: ✅ 43.995MB (SLO: <46.000MB -4.4%) vs baseline: +5.6%


✅ add_inplace_noaspect

Time: ✅ 28.423µs (SLO: <40.000µs 📉 -28.9%) vs baseline: +1.1%

Memory: ✅ 43.898MB (SLO: <46.000MB -4.6%) vs baseline: +5.6%


✅ add_noaspect

Time: ✅ 48.538µs (SLO: <70.000µs 📉 -30.7%) vs baseline: -1.7%

Memory: ✅ 43.902MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ bytearray_aspect

Time: ✅ 259.879µs (SLO: <400.000µs 📉 -35.0%) vs baseline: -0.7%

Memory: ✅ 43.862MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ bytearray_extend_aspect

Time: ✅ 653.418µs (SLO: <800.000µs 📉 -18.3%) vs baseline: +1.5%

Memory: ✅ 43.821MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


✅ bytearray_extend_noaspect

Time: ✅ 277.900µs (SLO: <400.000µs 📉 -30.5%) vs baseline: +6.3%

Memory: ✅ 43.884MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ bytearray_noaspect

Time: ✅ 143.701µs (SLO: <300.000µs 📉 -52.1%) vs baseline: +0.8%

Memory: ✅ 43.861MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


✅ bytes_aspect

Time: ✅ 220.634µs (SLO: <300.000µs 📉 -26.5%) vs baseline: -1.8%

Memory: ✅ 43.839MB (SLO: <46.000MB -4.7%) vs baseline: +4.9%


✅ bytes_noaspect

Time: ✅ 135.815µs (SLO: <200.000µs 📉 -32.1%) vs baseline: +0.9%

Memory: ✅ 43.884MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ bytesio_aspect

Time: ✅ 3.889ms (SLO: <5.000ms 📉 -22.2%) vs baseline: +1.0%

Memory: ✅ 43.903MB (SLO: <46.000MB -4.6%) vs baseline: +5.1%


✅ bytesio_noaspect

Time: ✅ 321.436µs (SLO: <420.000µs 📉 -23.5%) vs baseline: +0.3%

Memory: ✅ 43.885MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ capitalize_aspect

Time: ✅ 88.572µs (SLO: <300.000µs 📉 -70.5%) vs baseline: ~same

Memory: ✅ 43.948MB (SLO: <46.000MB -4.5%) vs baseline: +5.7%


✅ capitalize_noaspect

Time: ✅ 264.454µs (SLO: <300.000µs 📉 -11.8%) vs baseline: +4.4%

Memory: ✅ 43.960MB (SLO: <46.000MB -4.4%) vs baseline: +5.6%


✅ casefold_aspect

Time: ✅ 91.445µs (SLO: <500.000µs 📉 -81.7%) vs baseline: +3.0%

Memory: ✅ 43.922MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ casefold_noaspect

Time: ✅ 305.597µs (SLO: <500.000µs 📉 -38.9%) vs baseline: -2.1%

Memory: ✅ 43.942MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%


✅ decode_aspect

Time: ✅ 87.226µs (SLO: <100.000µs 📉 -12.8%) vs baseline: +0.5%

Memory: ✅ 43.888MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%


✅ decode_noaspect

Time: ✅ 159.807µs (SLO: <210.000µs 📉 -23.9%) vs baseline: +2.9%

Memory: ✅ 43.924MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%


✅ encode_aspect

Time: ✅ 84.590µs (SLO: <200.000µs 📉 -57.7%) vs baseline: +0.6%

Memory: ✅ 43.864MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ encode_noaspect

Time: ✅ 147.545µs (SLO: <200.000µs 📉 -26.2%) vs baseline: +3.3%

Memory: ✅ 43.866MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ format_aspect

Time: ✅ 14.570ms (SLO: <19.200ms 📉 -24.1%) vs baseline: -0.3%

Memory: ✅ 43.977MB (SLO: <46.000MB -4.4%) vs baseline: +5.4%


✅ format_map_aspect

Time: ✅ 16.355ms (SLO: <21.500ms 📉 -23.9%) vs baseline: -0.5%

Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%


✅ format_map_noaspect

Time: ✅ 368.406µs (SLO: <500.000µs 📉 -26.3%) vs baseline: -2.7%

Memory: ✅ 43.885MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%


✅ format_noaspect

Time: ✅ 314.590µs (SLO: <500.000µs 📉 -37.1%) vs baseline: -2.2%

Memory: ✅ 43.905MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%


✅ index_aspect

Time: ✅ 122.385µs (SLO: <300.000µs 📉 -59.2%) vs baseline: -3.5%

Memory: ✅ 43.937MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ index_noaspect

Time: ✅ 40.670µs (SLO: <300.000µs 📉 -86.4%) vs baseline: -1.1%

Memory: ✅ 43.796MB (SLO: <46.000MB -4.8%) vs baseline: +5.1%


✅ join_aspect

Time: ✅ 207.320µs (SLO: <300.000µs 📉 -30.9%) vs baseline: -3.4%

Memory: ✅ 43.899MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%


✅ join_noaspect

Time: ✅ 140.756µs (SLO: <300.000µs 📉 -53.1%) vs baseline: -4.6%

Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ ljust_aspect

Time: ✅ 502.494µs (SLO: <700.000µs 📉 -28.2%) vs baseline: -2.4%

Memory: ✅ 43.941MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%


✅ ljust_noaspect

Time: ✅ 264.629µs (SLO: <300.000µs 📉 -11.8%) vs baseline: -1.5%

Memory: ✅ 43.927MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%


✅ lower_aspect

Time: ✅ 305.762µs (SLO: <500.000µs 📉 -38.8%) vs baseline: -1.9%

Memory: ✅ 43.952MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%


✅ lower_noaspect

Time: ✅ 246.797µs (SLO: <300.000µs 📉 -17.7%) vs baseline: +3.6%

Memory: ✅ 43.828MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%


✅ lstrip_aspect

Time: ✅ 0.347ms (SLO: <3.000ms 📉 -88.4%) vs baseline: 📈 +25.2%

Memory: ✅ 43.957MB (SLO: <46.000MB -4.4%) vs baseline: +5.5%


✅ lstrip_noaspect

Time: ✅ 0.179ms (SLO: <3.000ms 📉 -94.0%) vs baseline: +0.8%

Memory: ✅ 43.922MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ modulo_aspect

Time: ✅ 14.329ms (SLO: <18.750ms 📉 -23.6%) vs baseline: +0.6%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +5.2%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.794ms (SLO: <19.350ms 📉 -23.5%) vs baseline: -0.3%

Memory: ✅ 43.964MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%


✅ modulo_aspect_for_bytes

Time: ✅ 14.462ms (SLO: <18.900ms 📉 -23.5%) vs baseline: +0.6%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +5.2%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.542ms (SLO: <19.150ms 📉 -24.1%) vs baseline: -0.7%

Memory: ✅ 43.884MB (SLO: <46.000MB -4.6%) vs baseline: +5.1%


✅ modulo_noaspect

Time: ✅ 0.366ms (SLO: <3.000ms 📉 -87.8%) vs baseline: -0.8%

Memory: ✅ 43.910MB (SLO: <46.000MB -4.5%) vs baseline: +5.3%


✅ replace_aspect

Time: ✅ 18.948ms (SLO: <24.000ms 📉 -21.1%) vs baseline: +3.0%

Memory: ✅ 43.985MB (SLO: <46.000MB -4.4%) vs baseline: +5.7%


✅ replace_noaspect

Time: ✅ 287.372µs (SLO: <400.000µs 📉 -28.2%) vs baseline: +1.5%

Memory: ✅ 43.945MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%


✅ repr_aspect

Time: ✅ 318.117µs (SLO: <420.000µs 📉 -24.3%) vs baseline: -2.5%

Memory: ✅ 43.877MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ repr_noaspect

Time: ✅ 46.693µs (SLO: <90.000µs 📉 -48.1%) vs baseline: -0.5%

Memory: ✅ 43.822MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%


✅ rstrip_aspect

Time: ✅ 383.187µs (SLO: <500.000µs 📉 -23.4%) vs baseline: -0.9%

Memory: ✅ 43.917MB (SLO: <46.000MB -4.5%) vs baseline: +5.3%


✅ rstrip_noaspect

Time: ✅ 187.311µs (SLO: <300.000µs 📉 -37.6%) vs baseline: +3.6%

Memory: ✅ 43.886MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ slice_aspect

Time: ✅ 186.605µs (SLO: <300.000µs 📉 -37.8%) vs baseline: +1.3%

Memory: ✅ 43.910MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ slice_noaspect

Time: ✅ 54.229µs (SLO: <90.000µs 📉 -39.7%) vs baseline: +0.5%

Memory: ✅ 43.852MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%


✅ stringio_aspect

Time: ✅ 3.913ms (SLO: <5.000ms 📉 -21.7%) vs baseline: +0.7%

Memory: ✅ 43.942MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%


✅ stringio_noaspect

Time: ✅ 356.886µs (SLO: <500.000µs 📉 -28.6%) vs baseline: +1.0%

Memory: ✅ 43.890MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ strip_aspect

Time: ✅ 280.371µs (SLO: <350.000µs 📉 -19.9%) vs baseline: +0.5%

Memory: ✅ 43.936MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ strip_noaspect

Time: ✅ 182.302µs (SLO: <240.000µs 📉 -24.0%) vs baseline: +3.6%

Memory: ✅ 43.813MB (SLO: <46.000MB -4.8%) vs baseline: +5.2%


✅ swapcase_aspect

Time: ✅ 345.243µs (SLO: <500.000µs 📉 -31.0%) vs baseline: -2.2%

Memory: ✅ 43.907MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ swapcase_noaspect

Time: ✅ 282.906µs (SLO: <400.000µs 📉 -29.3%) vs baseline: +3.1%

Memory: ✅ 43.867MB (SLO: <46.000MB -4.6%) vs baseline: +5.1%


✅ title_aspect

Time: ✅ 332.067µs (SLO: <500.000µs 📉 -33.6%) vs baseline: -1.8%

Memory: ✅ 43.890MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%


✅ title_noaspect

Time: ✅ 266.974µs (SLO: <400.000µs 📉 -33.3%) vs baseline: +1.6%

Memory: ✅ 43.925MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%


✅ translate_aspect

Time: ✅ 565.142µs (SLO: <700.000µs 📉 -19.3%) vs baseline: 📈 +12.7%

Memory: ✅ 43.825MB (SLO: <46.000MB -4.7%) vs baseline: +4.9%


✅ translate_noaspect

Time: ✅ 431.725µs (SLO: <500.000µs 📉 -13.7%) vs baseline: ~same

Memory: ✅ 43.851MB (SLO: <46.000MB -4.7%) vs baseline: +5.0%


✅ upper_aspect

Time: ✅ 305.002µs (SLO: <500.000µs 📉 -39.0%) vs baseline: -2.7%

Memory: ✅ 43.979MB (SLO: <46.000MB -4.4%) vs baseline: +5.7%


✅ upper_noaspect

Time: ✅ 248.004µs (SLO: <400.000µs 📉 -38.0%) vs baseline: +4.0%

Memory: ✅ 43.892MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 525.870µs (SLO: <700.000µs 📉 -24.9%) vs baseline: 📈 +21.8%

Memory: ✅ 43.813MB (SLO: <46.000MB -4.8%) vs baseline: +5.3%


✅ ospathbasename_noaspect

Time: ✅ 446.925µs (SLO: <700.000µs 📉 -36.2%) vs baseline: +1.6%

Memory: ✅ 43.847MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%


✅ ospathjoin_aspect

Time: ✅ 637.704µs (SLO: <700.000µs -8.9%) vs baseline: +1.0%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +5.2%


✅ ospathjoin_noaspect

Time: ✅ 644.430µs (SLO: <700.000µs -7.9%) vs baseline: -0.4%

Memory: ✅ 43.884MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%


✅ ospathnormcase_aspect

Time: ✅ 363.521µs (SLO: <700.000µs 📉 -48.1%) vs baseline: +3.5%

Memory: ✅ 43.862MB (SLO: <46.000MB -4.6%) vs baseline: +5.1%


✅ ospathnormcase_noaspect

Time: ✅ 363.703µs (SLO: <700.000µs 📉 -48.0%) vs baseline: ~same

Memory: ✅ 43.885MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ ospathsplit_aspect

Time: ✅ 500.259µs (SLO: <700.000µs 📉 -28.5%) vs baseline: +1.9%

Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%


✅ ospathsplit_noaspect

Time: ✅ 504.813µs (SLO: <700.000µs 📉 -27.9%) vs baseline: -0.1%

Memory: ✅ 43.886MB (SLO: <46.000MB -4.6%) vs baseline: +5.6%


✅ ospathsplitdrive_aspect

Time: ✅ 383.926µs (SLO: <700.000µs 📉 -45.2%) vs baseline: +1.7%

Memory: ✅ 43.896MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%


✅ ospathsplitdrive_noaspect

Time: ✅ 72.761µs (SLO: <700.000µs 📉 -89.6%) vs baseline: +0.4%

Memory: ✅ 43.802MB (SLO: <46.000MB -4.8%) vs baseline: +5.2%


✅ ospathsplitext_aspect

Time: ✅ 476.819µs (SLO: <700.000µs 📉 -31.9%) vs baseline: +2.7%

Memory: ✅ 43.891MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%


✅ ospathsplitext_noaspect

Time: ✅ 478.789µs (SLO: <700.000µs 📉 -31.6%) vs baseline: +1.4%

Memory: ✅ 43.944MB (SLO: <46.000MB -4.5%) vs baseline: +5.7%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.345µs (SLO: <20.000µs 📉 -88.3%) vs baseline: 📈 +10.6%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.4%


✅ 1-count-metrics-100-times

Time: ✅ 154.569µs (SLO: <220.000µs 📉 -29.7%) vs baseline: +1.5%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ 1-distribution-metric-1-times

Time: ✅ 2.415µs (SLO: <20.000µs 📉 -87.9%) vs baseline: -4.6%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%


✅ 1-distribution-metrics-100-times

Time: ✅ 164.077µs (SLO: <230.000µs 📉 -28.7%) vs baseline: -1.3%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%


✅ 1-gauge-metric-1-times

Time: ✅ 1.999µs (SLO: <20.000µs 📉 -90.0%) vs baseline: -0.5%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +5.5%


✅ 1-gauge-metrics-100-times

Time: ✅ 138.455µs (SLO: <150.000µs -7.7%) vs baseline: +0.3%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.2%


✅ 1-rate-metric-1-times

Time: ✅ 2.273µs (SLO: <20.000µs 📉 -88.6%) vs baseline: +1.3%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.0%


✅ 1-rate-metrics-100-times

Time: ✅ 168.595µs (SLO: <250.000µs 📉 -32.6%) vs baseline: +0.8%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


✅ 100-count-metrics-100-times

Time: ✅ 15.548ms (SLO: <22.000ms 📉 -29.3%) vs baseline: +0.9%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.0%


✅ 100-distribution-metrics-100-times

Time: ✅ 1.726ms (SLO: <2.550ms 📉 -32.3%) vs baseline: -1.7%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.404ms (SLO: <1.550ms -9.4%) vs baseline: -0.5%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.5%


✅ 100-rate-metrics-100-times

Time: ✅ 1.741ms (SLO: <2.550ms 📉 -31.7%) vs baseline: +1.6%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.3%


✅ flush-1-metric

Time: ✅ 3.629µs (SLO: <20.000µs 📉 -81.9%) vs baseline: +1.5%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +6.5%


✅ flush-100-metrics

Time: ✅ 174.022µs (SLO: <250.000µs 📉 -30.4%) vs baseline: -1.7%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +5.2%


✅ flush-1000-metrics

Time: ✅ 2.197ms (SLO: <2.500ms 📉 -12.1%) vs baseline: -0.2%

Memory: ✅ 37.041MB (SLO: <38.750MB -4.4%) vs baseline: +5.3%

🟡 Near SLO Breach (5 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.735ms (SLO: <22.300ms 📉 -11.5%) vs baseline: +0.4%

Memory: ✅ 69.325MB (SLO: <73.500MB -5.7%) vs baseline: +5.1%


✅ exception-replay-enabled

Time: ✅ 1.370ms (SLO: <1.450ms -5.5%) vs baseline: ~same

Memory: ✅ 67.672MB (SLO: <71.500MB -5.4%) vs baseline: +5.2%


✅ iast

Time: ✅ 19.664ms (SLO: <22.250ms 📉 -11.6%) vs baseline: -0.2%

Memory: ✅ 69.374MB (SLO: <75.000MB -7.5%) vs baseline: +5.0%


✅ profiler

Time: ✅ 15.149ms (SLO: <16.550ms -8.5%) vs baseline: -0.2%

Memory: ✅ 59.971MB (SLO: <61.000MB 🟡 -1.7%) vs baseline: +5.4%


✅ resource-renaming

Time: ✅ 19.611ms (SLO: <21.750ms -9.8%) vs baseline: +0.4%

Memory: ✅ 69.499MB (SLO: <73.500MB -5.4%) vs baseline: +5.3%


✅ span-code-origin

Time: ✅ 20.155ms (SLO: <28.200ms 📉 -28.5%) vs baseline: +1.2%

Memory: ✅ 69.512MB (SLO: <75.000MB -7.3%) vs baseline: +5.4%


✅ tracer

Time: ✅ 19.804ms (SLO: <21.750ms -8.9%) vs baseline: +0.9%

Memory: ✅ 69.393MB (SLO: <75.000MB -7.5%) vs baseline: +5.0%


✅ tracer-and-profiler

Time: ✅ 20.973ms (SLO: <23.500ms 📉 -10.8%) vs baseline: -0.2%

Memory: ✅ 71.349MB (SLO: <75.000MB -4.9%) vs baseline: +5.1%


✅ tracer-dont-create-db-spans

Time: ✅ 19.718ms (SLO: <21.500ms -8.3%) vs baseline: +0.4%

Memory: ✅ 69.471MB (SLO: <75.000MB -7.4%) vs baseline: +5.3%


✅ tracer-minimal

Time: ✅ 16.647ms (SLO: <17.500ms -4.9%) vs baseline: -0.1%

Memory: ✅ 69.282MB (SLO: <75.000MB -7.6%) vs baseline: +4.9%


✅ tracer-native

Time: ✅ 19.593ms (SLO: <21.750ms -9.9%) vs baseline: +0.6%

Memory: ✅ 69.351MB (SLO: <72.500MB -4.3%) vs baseline: +5.1%


✅ tracer-no-caches

Time: ✅ 17.471ms (SLO: <19.650ms 📉 -11.1%) vs baseline: ~same

Memory: ✅ 69.294MB (SLO: <75.000MB -7.6%) vs baseline: +5.1%


✅ tracer-no-databases

Time: ✅ 19.260ms (SLO: <20.100ms -4.2%) vs baseline: +0.2%

Memory: ✅ 69.264MB (SLO: <75.000MB -7.6%) vs baseline: +4.9%


✅ tracer-no-middleware

Time: ✅ 19.274ms (SLO: <21.500ms 📉 -10.4%) vs baseline: -0.6%

Memory: ✅ 69.353MB (SLO: <75.000MB -7.5%) vs baseline: +5.1%


✅ tracer-no-templates

Time: ✅ 19.624ms (SLO: <22.000ms 📉 -10.8%) vs baseline: +1.2%

Memory: ✅ 69.424MB (SLO: <73.500MB -5.5%) vs baseline: +5.2%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.821ms (SLO: <47.150ms 📉 -13.4%) vs baseline: -0.5%

Memory: ✅ 41.374MB (SLO: <47.000MB 📉 -12.0%) vs baseline: +5.8%


✅ add-metrics

Time: ✅ 235.650ms (SLO: <344.800ms 📉 -31.7%) vs baseline: -0.5%

Memory: ✅ 45.623MB (SLO: <47.500MB -4.0%) vs baseline: +5.4%


✅ add-tags

Time: ✅ 278.594ms (SLO: <330.000ms 📉 -15.6%) vs baseline: +2.7%

Memory: ✅ 45.704MB (SLO: <47.500MB -3.8%) vs baseline: +5.2%


✅ get-context

Time: ✅ 83.711ms (SLO: <92.350ms -9.4%) vs baseline: ~same

Memory: ✅ 41.602MB (SLO: <46.500MB 📉 -10.5%) vs baseline: +5.3%


✅ is-recording

Time: ✅ 39.030ms (SLO: <44.500ms 📉 -12.3%) vs baseline: -0.5%

Memory: ✅ 41.221MB (SLO: <47.500MB 📉 -13.2%) vs baseline: +5.6%


✅ record-exception

Time: ✅ 61.272ms (SLO: <67.650ms -9.4%) vs baseline: ~same

Memory: ✅ 41.751MB (SLO: <47.000MB 📉 -11.2%) vs baseline: +5.3%


✅ set-status

Time: ✅ 45.130ms (SLO: <50.400ms 📉 -10.5%) vs baseline: ~same

Memory: ✅ 41.187MB (SLO: <47.000MB 📉 -12.4%) vs baseline: +5.7%


✅ start

Time: ✅ 39.931ms (SLO: <44.500ms 📉 -10.3%) vs baseline: +3.5%

Memory: ✅ 41.040MB (SLO: <47.000MB 📉 -12.7%) vs baseline: +5.1%


✅ start-finish

Time: ✅ 90.423ms (SLO: <91.000ms 🟡 -0.6%) vs baseline: +0.4%

Memory: ✅ 38.673MB (SLO: <46.500MB 📉 -16.8%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 91.905ms (SLO: <92.000ms 🟡 -0.1%) vs baseline: ~same

Memory: ✅ 38.732MB (SLO: <46.500MB 📉 -16.7%) vs baseline: +5.2%


✅ update-name

Time: ✅ 40.206ms (SLO: <45.150ms 📉 -10.9%) vs baseline: -0.4%

Memory: ✅ 41.247MB (SLO: <47.000MB 📉 -12.2%) vs baseline: +5.2%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 312.624ms (SLO: <320.950ms -2.6%) vs baseline: +0.3%

Memory: ✅ 37.434MB (SLO: <38.750MB -3.4%) vs baseline: +5.4%


✅ deep-profiled

Time: ✅ 328.253ms (SLO: <359.150ms -8.6%) vs baseline: -0.2%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.5%


✅ medium

Time: ✅ 7.405ms (SLO: <7.450ms 🟡 -0.6%) vs baseline: -0.5%

Memory: ✅ 36.176MB (SLO: <38.000MB -4.8%) vs baseline: +5.4%


✅ shallow

Time: ✅ 1.048ms (SLO: <1.050ms 🟡 -0.2%) vs baseline: +1.5%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


🟡 span - 26/26

✅ add-event

Time: ✅ 19.593ms (SLO: <22.500ms 📉 -12.9%) vs baseline: -1.4%

Memory: ✅ 38.426MB (SLO: <53.000MB 📉 -27.5%) vs baseline: +5.5%


✅ add-metrics

Time: ✅ 89.918ms (SLO: <93.500ms -3.8%) vs baseline: +0.8%

Memory: ✅ 42.861MB (SLO: <53.000MB 📉 -19.1%) vs baseline: +5.2%


✅ add-tags

Time: ✅ 149.107ms (SLO: <155.000ms -3.8%) vs baseline: +0.6%

Memory: ✅ 42.953MB (SLO: <53.000MB 📉 -19.0%) vs baseline: +5.5%


✅ get-context

Time: ✅ 18.667ms (SLO: <20.500ms -8.9%) vs baseline: -2.2%

Memory: ✅ 38.342MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.6%


✅ is-recording

Time: ✅ 18.762ms (SLO: <20.500ms -8.5%) vs baseline: -1.8%

Memory: ✅ 38.424MB (SLO: <53.000MB 📉 -27.5%) vs baseline: +5.7%


✅ record-exception

Time: ✅ 38.512ms (SLO: <41.000ms -6.1%) vs baseline: -0.2%

Memory: ✅ 38.869MB (SLO: <53.000MB 📉 -26.7%) vs baseline: +5.6%


✅ set-status

Time: ✅ 20.663ms (SLO: <22.000ms -6.1%) vs baseline: -1.4%

Memory: ✅ 38.255MB (SLO: <53.000MB 📉 -27.8%) vs baseline: +5.4%


✅ start

Time: ✅ 19.715ms (SLO: <20.500ms -3.8%) vs baseline: +4.7%

Memory: ✅ 38.336MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.6%


✅ start-finish

Time: ✅ 58.077ms (SLO: <58.500ms 🟡 -0.7%) vs baseline: -0.4%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ start-finish-telemetry

Time: ✅ 59.200ms (SLO: <60.000ms 🟡 -1.3%) vs baseline: -0.7%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.9%


✅ start-finish-traceid128

Time: ✅ 60.551ms (SLO: <62.000ms -2.3%) vs baseline: -0.6%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.4%


✅ start-traceid128

Time: ✅ 18.776ms (SLO: <22.500ms 📉 -16.5%) vs baseline: -0.8%

Memory: ✅ 38.320MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.3%


✅ update-name

Time: ✅ 19.233ms (SLO: <22.000ms 📉 -12.6%) vs baseline: -1.5%

Memory: ✅ 38.408MB (SLO: <53.000MB 📉 -27.5%) vs baseline: +5.6%


🟡 tracer - 6/6

✅ large

Time: ✅ 33.067ms (SLO: <32.950ms +0.4%) vs baseline: -0.3%

Memory: ✅ 37.827MB (SLO: <39.250MB -3.6%) vs baseline: +6.0%


✅ medium

Time: ✅ 3.343ms (SLO: <3.500ms -4.5%) vs baseline: ~same

Memory: ✅ 36.215MB (SLO: <38.750MB -6.5%) vs baseline: +5.4%


✅ small

Time: ✅ 385.459µs (SLO: <390.000µs 🟡 -1.2%) vs baseline: +3.4%

Memory: ✅ 36.176MB (SLO: <38.750MB -6.6%) vs baseline: +5.3%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.635µs (SLO: <20.000µs 📉 -31.8%) vs baseline: -0.2%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


✅ context_with_data_no_listeners

Time: ✅ 3.623µs (SLO: <10.000µs 📉 -63.8%) vs baseline: +0.7%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%


✅ get_item_exists

Time: ✅ 0.583µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.4%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.3%


✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.3%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.6%


✅ set_item

Time: ✅ 24.512µs (SLO: <30.000µs 📉 -18.3%) vs baseline: +0.5%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.7%


⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.889µs (SLO: <170.000µs -8.3%) vs baseline: +0.4%

Memory: ✅ 41.397MB (SLO: <46.000MB 📉 -10.0%) vs baseline: +6.6%


✅ import_many_cached

Time: ✅ 121.823µs (SLO: <130.000µs -6.3%) vs baseline: +0.8%

Memory: ✅ 41.036MB (SLO: <46.000MB 📉 -10.8%) vs baseline: +5.7%


✅ import_many_stdlib

Time: ✅ 0.798ms (SLO: <1.750ms 📉 -54.4%) vs baseline: -0.1%

Memory: ✅ 41.125MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +6.0%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.187ms (SLO: <1.100ms 📉 -83.0%) vs baseline: +0.2%

Memory: ✅ 40.751MB (SLO: <46.000MB 📉 -11.4%) vs baseline: +4.9%


✅ import_many_unknown

Time: ✅ 830.184µs (SLO: <890.000µs -6.7%) vs baseline: -1.0%

Memory: ✅ 41.361MB (SLO: <46.000MB 📉 -10.1%) vs baseline: +6.3%


✅ import_many_unknown_cached

Time: ✅ 787.729µs (SLO: <870.000µs -9.5%) vs baseline: ~same

Memory: ✅ 41.092MB (SLO: <46.000MB 📉 -10.7%) vs baseline: +4.9%


✅ import_one

Time: ✅ 19.842µs (SLO: <30.000µs 📉 -33.9%) vs baseline: +0.3%

Memory: ✅ 40.934MB (SLO: <46.000MB 📉 -11.0%) vs baseline: +5.3%


✅ import_one_cache

Time: ✅ 6.311µs (SLO: <10.000µs 📉 -36.9%) vs baseline: -0.3%

Memory: ✅ 40.957MB (SLO: <46.000MB 📉 -11.0%) vs baseline: +5.1%


✅ import_one_stdlib

Time: ✅ 18.803µs (SLO: <20.000µs -6.0%) vs baseline: -0.5%

Memory: ✅ 40.874MB (SLO: <46.000MB 📉 -11.1%) vs baseline: +4.9%


✅ import_one_stdlib_cache

Time: ✅ 6.302µs (SLO: <10.000µs 📉 -37.0%) vs baseline: -0.1%

Memory: ✅ 41.122MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +6.2%


✅ import_one_unknown

Time: ✅ 45.618µs (SLO: <50.000µs -8.8%) vs baseline: ~same

Memory: ✅ 41.043MB (SLO: <46.000MB 📉 -10.8%) vs baseline: +6.0%


✅ import_one_unknown_cache

Time: ✅ 6.309µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.2%

Memory: ✅ 40.970MB (SLO: <43.000MB -4.7%) vs baseline: +6.0%

✅ All Tests Passing (16 suites)
codeprovenancefork - 2/2

✅ fork-10

Time: ✅ 2.197s (SLO: <2.300s -4.5%) vs baseline: +2.8%

Memory: ✅ 17.459MB (SLO: <20.000MB 📉 -12.7%) vs baseline: +5.1%


errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.275ms (SLO: <19.850ms 📉 -18.0%) vs baseline: +0.6%

Memory: ✅ 68.832MB (SLO: <75.000MB -8.2%) vs baseline: +5.1%


✅ errortracking-enabled-user

Time: ✅ 16.248ms (SLO: <19.400ms 📉 -16.2%) vs baseline: +0.6%

Memory: ✅ 68.852MB (SLO: <75.000MB -8.2%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 16.326ms (SLO: <19.450ms 📉 -16.1%) vs baseline: +0.4%

Memory: ✅ 68.830MB (SLO: <75.000MB -8.2%) vs baseline: +5.0%


errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.121ms (SLO: <2.300ms -7.8%) vs baseline: +0.2%

Memory: ✅ 56.417MB (SLO: <60.000MB -6.0%) vs baseline: +5.2%


✅ errortracking-enabled-user

Time: ✅ 2.131ms (SLO: <2.250ms -5.3%) vs baseline: +0.4%

Memory: ✅ 56.465MB (SLO: <60.000MB -5.9%) vs baseline: +5.3%


✅ tracer-enabled

Time: ✅ 2.121ms (SLO: <2.300ms -7.8%) vs baseline: +0.3%

Memory: ✅ 56.100MB (SLO: <60.000MB -6.5%) vs baseline: +4.7%


flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.411ms (SLO: <4.750ms 📉 -28.2%) vs baseline: ~same

Memory: ✅ 56.552MB (SLO: <66.500MB 📉 -15.0%) vs baseline: +5.5%


✅ appsec-post

Time: ✅ 2.913ms (SLO: <6.750ms 📉 -56.8%) vs baseline: +0.3%

Memory: ✅ 56.611MB (SLO: <66.500MB 📉 -14.9%) vs baseline: +5.5%


✅ appsec-telemetry

Time: ✅ 3.444ms (SLO: <4.750ms 📉 -27.5%) vs baseline: +1.3%

Memory: ✅ 56.555MB (SLO: <66.500MB 📉 -15.0%) vs baseline: +5.6%


✅ debugger

Time: ✅ 1.884ms (SLO: <2.000ms -5.8%) vs baseline: +0.3%

Memory: ✅ 49.320MB (SLO: <51.500MB -4.2%) vs baseline: +5.6%


✅ iast-get

Time: ✅ 1.870ms (SLO: <2.000ms -6.5%) vs baseline: -0.2%

Memory: ✅ 46.057MB (SLO: <49.000MB -6.0%) vs baseline: +5.8%


✅ profiler

Time: ✅ 1.911ms (SLO: <2.100ms -9.0%) vs baseline: -0.2%

Memory: ✅ 52.054MB (SLO: <53.500MB -2.7%) vs baseline: +5.9%


✅ resource-renaming

Time: ✅ 3.391ms (SLO: <3.650ms -7.1%) vs baseline: ~same

Memory: ✅ 56.512MB (SLO: <60.000MB -5.8%) vs baseline: +5.5%


✅ tracer

Time: ✅ 3.401ms (SLO: <3.650ms -6.8%) vs baseline: +0.3%

Memory: ✅ 56.577MB (SLO: <60.000MB -5.7%) vs baseline: +5.6%


✅ tracer-native

Time: ✅ 3.405ms (SLO: <3.650ms -6.7%) vs baseline: +0.6%

Memory: ✅ 56.611MB (SLO: <60.000MB -5.6%) vs baseline: +5.5%


flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.117ms (SLO: <4.200ms 📉 -49.6%) vs baseline: +0.2%

Memory: ✅ 56.369MB (SLO: <66.000MB 📉 -14.6%) vs baseline: +5.0%


✅ iast-enabled

Time: ✅ 2.117ms (SLO: <2.800ms 📉 -24.4%) vs baseline: ~same

Memory: ✅ 56.391MB (SLO: <62.500MB -9.8%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 2.113ms (SLO: <2.250ms -6.1%) vs baseline: +0.3%

Memory: ✅ 56.309MB (SLO: <60.000MB -6.2%) vs baseline: +4.9%


forktime - 4/4

✅ baseline

Time: ✅ 1.955ms (SLO: <3.000ms 📉 -34.8%) vs baseline: +4.6%

Memory: ✅ 29.275MB (SLO: <33.000MB 📉 -11.3%) vs baseline: +5.1%


✅ configured

Time: ✅ 8.814ms (SLO: <13.000ms 📉 -32.2%) vs baseline: -0.1%

Memory: ✅ 56.446MB (SLO: <60.000MB -5.9%) vs baseline: +5.5%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 77.022µs (SLO: <100.000µs 📉 -23.0%) vs baseline: +0.5%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%


✅ b3_headers

Time: ✅ 12.840µs (SLO: <20.000µs 📉 -35.8%) vs baseline: +0.6%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.3%


✅ b3_single_headers

Time: ✅ 11.931µs (SLO: <20.000µs 📉 -40.3%) vs baseline: +1.1%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 60.424µs (SLO: <80.000µs 📉 -24.5%) vs baseline: +0.8%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +4.9%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 63.672µs (SLO: <80.000µs 📉 -20.4%) vs baseline: +0.8%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%


✅ empty_headers

Time: ✅ 1.292µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.5%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%


✅ full_t_id_datadog_headers

Time: ✅ 21.645µs (SLO: <30.000µs 📉 -27.9%) vs baseline: +0.3%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.4%


✅ invalid_priority_header

Time: ✅ 5.920µs (SLO: <10.000µs 📉 -40.8%) vs baseline: +0.3%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.5%


✅ invalid_span_id_header

Time: ✅ 5.893µs (SLO: <10.000µs 📉 -41.1%) vs baseline: -0.6%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.2%


✅ invalid_tags_header

Time: ✅ 5.937µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.6%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.8%


✅ invalid_trace_id_header

Time: ✅ 5.936µs (SLO: <10.000µs 📉 -40.6%) vs baseline: -0.3%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.2%


✅ large_header_no_matches

Time: ✅ 27.034µs (SLO: <30.000µs -9.9%) vs baseline: +0.6%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ large_valid_headers_all

Time: ✅ 28.162µs (SLO: <40.000µs 📉 -29.6%) vs baseline: ~same

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%


✅ medium_header_no_matches

Time: ✅ 9.257µs (SLO: <20.000µs 📉 -53.7%) vs baseline: -0.5%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%


✅ medium_valid_headers_all

Time: ✅ 10.824µs (SLO: <20.000µs 📉 -45.9%) vs baseline: +0.3%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.4%


✅ none_propagation_style

Time: ✅ 1.391µs (SLO: <10.000µs 📉 -86.1%) vs baseline: ~same

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.1%


✅ tracecontext_headers

Time: ✅ 32.643µs (SLO: <40.000µs 📉 -18.4%) vs baseline: ~same

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ valid_headers_all

Time: ✅ 5.901µs (SLO: <10.000µs 📉 -41.0%) vs baseline: +0.3%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%


✅ valid_headers_basic

Time: ✅ 5.476µs (SLO: <10.000µs 📉 -45.2%) vs baseline: ~same

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ wsgi_empty_headers

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.2%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


✅ wsgi_invalid_priority_header

Time: ✅ 5.924µs (SLO: <10.000µs 📉 -40.8%) vs baseline: -0.2%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.296µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -1.5%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.8%


✅ wsgi_invalid_tags_header

Time: ✅ 5.944µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.1%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.4%


✅ wsgi_invalid_trace_id_header

Time: ✅ 5.939µs (SLO: <10.000µs 📉 -40.6%) vs baseline: -1.0%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%


✅ wsgi_large_header_no_matches

Time: ✅ 28.074µs (SLO: <40.000µs 📉 -29.8%) vs baseline: ~same

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.173µs (SLO: <40.000µs 📉 -27.1%) vs baseline: -0.2%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.3%


✅ wsgi_medium_header_no_matches

Time: ✅ 9.502µs (SLO: <20.000µs 📉 -52.5%) vs baseline: +0.3%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.2%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.077µs (SLO: <20.000µs 📉 -44.6%) vs baseline: +1.1%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%


✅ wsgi_valid_headers_all

Time: ✅ 5.956µs (SLO: <10.000µs 📉 -40.4%) vs baseline: -0.2%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%


✅ wsgi_valid_headers_basic

Time: ✅ 5.500µs (SLO: <10.000µs 📉 -45.0%) vs baseline: +0.3%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.931µs (SLO: <30.000µs 📉 -30.2%) vs baseline: +3.5%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%


✅ with_all

Time: ✅ 27.204µs (SLO: <40.000µs 📉 -32.0%) vs baseline: ~same

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%


✅ with_dd_origin

Time: ✅ 24.027µs (SLO: <30.000µs 📉 -19.9%) vs baseline: -0.3%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.7%


✅ with_priority_and_origin

Time: ✅ 23.383µs (SLO: <40.000µs 📉 -41.5%) vs baseline: -0.4%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%


✅ with_sampling_priority

Time: ✅ 20.247µs (SLO: <30.000µs 📉 -32.5%) vs baseline: +0.8%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%


✅ with_tags

Time: ✅ 25.189µs (SLO: <40.000µs 📉 -37.0%) vs baseline: +0.2%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.0%


✅ with_tags_invalid

Time: ✅ 26.599µs (SLO: <40.000µs 📉 -33.5%) vs baseline: +0.4%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


✅ with_tags_max_size

Time: ✅ 25.523µs (SLO: <40.000µs 📉 -36.2%) vs baseline: -0.2%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 165.418µs (SLO: <250.000µs 📉 -33.8%) vs baseline: +6.9%

Memory: ✅ 43.895MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%


✅ rsplit_noaspect

Time: ✅ 164.967µs (SLO: <250.000µs 📉 -34.0%) vs baseline: +3.1%

Memory: ✅ 43.821MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


✅ split_aspect

Time: ✅ 155.768µs (SLO: <250.000µs 📉 -37.7%) vs baseline: -0.2%

Memory: ✅ 43.847MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


✅ split_noaspect

Time: ✅ 160.843µs (SLO: <250.000µs 📉 -35.7%) vs baseline: +0.5%

Memory: ✅ 43.867MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%


✅ splitlines_aspect

Time: ✅ 149.844µs (SLO: <250.000µs 📉 -40.1%) vs baseline: +3.6%

Memory: ✅ 43.821MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


✅ splitlines_noaspect

Time: ✅ 155.640µs (SLO: <250.000µs 📉 -37.7%) vs baseline: +1.9%

Memory: ✅ 43.849MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.430µs (SLO: <60.000µs 📉 -19.3%) vs baseline: -0.6%

Memory: ✅ 39.892MB (SLO: <42.000MB -5.0%) vs baseline: +5.1%


✅ propagation_enabled

Time: ✅ 134.662µs (SLO: <190.000µs 📉 -29.1%) vs baseline: -0.6%

Memory: ✅ 40.069MB (SLO: <42.000MB -4.6%) vs baseline: +5.2%


✅ propagation_enabled_100

Time: ✅ 1.556ms (SLO: <2.300ms 📉 -32.4%) vs baseline: -0.9%

Memory: ✅ 39.990MB (SLO: <42.000MB -4.8%) vs baseline: +5.2%


✅ propagation_enabled_1000

Time: ✅ 28.849ms (SLO: <34.550ms 📉 -16.5%) vs baseline: -0.7%

Memory: ✅ 39.872MB (SLO: <42.000MB -5.1%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.612ms (SLO: <42.000ms -3.3%) vs baseline: +0.5%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.1%


✅ add-link

Time: ✅ 36.418ms (SLO: <38.550ms -5.5%) vs baseline: +0.2%

Memory: ✅ 39.007MB (SLO: <40.750MB -4.3%) vs baseline: +5.9%


✅ add-metrics

Time: ✅ 218.794ms (SLO: <232.000ms -5.7%) vs baseline: -2.2%

Memory: ✅ 38.928MB (SLO: <40.750MB -4.5%) vs baseline: +6.0%


✅ add-tags

Time: ✅ 213.059ms (SLO: <221.600ms -3.9%) vs baseline: +0.4%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.3%


✅ get-context

Time: ✅ 29.258ms (SLO: <31.300ms -6.5%) vs baseline: +0.4%

Memory: ✅ 39.007MB (SLO: <40.750MB -4.3%) vs baseline: +5.9%


✅ is-recording

Time: ✅ 29.112ms (SLO: <31.000ms -6.1%) vs baseline: -0.2%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.2%


✅ record-exception

Time: ✅ 63.234ms (SLO: <65.850ms -4.0%) vs baseline: -0.9%

Memory: ✅ 38.987MB (SLO: <40.750MB -4.3%) vs baseline: +5.8%


✅ set-status

Time: ✅ 31.948ms (SLO: <34.150ms -6.4%) vs baseline: -0.3%

Memory: ✅ 39.046MB (SLO: <40.750MB -4.2%) vs baseline: +6.1%


✅ start

Time: ✅ 29.376ms (SLO: <30.150ms -2.6%) vs baseline: +2.1%

Memory: ✅ 39.007MB (SLO: <40.750MB -4.3%) vs baseline: +6.1%


✅ start-finish

Time: ✅ 33.928ms (SLO: <35.350ms -4.0%) vs baseline: -0.3%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.2%


✅ start-finish-telemetry

Time: ✅ 33.917ms (SLO: <35.450ms -4.3%) vs baseline: -0.2%

Memory: ✅ 38.909MB (SLO: <40.750MB -4.5%) vs baseline: +5.9%


✅ update-name

Time: ✅ 31.024ms (SLO: <33.400ms -7.1%) vs baseline: -0.3%

Memory: ✅ 39.086MB (SLO: <40.750MB -4.1%) vs baseline: +6.6%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 344.755ms (SLO: <354.300ms -2.7%) vs baseline: -0.3%

Memory: ✅ 42.416MB (SLO: <46.000MB -7.8%) vs baseline: +5.8%


✅ cache_on

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.2%

Memory: ✅ 40.611MB (SLO: <46.000MB 📉 -11.7%) vs baseline: +5.3%


rand - 2/2

✅ rand128bits

Time: ✅ 0.181µs (SLO: <21.000µs 📉 -99.1%) vs baseline: -2.3%


✅ rand64bits

Time: ✅ 0.124µs (SLO: <15.000µs 📉 -99.2%) vs baseline: +3.7%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.369µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.1%

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +6.4%


✅ high_rate_limit

Time: ✅ 2.410µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.5%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +6.3%


✅ long_window

Time: ✅ 2.345µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.6%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +6.3%


✅ low_rate_limit

Time: ✅ 2.360µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.2%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +5.9%


✅ no_rate_limit

Time: ✅ 0.826µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.4%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +6.2%


✅ short_window

Time: ✅ 2.465µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -0.2%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +6.7%


samplingrules - 8/8

✅ average_match

Time: ✅ 166.426µs (SLO: <300.000µs 📉 -44.5%) vs baseline: -1.1%

Memory: ✅ 36.176MB (SLO: <38.000MB -4.8%) vs baseline: +5.3%


✅ high_match

Time: ✅ 215.049µs (SLO: <480.000µs 📉 -55.2%) vs baseline: -0.5%

Memory: ✅ 36.176MB (SLO: <38.000MB -4.8%) vs baseline: +5.3%


✅ low_match

Time: ✅ 118.949µs (SLO: <130.000µs -8.5%) vs baseline: -0.8%

Memory: ✅ 701.754MB (SLO: <780.000MB 📉 -10.0%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 3.110ms (SLO: <9.000ms 📉 -65.4%) vs baseline: ~same

Memory: ✅ 78.762MB (SLO: <85.000MB -7.3%) vs baseline: +5.1%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.721µs (SLO: <20.000µs 📉 -46.4%) vs baseline: +0.8%

Memory: ✅ 37.061MB (SLO: <38.750MB -4.4%) vs baseline: +5.1%


✅ all-enabled

Time: ✅ 39.786µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +2.0%

Memory: ✅ 37.080MB (SLO: <38.750MB -4.3%) vs baseline: +5.4%


✅ collectipvariant_exists

Time: ✅ 39.759µs (SLO: <50.000µs 📉 -20.5%) vs baseline: +0.4%

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.4%


✅ no-collectipvariant

Time: ✅ 38.898µs (SLO: <50.000µs 📉 -22.2%) vs baseline: -0.1%

Memory: ✅ 37.080MB (SLO: <38.750MB -4.3%) vs baseline: +5.5%


✅ no-useragentvariant

Time: ✅ 37.861µs (SLO: <50.000µs 📉 -24.3%) vs baseline: +0.7%

Memory: ✅ 37.120MB (SLO: <38.750MB -4.2%) vs baseline: +5.4%


✅ obfuscation-no-query

Time: ✅ 39.531µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.3%

Memory: ✅ 37.198MB (SLO: <38.750MB -4.0%) vs baseline: +5.6%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.714µs (SLO: <90.000µs 📉 -15.9%) vs baseline: +0.2%

Memory: ✅ 37.415MB (SLO: <38.750MB -3.4%) vs baseline: +6.3%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 75.974µs (SLO: <90.000µs 📉 -15.6%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <38.750MB -3.4%) vs baseline: +6.3%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.402µs (SLO: <170.000µs -9.2%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <38.750MB -3.4%) vs baseline: +5.4%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.544µs (SLO: <160.000µs -7.2%) vs baseline: ~same

Memory: ✅ 37.513MB (SLO: <38.750MB -3.2%) vs baseline: +5.4%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.789µs (SLO: <170.000µs -8.9%) vs baseline: -0.2%

Memory: ✅ 37.493MB (SLO: <38.750MB -3.2%) vs baseline: +5.6%


✅ useragentvariant_exists_1

Time: ✅ 38.615µs (SLO: <50.000µs 📉 -22.8%) vs baseline: +1.1%

Memory: ✅ 37.159MB (SLO: <38.750MB -4.1%) vs baseline: +5.5%


✅ useragentvariant_exists_2

Time: ✅ 39.595µs (SLO: <50.000µs 📉 -20.8%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <38.750MB -4.1%) vs baseline: +5.7%


✅ useragentvariant_exists_3

Time: ✅ 39.273µs (SLO: <50.000µs 📉 -21.5%) vs baseline: +0.9%

Memory: ✅ 37.218MB (SLO: <38.750MB -4.0%) vs baseline: +5.7%


✅ useragentvariant_not_exists_1

Time: ✅ 38.537µs (SLO: <50.000µs 📉 -22.9%) vs baseline: +0.1%

Memory: ✅ 37.041MB (SLO: <38.750MB -4.4%) vs baseline: +5.1%


✅ useragentvariant_not_exists_2

Time: ✅ 38.596µs (SLO: <50.000µs 📉 -22.8%) vs baseline: +0.3%

Memory: ✅ 37.257MB (SLO: <38.750MB -3.9%) vs baseline: +6.0%

ℹ️ Scenarios Missing SLO Configuration (46 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • iast_aspects-re_expand_aspect
  • iast_aspects-re_expand_noaspect
  • iast_aspects-re_findall_aspect
  • iast_aspects-re_findall_noaspect
  • iast_aspects-re_finditer_aspect
  • iast_aspects-re_finditer_noaspect
  • iast_aspects-re_fullmatch_aspect
  • iast_aspects-re_fullmatch_noaspect
  • iast_aspects-re_group_aspect
  • iast_aspects-re_group_noaspect
  • iast_aspects-re_groups_aspect
  • iast_aspects-re_groups_noaspect
  • iast_aspects-re_match_aspect
  • iast_aspects-re_match_noaspect
  • iast_aspects-re_search_aspect
  • iast_aspects-re_search_noaspect
  • iast_aspects-re_sub_aspect
  • iast_aspects-re_sub_noaspect
  • iast_aspects-re_subn_aspect
  • iast_aspects-re_subn_noaspect
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@gnufede gnufede added changelog/no-changelog A changelog entry is not required for this PR. CI App labels Apr 10, 2026
Copy link
Copy Markdown
Member

@brettlangdon brettlangdon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

@gnufede gnufede requested a review from a team as a code owner April 13, 2026 11:45
@gnufede gnufede requested review from KowalskiThomas and Kyle-Verhoog and removed request for a team April 13, 2026 11:45
@cit-pr-commenter-54b7da
Copy link
Copy Markdown

cit-pr-commenter-54b7da bot commented Apr 13, 2026

Codeowners resolved as

ddtrace/contrib/internal/pytest/_plugin_v2.py                           @DataDog/ci-app-libraries
ddtrace/contrib/internal/pytest/_xdist.py                               @DataDog/ci-app-libraries
tests/ci_visibility/api_client/_util.py                                 @DataDog/ci-app-libraries
tests/ci_visibility/api_client/test_ci_visibility_api_client.py         @DataDog/ci-app-libraries
tests/ci_visibility/conftest.py                                         @DataDog/ci-app-libraries
tests/ci_visibility/test_ci_visibility.py                               @DataDog/ci-app-libraries
tests/ci_visibility/test_encoder.py                                     @DataDog/ci-app-libraries
tests/contrib/pytest/test_pytest.py                                     @DataDog/ci-app-libraries
tests/testing/internal/pytest/test_pytest_benchmark.py                  @DataDog/ci-app-libraries

@gnufede gnufede force-pushed the gnufede/xdist-pr2-test-fixes branch from 1fd4792 to 2c410e7 Compare April 13, 2026 11:47
gh-worker-dd-mergequeue-cf854d bot pushed a commit that referenced this pull request Apr 13, 2026
…on (#17457)

## Summary

Foundational production-code changes that allow the outer pytest session to run with `--ddtrace` and xdist without corrupting inner `inline_run()` sessions.

Three sources of module-level bleed-through are fixed:

- **`CIVisibility._suspend()`/`_resume()`** — removes/restores the active singleton without calling `stop()`, so the outer session's tracer keeps running while inner sessions get a clean slate. `enable()` and `disable()` are completely unchanged.
- **`is_xdist_worker_env()`** — replaces the frozen-at-import-time `PYTEST_XDIST_WORKER_VALUE` constant with a live `os.environ` read, so inner `inline_run()` sessions (which clear `PYTEST_XDIST_WORKER` from the env) correctly detect they are not workers.
- **Module-level state reset in `pytest_configure`** — resets `skipped_suites` and `skip_pytest_runtest_protocol` for each new main-process session (guarded by `not hasattr(config, "workerinput")`), preventing stale state from accumulating across `inline_run()` calls.

## Test plan

- [x] `ci_visibility::pytest` suite passes with `--ddtrace -n auto` (validated in follow-up PR)
- [x] `ci_visibility::ci_visibility` suite passes with `--ddtrace -n auto` (validated in follow-up PR)
- [x] CI green

## Stacked PRs

1. **This PR** — plugin changes
2. #17458 test isolation fixes (depends on this PR)
3. #17459 enable `--ddtrace -n auto` in riotfile (depends on PR 1 + 2)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: federico.mon <federico.mon@datadoghq.com>
Base automatically changed from gnufede/xdist-pr1-plugin-fixes to main April 13, 2026 11:58
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit 240631e into main Apr 14, 2026
431 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the gnufede/xdist-pr2-test-fixes branch April 14, 2026 07:33
gh-worker-dd-mergequeue-cf854d bot pushed a commit that referenced this pull request Apr 14, 2026
… suites (#17459)

## Summary

Switch `pytest`, `ci_visibility`, and `testing` suite commands from `--no-ddtrace` to `--ddtrace -n auto`.

**Depends on:**
- #17457 — plugin changes
- #17458 — test isolation fixes

Snapshot sub-venvs (`pytest-snapshot`, `ci_visibility-snapshot`) are kept without pytest-xdist as the testagent would receive spans in parallel and that breaks the tests.

## Test plan

- [x] All three suites pass in CI with `--ddtrace -n auto`
- [x] Snapshot sub-venvs also pass with `--ddtrace` (without `-n auto`)
- [x] CI green

## Stacked PRs

1. #17457 — production plugin fixes
2. #17458 — test isolation fixes *(base of this PR)*
3. **This PR** — enable `--ddtrace -n auto` in riotfile

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: datadog-prod-us1-4[bot] <266080418+datadog-prod-us1-4[bot]@users.noreply.github.com>
Co-authored-by: federico.mon <federico.mon@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR. CI App

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants