Skip to content

chore(openai): fix responses reasoning token metric tracking support for streaming #14072

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

chore(openai): fix responses reasoning token metric tracking support for streaming #14072

wants to merge 6 commits into from
+308 −37

Conversation

sabrenner
Copy link
Contributor

@sabrenner sabrenner commented Jul 18, 2025 •
edited
Loading

I discovered another instance of where we check object attributes when we should be checking dict attributes. Although, I have not been able to reproduce in tests here. I discovered this while writing shared tests, and I think this should have been part of #14030, although the test there doesn't catch it because the response from the OpenAI SDK is an object and not a dict.

No release note as this can be considered a follow-up fix to the mentioned PR and is grouped under the release note there.

Checklist

  • PR author has checked that all the criteria below are met
  • The PR description includes an overview of the change
  • The PR description articulates the motivation for the change
  • The change includes tests OR the PR description describes a testing strategy
  • The PR description notes risks associated with the change, if any
  • Newly-added code is easy to change
  • The change follows the library release note guidelines
  • The change includes or references documentation updates if necessary
  • Backport labels are set (if applicable)

Reviewer Checklist

  • Reviewer has checked that all the criteria below are met
  • Title is accurate
  • All changes are related to the pull request's stated goal
  • Avoids breaking API changes
  • Testing strategy adequately addresses listed risks
  • Newly-added code is easy to change
  • Release note makes sense to a user of the library
  • If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
  • Backport labels are set in a manner that is consistent with the release branch maintenance policy

@sabrenner sabrenner added the changelog/no-changelog A changelog entry is not required for this PR. label Jul 18, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 18, 2025 •
edited
Loading

CODEOWNERS have been resolved as:

.riot/requirements/1911f94.txt                                          @DataDog/apm-python
.riot/requirements/1a0657d.txt                                          @DataDog/apm-python
.riot/requirements/85ff44d.txt                                          @DataDog/apm-python
.riot/requirements/b68c552.txt                                          @DataDog/apm-python
.riot/requirements/c5399d2.txt                                          @DataDog/apm-python
.riot/requirements/e9c67e1.txt                                          @DataDog/apm-python
ddtrace/llmobs/_integrations/openai.py                                  @DataDog/ml-observability
riotfile.py                                                             @DataDog/apm-python
tests/contrib/openai/test_openai_llmobs.py                              @DataDog/ml-observability

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 18, 2025 •
edited
Loading

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 282 ± 5 ms.

The average import time from base is: 289 ± 8 ms.

The import time difference between this PR and base is: -7.8 ± 0.3 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.594 ms (0.92%)
ddtrace.bootstrap.sitecustomize 1.806 ms (0.64%)
ddtrace.bootstrap.preload 1.806 ms (0.64%)
ddtrace.internal.remoteconfig.client 0.779 ms (0.28%)
ddtrace 0.788 ms (0.28%)
ddtrace.internal._unpatched 0.126 ms (0.04%)
subprocess 0.092 ms (0.03%)
contextlib 0.092 ms (0.03%)
json 0.035 ms (0.01%)
json.decoder 0.035 ms (0.01%)
re 0.035 ms (0.01%)
enum 0.035 ms (0.01%)
types 0.035 ms (0.01%)

sabrenner added 2 commits July 18, 2025 16:18
@sabrenner
test
376c1e8
@sabrenner
Merge branch 'sabrenner/use-get-attr-token-util' of github.com:DataDo…
2eeeef6 
…g/dd-trace-py into sabrenner/use-get-attr-token-util
@pr-commenter
Copy link

pr-commenter bot commented Jul 18, 2025 •
edited
Loading

Performance SLOs

Performance SLOs

Benchmark execution time: 2025-07-18 21:04:02

Comparing candidate commit 5cdcc5d in branch sabrenner/use-get-attr-token-util with performance thresholds.

coreapiscenario-context_with_data_listeners

  • (unstable) execution_time seen in benchmark [13.066µs; 14.163µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

coreapiscenario-context_with_data_no_listeners

  • 🟩 execution_time seen in benchmark [3.688µs; 3.725µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.044MB; 29.112MB]; SLO is < 31.000MB

coreapiscenario-context_with_data_only_all_listeners

  • (unstable) execution_time seen in benchmark [13.131µs; 14.228µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

coreapiscenario-get_item_exists

  • 🟩 execution_time seen in benchmark [635.244ns; 642.055ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

coreapiscenario-get_item_missing

  • 🟩 execution_time seen in benchmark [680.393ns; 686.078ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.044MB; 29.112MB]; SLO is < 31.000MB

coreapiscenario-set_item

  • 🟩 execution_time seen in benchmark [24.499µs; 24.746µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

djangosimple-appsec

  • 🟩 execution_time seen in benchmark [21.268ms; 21.334ms]; SLO is < 22.300ms
  • 🟩 max_rss_usage seen in benchmark [63.717MB; 63.842MB]; SLO is < 65.500MB

djangosimple-exception-replay-enabled

  • 🟩 execution_time seen in benchmark [1.352ms; 1.354ms]; SLO is < 1.450ms
  • 🟩 max_rss_usage seen in benchmark [63.535MB; 63.670MB]; SLO is < 65.500MB

djangosimple-iast

  • 🟩 execution_time seen in benchmark [21.336ms; 21.419ms]; SLO is < 22.250ms
  • 🟩 max_rss_usage seen in benchmark [63.717MB; 63.842MB]; SLO is < 65.500MB

djangosimple-profiler

  • 🟩 execution_time seen in benchmark [15.878ms; 15.965ms]; SLO is < 16.550ms
  • 🟩 max_rss_usage seen in benchmark [50.728MB; 50.840MB]; SLO is < 53.000MB

djangosimple-span-code-origin

  • 🟩 execution_time seen in benchmark [27.099ms; 27.175ms]; SLO is < 28.200ms
  • 🟩 max_rss_usage seen in benchmark [65.987MB; 66.101MB]; SLO is < 68.000MB

djangosimple-tracer

  • 🟩 execution_time seen in benchmark [21.326ms; 21.392ms]; SLO is < 22.700ms
  • 🟩 max_rss_usage seen in benchmark [63.687MB; 63.755MB]; SLO is < 65.500MB

djangosimple-tracer-and-profiler

  • 🟩 execution_time seen in benchmark [23.771ms; 23.865ms]; SLO is < 24.900ms
  • 🟩 max_rss_usage seen in benchmark [65.137MB; 65.332MB]; SLO is < 67.000MB

djangosimple-tracer-no-caches

  • 🟩 execution_time seen in benchmark [18.859ms; 18.928ms]; SLO is < 19.650ms
  • 🟩 max_rss_usage seen in benchmark [63.704MB; 63.816MB]; SLO is < 65.500MB

djangosimple-tracer-no-databases

  • 🟩 execution_time seen in benchmark [19.191ms; 19.257ms]; SLO is < 20.100ms
  • 🟩 max_rss_usage seen in benchmark [63.717MB; 63.842MB]; SLO is < 65.500MB

djangosimple-tracer-no-middleware

  • 🟩 execution_time seen in benchmark [21.084ms; 21.143ms]; SLO is < 22.500ms
  • 🟩 max_rss_usage seen in benchmark [63.747MB; 63.890MB]; SLO is < 65.500MB

djangosimple-tracer-no-templates

  • 🟩 execution_time seen in benchmark [21.168ms; 21.264ms]; SLO is < 22.250ms
  • 🟩 max_rss_usage seen in benchmark [63.732MB; 63.867MB]; SLO is < 65.500MB

errortrackingdjangosimple-errortracking-enabled-all

  • 🟩 execution_time seen in benchmark [18.605ms; 18.671ms]; SLO is < 19.850ms
  • 🟩 max_rss_usage seen in benchmark [63.704MB; 63.816MB]; SLO is < 65.500MB

errortrackingdjangosimple-errortracking-enabled-user

  • 🟩 execution_time seen in benchmark [18.605ms; 18.689ms]; SLO is < 19.400ms
  • 🟩 max_rss_usage seen in benchmark [63.717MB; 63.842MB]; SLO is < 65.500MB

errortrackingdjangosimple-tracer-enabled

  • 🟩 execution_time seen in benchmark [18.674ms; 18.773ms]; SLO is < 19.450ms
  • 🟩 max_rss_usage seen in benchmark [63.739MB; 63.882MB]; SLO is < 65.500MB

errortrackingflasksqli-errortracking-enabled-all

  • 🟩 execution_time seen in benchmark [2.122ms; 2.129ms]; SLO is < 2.300ms
  • 🟩 max_rss_usage seen in benchmark [51.630MB; 51.786MB]; SLO is < 53.000MB

errortrackingflasksqli-errortracking-enabled-user

  • 🟩 execution_time seen in benchmark [2.114ms; 2.119ms]; SLO is < 2.250ms
  • 🟩 max_rss_usage seen in benchmark [51.630MB; 51.786MB]; SLO is < 53.000MB

errortrackingflasksqli-tracer-enabled

  • 🟩 execution_time seen in benchmark [2.110ms; 2.116ms]; SLO is < 2.300ms
  • 🟩 max_rss_usage seen in benchmark [51.277MB; 51.430MB]; SLO is < 53.000MB

flasksimple-appsec-get

  • 🟩 execution_time seen in benchmark [4.616ms; 4.627ms]; SLO is < 4.750ms
  • 🟩 max_rss_usage seen in benchmark [63.042MB; 63.182MB]; SLO is < 64.000MB

flasksimple-appsec-post

  • 🟩 execution_time seen in benchmark [6.622ms; 6.633ms]; SLO is < 6.750ms
  • 🟩 max_rss_usage seen in benchmark [63.107MB; 63.218MB]; SLO is < 64.000MB

flasksimple-appsec-telemetry

  • 🟩 execution_time seen in benchmark [4.618ms; 4.629ms]; SLO is < 4.750ms
  • 🟩 max_rss_usage seen in benchmark [63.176MB; 63.244MB]; SLO is < 64.000MB

flasksimple-debugger

  • 🟩 execution_time seen in benchmark [1.848ms; 1.851ms]; SLO is < 2.000ms
  • 🟩 max_rss_usage seen in benchmark [42.074MB; 42.074MB]; SLO is < 44.000MB

flasksimple-iast-get

  • 🟩 execution_time seen in benchmark [1.856ms; 1.858ms]; SLO is < 2.000ms
  • 🟩 max_rss_usage seen in benchmark [44.432MB; 44.568MB]; SLO is < 45.000MB

flasksimple-profiler

  • 🟩 execution_time seen in benchmark [1.974ms; 1.979ms]; SLO is < 2.100ms
  • 🟩 max_rss_usage seen in benchmark [43.196MB; 43.390MB]; SLO is < 44.000MB

flasksimple-tracer

  • 🟩 execution_time seen in benchmark [3.382ms; 3.390ms]; SLO is < 3.650ms
  • 🟩 max_rss_usage seen in benchmark [51.425MB; 51.519MB]; SLO is < 53.000MB

flasksqli-appsec-enabled

  • 🟩 execution_time seen in benchmark [3.974ms; 3.983ms]; SLO is < 4.200ms
  • 🟩 max_rss_usage seen in benchmark [63.389MB; 63.541MB]; SLO is < 66.000MB

flasksqli-iast-enabled

  • 🟩 execution_time seen in benchmark [2.556ms; 2.577ms]; SLO is < 2.800ms
  • 🟩 max_rss_usage seen in benchmark [56.574MB; 56.672MB]; SLO is < 58.000MB

flasksqli-tracer-enabled

  • 🟩 execution_time seen in benchmark [2.101ms; 2.107ms]; SLO is < 2.250ms
  • 🟩 max_rss_usage seen in benchmark [51.237MB; 51.393MB]; SLO is < 53.000MB

httppropagationextract-all_styles_all_headers

  • 🟩 execution_time seen in benchmark [61.200µs; 61.528µs]; SLO is < 70.000µs
  • 🟩 max_rss_usage seen in benchmark [29.129MB; 29.264MB]; SLO is < 31.000MB

httppropagationextract-b3_headers

  • 🟩 execution_time seen in benchmark [9.924µs; 9.978µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.161MB; 29.310MB]; SLO is < 31.000MB

httppropagationextract-b3_single_headers

  • 🟩 execution_time seen in benchmark [9.013µs; 9.075µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

  • 🟩 execution_time seen in benchmark [52.542µs; 52.886µs]; SLO is < 60.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-datadog_tracecontext_tracestate_propagated_on_trace_id_match

  • 🟩 execution_time seen in benchmark [54.705µs; 55.138µs]; SLO is < 60.000µs
  • 🟩 max_rss_usage seen in benchmark [29.161MB; 29.310MB]; SLO is < 31.000MB

httppropagationextract-empty_headers

  • 🟩 execution_time seen in benchmark [1.591µs; 1.603µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-full_t_id_datadog_headers

  • 🟩 execution_time seen in benchmark [17.953µs; 18.147µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-invalid_priority_header

  • 🟩 execution_time seen in benchmark [6.573µs; 6.608µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-invalid_span_id_header

  • 🟩 execution_time seen in benchmark [6.520µs; 6.562µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

httppropagationextract-invalid_tags_header

  • 🟩 execution_time seen in benchmark [6.571µs; 6.606µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.091MB; 29.184MB]; SLO is < 31.000MB

httppropagationextract-invalid_trace_id_header

  • 🟩 execution_time seen in benchmark [6.561µs; 6.595µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.069MB; 29.205MB]; SLO is < 31.000MB

httppropagationextract-large_header_no_matches

  • 🟩 execution_time seen in benchmark [27.542µs; 27.624µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-large_valid_headers_all

  • 🟩 execution_time seen in benchmark [28.705µs; 28.888µs]; SLO is < 40.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-medium_header_no_matches

  • 🟩 execution_time seen in benchmark [9.846µs; 9.915µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.129MB; 29.264MB]; SLO is < 31.000MB

httppropagationextract-medium_valid_headers_all

  • 🟩 execution_time seen in benchmark [11.202µs; 11.253µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.049MB; 29.147MB]; SLO is < 31.000MB

httppropagationextract-none_propagation_style

  • 🟩 execution_time seen in benchmark [1.710µs; 1.723µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.083MB; 29.231MB]; SLO is < 31.000MB

httppropagationextract-tracecontext_headers

  • 🟩 execution_time seen in benchmark [27.409µs; 27.579µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-valid_headers_all

  • 🟩 execution_time seen in benchmark [6.540µs; 6.582µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.084MB; 29.152MB]; SLO is < 31.000MB

httppropagationextract-valid_headers_basic

  • 🟩 execution_time seen in benchmark [6.098µs; 6.131µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-wsgi_empty_headers

  • 🟩 execution_time seen in benchmark [1.581µs; 1.591µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-wsgi_invalid_priority_header

  • 🟩 execution_time seen in benchmark [6.580µs; 6.620µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.144MB; 29.287MB]; SLO is < 31.000MB

httppropagationextract-wsgi_invalid_span_id_header

  • 🟩 execution_time seen in benchmark [1.588µs; 1.601µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-wsgi_invalid_tags_header

  • 🟩 execution_time seen in benchmark [6.580µs; 6.623µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.129MB; 29.264MB]; SLO is < 31.000MB

httppropagationextract-wsgi_invalid_trace_id_header

  • 🟩 execution_time seen in benchmark [6.615µs; 6.656µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationextract-wsgi_large_header_no_matches

  • 🟩 execution_time seen in benchmark [28.613µs; 28.811µs]; SLO is < 40.000µs
  • 🟩 max_rss_usage seen in benchmark [29.091MB; 29.184MB]; SLO is < 31.000MB

httppropagationextract-wsgi_large_valid_headers_all

  • 🟩 execution_time seen in benchmark [29.785µs; 29.890µs]; SLO is < 40.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-wsgi_medium_header_no_matches

  • 🟩 execution_time seen in benchmark [10.186µs; 10.245µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.161MB; 29.310MB]; SLO is < 31.000MB

httppropagationextract-wsgi_medium_valid_headers_all

  • 🟩 execution_time seen in benchmark [11.637µs; 11.687µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.084MB; 29.152MB]; SLO is < 31.000MB

httppropagationextract-wsgi_valid_headers_all

  • 🟩 execution_time seen in benchmark [6.595µs; 6.635µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationextract-wsgi_valid_headers_basic

  • 🟩 execution_time seen in benchmark [6.136µs; 6.178µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.144MB; 29.287MB]; SLO is < 31.000MB

httppropagationinject-ids_only

  • 🟩 execution_time seen in benchmark [11.720µs; 11.814µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.101MB; 29.213MB]; SLO is < 31.000MB

httppropagationinject-with_all

  • 🟩 execution_time seen in benchmark [24.391µs; 24.567µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.058MB; 29.178MB]; SLO is < 31.000MB

httppropagationinject-with_dd_origin

  • 🟩 execution_time seen in benchmark [16.822µs; 16.921µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.091MB; 29.184MB]; SLO is < 31.000MB

httppropagationinject-with_priority_and_origin

  • 🟩 execution_time seen in benchmark [18.957µs; 19.060µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

httppropagationinject-with_sampling_priority

  • 🟩 execution_time seen in benchmark [13.929µs; 14.027µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.129MB; 29.264MB]; SLO is < 31.000MB

httppropagationinject-with_tags

  • 🟩 execution_time seen in benchmark [18.005µs; 18.119µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.144MB; 29.287MB]; SLO is < 31.000MB

httppropagationinject-with_tags_invalid

  • 🟩 execution_time seen in benchmark [20.661µs; 20.758µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.144MB; 29.287MB]; SLO is < 31.000MB

httppropagationinject-with_tags_max_size

  • 🟩 execution_time seen in benchmark [18.611µs; 18.753µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [29.114MB; 29.239MB]; SLO is < 31.000MB

iast_aspects-re_expand_aspect

  • 🟩 execution_time seen in benchmark [33.015µs; 33.266µs]; SLO is < 40.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_expand_noaspect

  • 🟩 execution_time seen in benchmark [28.573µs; 28.767µs]; SLO is < 40.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_findall_aspect

  • 🟩 execution_time seen in benchmark [3.686µs; 3.710µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.634MB; 34.769MB]; SLO is < 35.000MB

iast_aspects-re_findall_noaspect

  • 🟩 execution_time seen in benchmark [1.401µs; 1.411µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_finditer_aspect

  • 🟩 execution_time seen in benchmark [5.156µs; 5.202µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_finditer_noaspect

  • 🟩 execution_time seen in benchmark [1.419µs; 1.433µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iast_aspects-re_fullmatch_aspect

  • 🟩 execution_time seen in benchmark [3.382µs; 3.413µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_fullmatch_noaspect

  • 🟩 execution_time seen in benchmark [1.286µs; 1.295µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iast_aspects-re_group_aspect

  • 🟩 execution_time seen in benchmark [3.437µs; 3.463µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_group_noaspect

  • 🟩 execution_time seen in benchmark [1.592µs; 1.608µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iast_aspects-re_groups_aspect

  • 🟩 execution_time seen in benchmark [3.552µs; 3.580µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iast_aspects-re_groups_noaspect

  • 🟩 execution_time seen in benchmark [1.707µs; 1.730µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_match_aspect

  • 🟩 execution_time seen in benchmark [3.409µs; 3.434µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iast_aspects-re_match_noaspect

  • 🟩 execution_time seen in benchmark [1.291µs; 1.302µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iast_aspects-re_search_aspect

  • 🟩 execution_time seen in benchmark [3.260µs; 3.286µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_search_noaspect

  • 🟩 execution_time seen in benchmark [1.188µs; 1.199µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iast_aspects-re_sub_aspect

  • 🟩 execution_time seen in benchmark [4.646µs; 4.682µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.619MB; 34.744MB]; SLO is < 35.000MB

iast_aspects-re_sub_noaspect

  • 🟩 execution_time seen in benchmark [1.515µs; 1.529µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iast_aspects-re_subn_aspect

  • 🟩 execution_time seen in benchmark [4.864µs; 4.893µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.500MB

iast_aspects-re_subn_noaspect

  • 🟩 execution_time seen in benchmark [1.602µs; 1.619µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-add_aspect

  • 🟩 execution_time seen in benchmark [325.173ns; 330.008ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-add_inplace_aspect

  • 🟩 execution_time seen in benchmark [327.819ns; 333.336ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-add_inplace_noaspect

  • 🟩 execution_time seen in benchmark [316.286ns; 323.636ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-add_noaspect

  • 🟩 execution_time seen in benchmark [273.684ns; 278.652ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-bytearray_aspect

  • 🟩 execution_time seen in benchmark [1.850µs; 1.858µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-bytearray_extend_aspect

  • 🟩 execution_time seen in benchmark [1.382µs; 1.398µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-bytearray_extend_noaspect

  • 🟩 execution_time seen in benchmark [612.872ns; 617.853ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.619MB; 34.744MB]; SLO is < 35.000MB

iastaspects-bytearray_noaspect

  • 🟩 execution_time seen in benchmark [475.941ns; 481.093ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-bytes_aspect

  • 🟩 execution_time seen in benchmark [1.840µs; 1.853µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-bytes_noaspect

  • 🟩 execution_time seen in benchmark [485.714ns; 488.961ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-bytesio_aspect

  • 🟩 execution_time seen in benchmark [1.884µs; 1.899µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-bytesio_noaspect

  • 🟩 execution_time seen in benchmark [495.108ns; 499.867ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-capitalize_aspect

  • 🟩 execution_time seen in benchmark [734.196ns; 739.117ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-capitalize_noaspect

  • 🟩 execution_time seen in benchmark [432.507ns; 434.927ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-casefold_aspect

  • 🟩 execution_time seen in benchmark [736.445ns; 742.465ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.619MB; 34.744MB]; SLO is < 35.000MB

iastaspects-casefold_noaspect

  • 🟩 execution_time seen in benchmark [365.353ns; 369.896ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-decode_aspect

  • 🟩 execution_time seen in benchmark [719.559ns; 729.887ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-decode_noaspect

  • 🟩 execution_time seen in benchmark [420.462ns; 427.654ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-encode_aspect

  • 🟩 execution_time seen in benchmark [701.933ns; 705.243ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-encode_noaspect

  • 🟩 execution_time seen in benchmark [398.304ns; 403.308ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-format_aspect

  • 🟩 execution_time seen in benchmark [3.413µs; 3.445µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-format_map_aspect

  • 🟩 execution_time seen in benchmark [3.224µs; 3.257µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-format_map_noaspect

  • 🟩 execution_time seen in benchmark [771.066ns; 777.159ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspects-format_noaspect

  • 🟩 execution_time seen in benchmark [592.664ns; 598.596ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-index_aspect

  • 🟩 execution_time seen in benchmark [341.636ns; 345.371ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-index_noaspect

  • 🟩 execution_time seen in benchmark [277.168ns; 281.531ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-join_aspect

  • 🟩 execution_time seen in benchmark [1.219µs; 1.230µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-join_noaspect

  • 🟩 execution_time seen in benchmark [494.222ns; 500.921ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-ljust_aspect

  • 🟩 execution_time seen in benchmark [10.318µs; 10.385µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [34.649MB; 34.792MB]; SLO is < 35.500MB

iastaspects-ljust_noaspect

  • 🟩 execution_time seen in benchmark [400.147ns; 403.850ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.500MB

iastaspects-lower_aspect

  • 🟩 execution_time seen in benchmark [2.214µs; 2.229µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.500MB

iastaspects-lower_noaspect

  • 🟩 execution_time seen in benchmark [366.175ns; 370.970ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspects-lstrip_aspect

  • 🟩 execution_time seen in benchmark [10.408µs; 10.459µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [34.666MB; 34.815MB]; SLO is < 35.500MB

iastaspects-lstrip_noaspect

  • 🟩 execution_time seen in benchmark [376.714ns; 380.986ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-modulo_aspect

  • 🟩 execution_time seen in benchmark [577.066ns; 584.091ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-modulo_aspect_for_bytearray_bytearray

  • 🟩 execution_time seen in benchmark [1.239µs; 1.251µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-modulo_aspect_for_bytes

  • 🟩 execution_time seen in benchmark [743.595ns; 749.704ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-modulo_aspect_for_bytes_bytearray

  • 🟩 execution_time seen in benchmark [968.086ns; 982.819ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-modulo_noaspect

  • 🟩 execution_time seen in benchmark [623.075ns; 627.992ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-replace_aspect

  • 🟩 execution_time seen in benchmark [4.715µs; 4.744µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-replace_noaspect

  • 🟩 execution_time seen in benchmark [457.180ns; 461.657ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.500MB

iastaspects-repr_aspect

  • 🟩 execution_time seen in benchmark [904.926ns; 910.682ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspects-repr_noaspect

  • 🟩 execution_time seen in benchmark [412.984ns; 418.757ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspects-rstrip_aspect

  • 🟩 execution_time seen in benchmark [10.302µs; 10.352µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [34.742MB; 34.897MB]; SLO is < 35.500MB

iastaspects-rstrip_noaspect

  • 🟩 execution_time seen in benchmark [375.558ns; 379.595ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-slice_aspect

  • 🟩 execution_time seen in benchmark [472.622ns; 475.509ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-slice_noaspect

  • 🟩 execution_time seen in benchmark [441.796ns; 445.357ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-stringio_aspect

  • 🟩 execution_time seen in benchmark [2.176µs; 2.192µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-stringio_noaspect

  • 🟩 execution_time seen in benchmark [709.652ns; 718.419ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-strip_aspect

  • 🟩 execution_time seen in benchmark [10.451µs; 10.506µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.500MB

iastaspects-strip_noaspect

  • 🟩 execution_time seen in benchmark [379.818ns; 382.339ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-swapcase_aspect

  • 🟩 execution_time seen in benchmark [2.442µs; 2.479µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-swapcase_noaspect

  • 🟩 execution_time seen in benchmark [533.053ns; 538.118ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-title_aspect

  • 🟩 execution_time seen in benchmark [2.359µs; 2.379µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.619MB; 34.744MB]; SLO is < 35.000MB

iastaspects-title_noaspect

  • 🟩 execution_time seen in benchmark [500.159ns; 503.982ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspects-translate_aspect

  • 🟩 execution_time seen in benchmark [3.299µs; 3.328µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspects-translate_noaspect

  • 🟩 execution_time seen in benchmark [1.043µs; 1.050µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspects-upper_aspect

  • 🟩 execution_time seen in benchmark [2.213µs; 2.229µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspects-upper_noaspect

  • 🟩 execution_time seen in benchmark [369.206ns; 374.791ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectsospath-ospathbasename_aspect

  • 🟩 execution_time seen in benchmark [4.217µs; 4.255µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspectsospath-ospathbasename_noaspect

  • 🟩 execution_time seen in benchmark [1.082µs; 1.089µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathjoin_aspect

  • 🟩 execution_time seen in benchmark [6.127µs; 6.172µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathjoin_noaspect

  • 🟩 execution_time seen in benchmark [2.293µs; 2.308µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathnormcase_aspect

  • 🟩 execution_time seen in benchmark [3.518µs; 3.539µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectsospath-ospathnormcase_noaspect

  • 🟩 execution_time seen in benchmark [564.506ns; 572.040ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplit_aspect

  • 🟩 execution_time seen in benchmark [5.867µs; 5.991µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplit_noaspect

  • 🟩 execution_time seen in benchmark [1.599µs; 1.612µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplitdrive_aspect

  • 🟩 execution_time seen in benchmark [3.677µs; 3.707µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplitdrive_noaspect

  • 🟩 execution_time seen in benchmark [689.834ns; 697.783ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplitext_aspect

  • 🟩 execution_time seen in benchmark [4.661µs; 4.804µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectsospath-ospathsplitext_noaspect

  • 🟩 execution_time seen in benchmark [1.377µs; 1.391µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectssplit-rsplit_aspect

  • 🟩 execution_time seen in benchmark [1.439µs; 1.450µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.603MB; 34.603MB]; SLO is < 35.000MB

iastaspectssplit-rsplit_noaspect

  • 🟩 execution_time seen in benchmark [577.888ns; 583.386ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectssplit-split_aspect

  • 🟩 execution_time seen in benchmark [1.434µs; 1.452µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.000MB

iastaspectssplit-split_noaspect

  • 🟩 execution_time seen in benchmark [569.393ns; 574.471ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastaspectssplit-splitlines_aspect

  • 🟩 execution_time seen in benchmark [1.415µs; 1.427µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastaspectssplit-splitlines_noaspect

  • 🟩 execution_time seen in benchmark [580.521ns; 585.328ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.000MB

iastpropagation-no-propagation

  • 🟩 execution_time seen in benchmark [48.823µs; 48.964µs]; SLO is < 60.000µs
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.500MB

iastpropagation-propagation_enabled

  • 🟩 execution_time seen in benchmark [144.046µs; 144.957µs]; SLO is < 160.000µs
  • 🟩 max_rss_usage seen in benchmark [34.606MB; 34.718MB]; SLO is < 35.500MB

iastpropagation-propagation_enabled_100

  • 🟩 execution_time seen in benchmark [1.558ms; 1.572ms]; SLO is < 1.800ms
  • 🟩 max_rss_usage seen in benchmark [34.596MB; 34.689MB]; SLO is < 35.000MB

iastpropagation-propagation_enabled_1000

  • 🟩 execution_time seen in benchmark [29.244ms; 29.397ms]; SLO is < 30.550ms
  • 🟩 max_rss_usage seen in benchmark [34.589MB; 34.657MB]; SLO is < 35.500MB

otelsdkspan-add-event

  • 🟩 execution_time seen in benchmark [40.108ms; 40.310ms]; SLO is < 42.000ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-add-link

  • 🟩 execution_time seen in benchmark [36.247ms; 36.423ms]; SLO is < 38.550ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-add-metrics

  • 🟩 execution_time seen in benchmark [218.483ms; 220.045ms]; SLO is < 232.000ms
  • 🟩 max_rss_usage seen in benchmark [31.836MB; 31.904MB]; SLO is < 35.000MB

otelsdkspan-add-tags

  • 🟩 execution_time seen in benchmark [209.778ms; 211.397ms]; SLO is < 221.600ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-get-context

  • 🟩 execution_time seen in benchmark [29.014ms; 29.166ms]; SLO is < 31.300ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-is-recording

  • 🟩 execution_time seen in benchmark [29.575ms; 29.743ms]; SLO is < 31.000ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-record-exception

  • 🟩 execution_time seen in benchmark [63.006ms; 63.281ms]; SLO is < 65.850ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-set-status

  • 🟩 execution_time seen in benchmark [31.900ms; 32.114ms]; SLO is < 34.150ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-start

  • 🟩 execution_time seen in benchmark [28.615ms; 28.759ms]; SLO is < 30.150ms
  • 🟩 max_rss_usage seen in benchmark [31.836MB; 31.904MB]; SLO is < 35.000MB

otelsdkspan-start-finish

  • 🟩 execution_time seen in benchmark [33.838ms; 34.038ms]; SLO is < 35.350ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-start-finish-telemetry

  • 🟩 execution_time seen in benchmark [34.190ms; 34.452ms]; SLO is < 35.450ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelsdkspan-update-name

  • 🟩 execution_time seen in benchmark [30.825ms; 31.018ms]; SLO is < 33.400ms
  • 🟩 max_rss_usage seen in benchmark [31.850MB; 31.850MB]; SLO is < 35.000MB

otelspan-add-event

  • 🟩 execution_time seen in benchmark [44.196ms; 44.500ms]; SLO is < 47.150ms
  • 🟩 max_rss_usage seen in benchmark [42.075MB; 42.222MB]; SLO is < 42.500MB

otelspan-add-metrics

  • 🟩 execution_time seen in benchmark [318.593ms; 321.301ms]; SLO is < 344.800ms
  • 🟩 max_rss_usage seen in benchmark [560.038MB; 560.038MB]; SLO is < 562.000MB

otelspan-add-tags

  • 🟩 execution_time seen in benchmark [288.865ms; 291.558ms]; SLO is < 314.000ms
  • 🟩 max_rss_usage seen in benchmark [559.874MB; 559.874MB]; SLO is < 563.500MB

otelspan-get-context

  • 🟩 execution_time seen in benchmark [84.008ms; 85.211ms]; SLO is < 92.350ms
  • 🟩 max_rss_usage seen in benchmark [37.120MB; 37.285MB]; SLO is < 38.000MB

otelspan-is-recording

  • 🟩 execution_time seen in benchmark [41.183ms; 41.364ms]; SLO is < 44.500ms
  • 🟩 max_rss_usage seen in benchmark [41.442MB; 41.585MB]; SLO is < 42.000MB

otelspan-record-exception

  • 🟩 execution_time seen in benchmark [59.695ms; 60.729ms]; SLO is < 67.650ms
  • 🟩 max_rss_usage seen in benchmark [37.560MB; 37.717MB]; SLO is < 38.000MB

otelspan-set-status

  • 🟩 execution_time seen in benchmark [47.086ms; 47.256ms]; SLO is < 50.400ms
  • 🟩 max_rss_usage seen in benchmark [41.383MB; 41.549MB]; SLO is < 42.000MB

otelspan-start

  • 🟩 execution_time seen in benchmark [40.866ms; 41.041ms]; SLO is < 43.450ms
  • 🟩 max_rss_usage seen in benchmark [41.438MB; 41.615MB]; SLO is < 42.000MB

otelspan-start-finish

  • 🟩 execution_time seen in benchmark [80.856ms; 81.161ms]; SLO is < 86.000ms
  • 🟩 max_rss_usage seen in benchmark [31.617MB; 31.770MB]; SLO is < 32.000MB

otelspan-start-finish-telemetry

  • 🟩 execution_time seen in benchmark [82.315ms; 82.601ms]; SLO is < 86.000ms
  • 🟩 max_rss_usage seen in benchmark [31.538MB; 31.691MB]; SLO is < 32.000MB

otelspan-update-name

  • 🟩 execution_time seen in benchmark [42.605ms; 42.949ms]; SLO is < 45.150ms
  • 🟩 max_rss_usage seen in benchmark [41.805MB; 41.964MB]; SLO is < 42.500MB

packagespackageforrootmodulemapping-cache_off

  • 🟩 execution_time seen in benchmark [345.705ms; 347.956ms]; SLO is < 354.300ms
  • 🟩 max_rss_usage seen in benchmark [35.142MB; 35.260MB]; SLO is < 38.000MB

packagespackageforrootmodulemapping-cache_on

  • 🟩 execution_time seen in benchmark [383.690ns; 389.354ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.012MB; 34.073MB]; SLO is < 38.000MB

packagesupdateimporteddependencies-import_many

  • 🟩 execution_time seen in benchmark [154.801µs; 156.338µs]; SLO is < 170.000µs
  • 🟩 max_rss_usage seen in benchmark [34.145MB; 34.194MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_many_cached

  • 🟩 execution_time seen in benchmark [120.262µs; 120.428µs]; SLO is < 130.000µs
  • 🟩 max_rss_usage seen in benchmark [34.143MB; 34.199MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_many_stdlib

  • 🟩 execution_time seen in benchmark [1.600ms; 1.621ms]; SLO is < 1.750ms
  • 🟩 max_rss_usage seen in benchmark [34.188MB; 34.265MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_many_stdlib_cached

  • 🟩 execution_time seen in benchmark [952.459µs; 972.743µs]; SLO is < 1.100ms
  • 🟩 max_rss_usage seen in benchmark [34.329MB; 34.360MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_many_unknown

  • 🟩 execution_time seen in benchmark [831.970µs; 848.712µs]; SLO is < 890.000µs
  • 🟩 max_rss_usage seen in benchmark [34.359MB; 34.388MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_many_unknown_cached

  • 🟩 execution_time seen in benchmark [796.643µs; 804.769µs]; SLO is < 870.000µs
  • 🟩 max_rss_usage seen in benchmark [34.214MB; 34.309MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one

  • 🟩 execution_time seen in benchmark [19.657µs; 19.779µs]; SLO is < 30.000µs
  • 🟩 max_rss_usage seen in benchmark [34.132MB; 34.161MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one_cache

  • 🟩 execution_time seen in benchmark [6.299µs; 6.352µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.154MB; 34.207MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one_stdlib

  • 🟩 execution_time seen in benchmark [18.492µs; 18.625µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [34.104MB; 34.189MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one_stdlib_cache

  • 🟩 execution_time seen in benchmark [6.262µs; 6.294µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.126MB; 34.197MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one_unknown

  • 🟩 execution_time seen in benchmark [45.138µs; 45.380µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [34.144MB; 34.255MB]; SLO is < 35.500MB

packagesupdateimporteddependencies-import_one_unknown_cache

  • 🟩 execution_time seen in benchmark [6.260µs; 6.303µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [34.134MB; 34.205MB]; SLO is < 35.500MB

ratelimiter-defaults

  • 🟩 execution_time seen in benchmark [2.360µs; 2.383µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.689MB; 28.838MB]; SLO is < 31.000MB

ratelimiter-high_rate_limit

  • 🟩 execution_time seen in benchmark [2.411µs; 2.427µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.690MB; 28.758MB]; SLO is < 31.000MB

ratelimiter-long_window

  • 🟩 execution_time seen in benchmark [2.351µs; 2.368µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.608MB; 28.763MB]; SLO is < 31.000MB

ratelimiter-low_rate_limit

  • 🟩 execution_time seen in benchmark [2.353µs; 2.374µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.676MB; 28.812MB]; SLO is < 31.000MB

ratelimiter-no_rate_limit

  • 🟩 execution_time seen in benchmark [821.995ns; 829.463ns]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.690MB; 28.758MB]; SLO is < 31.000MB

ratelimiter-short_window

  • 🟩 execution_time seen in benchmark [2.474µs; 2.494µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [28.736MB; 28.871MB]; SLO is < 31.000MB

recursivecomputation-deep

  • 🟩 execution_time seen in benchmark [308.889ms; 309.772ms]; SLO is < 320.950ms
  • 🟩 max_rss_usage seen in benchmark [30.278MB; 30.278MB]; SLO is < 31.000MB

recursivecomputation-deep-profiled

  • 🟩 execution_time seen in benchmark [343.171ms; 344.525ms]; SLO is < 359.150ms
  • 🟩 max_rss_usage seen in benchmark [34.549MB; 34.617MB]; SLO is < 35.500MB

recursivecomputation-medium

  • 🟩 execution_time seen in benchmark [7.013ms; 7.035ms]; SLO is < 7.400ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

recursivecomputation-shallow

  • 🟩 execution_time seen in benchmark [939.063µs; 945.222µs]; SLO is < 1.050ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

samplingrules-average_match

  • 🟩 execution_time seen in benchmark [332.273µs; 333.916µs]; SLO is < 350.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

samplingrules-high_match

  • 🟩 execution_time seen in benchmark [498.601µs; 502.464µs]; SLO is < 550.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

samplingrules-low_match

  • 🟩 execution_time seen in benchmark [167.865µs; 168.827µs]; SLO is < 190.000µs
  • 🟩 max_rss_usage seen in benchmark [431.414MB; 431.456MB]; SLO is < 432.500MB

samplingrules-very_low_match

  • 🟩 execution_time seen in benchmark [8.590ms; 8.638ms]; SLO is < 9.150ms
  • 🟩 max_rss_usage seen in benchmark [54.823MB; 54.870MB]; SLO is < 55.000MB

sethttpmeta-all-disabled

  • 🟩 execution_time seen in benchmark [12.158µs; 12.224µs]; SLO is < 20.000µs
  • 🟩 max_rss_usage seen in benchmark [29.491MB; 29.491MB]; SLO is < 31.000MB

sethttpmeta-all-enabled

  • 🟩 execution_time seen in benchmark [41.977µs; 42.141µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.484MB; 29.577MB]; SLO is < 31.000MB

sethttpmeta-collectipvariant_exists

  • 🟩 execution_time seen in benchmark [42.966µs; 43.204µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.477MB; 29.545MB]; SLO is < 31.000MB

sethttpmeta-no-collectipvariant

  • 🟩 execution_time seen in benchmark [41.850µs; 42.091µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.484MB; 29.577MB]; SLO is < 31.000MB

sethttpmeta-no-useragentvariant

  • 🟩 execution_time seen in benchmark [40.708µs; 40.933µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.494MB; 29.606MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-no-query

  • 🟩 execution_time seen in benchmark [43.203µs; 43.458µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.477MB; 29.545MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-regular-case-explicit-query

  • 🟩 execution_time seen in benchmark [78.714µs; 78.929µs]; SLO is < 90.000µs
  • 🟩 max_rss_usage seen in benchmark [29.901MB; 30.025MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-regular-case-implicit-query

  • 🟩 execution_time seen in benchmark [80.550µs; 80.831µs]; SLO is < 90.000µs
  • 🟩 max_rss_usage seen in benchmark [29.884MB; 29.884MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-send-querystring-disabled

  • 🟩 execution_time seen in benchmark [156.435µs; 156.749µs]; SLO is < 170.000µs
  • 🟩 max_rss_usage seen in benchmark [29.870MB; 29.938MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-worst-case-explicit-query

  • 🟩 execution_time seen in benchmark [150.763µs; 151.072µs]; SLO is < 160.000µs
  • 🟩 max_rss_usage seen in benchmark [29.870MB; 29.938MB]; SLO is < 31.000MB

sethttpmeta-obfuscation-worst-case-implicit-query

  • 🟩 execution_time seen in benchmark [156.793µs; 157.106µs]; SLO is < 170.000µs
  • 🟩 max_rss_usage seen in benchmark [29.877MB; 29.971MB]; SLO is < 31.000MB

sethttpmeta-useragentvariant_exists_1

  • 🟩 execution_time seen in benchmark [41.614µs; 41.865µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.484MB; 29.577MB]; SLO is < 31.000MB

sethttpmeta-useragentvariant_exists_2

  • 🟩 execution_time seen in benchmark [43.242µs; 43.472µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.491MB; 29.491MB]; SLO is < 31.000MB

sethttpmeta-useragentvariant_exists_3

  • 🟩 execution_time seen in benchmark [41.991µs; 42.188µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.494MB; 29.606MB]; SLO is < 31.000MB

sethttpmeta-useragentvariant_not_exists_1

  • 🟩 execution_time seen in benchmark [41.305µs; 41.484µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.484MB; 29.577MB]; SLO is < 31.000MB

sethttpmeta-useragentvariant_not_exists_2

  • 🟩 execution_time seen in benchmark [41.566µs; 41.787µs]; SLO is < 50.000µs
  • 🟩 max_rss_usage seen in benchmark [29.477MB; 29.545MB]; SLO is < 31.000MB

span-add-event

  • 🟩 execution_time seen in benchmark [22.703ms; 23.074ms]; SLO is < 26.200ms
  • 🟩 max_rss_usage seen in benchmark [48.471MB; 48.493MB]; SLO is < 49.000MB

span-add-metrics

  • 🟩 execution_time seen in benchmark [89.473ms; 90.588ms]; SLO is < 98.350ms
  • 🟩 max_rss_usage seen in benchmark [614.248MB; 614.248MB]; SLO is < 961.000MB

span-add-tags

  • 🟩 execution_time seen in benchmark [148.015ms; 149.839ms]; SLO is < 168.550ms
  • 🟩 max_rss_usage seen in benchmark [614.118MB; 614.292MB]; SLO is < 962.500MB

span-get-context

  • 🟩 execution_time seen in benchmark [21.402ms; 21.821ms]; SLO is < 23.700ms
  • 🟩 max_rss_usage seen in benchmark [47.259MB; 47.287MB]; SLO is < 47.500MB

span-is-recording

  • 🟩 execution_time seen in benchmark [21.306ms; 21.684ms]; SLO is < 23.900ms
  • 🟩 max_rss_usage seen in benchmark [47.285MB; 47.321MB]; SLO is < 47.500MB

span-record-exception

  • 🟩 execution_time seen in benchmark [40.812ms; 40.978ms]; SLO is < 44.500ms
  • 🟩 max_rss_usage seen in benchmark [40.295MB; 40.341MB]; SLO is < 40.500MB

span-set-status

  • 🟩 execution_time seen in benchmark [22.854ms; 23.196ms]; SLO is < 26.000ms
  • 🟩 max_rss_usage seen in benchmark [47.278MB; 47.307MB]; SLO is < 47.500MB

span-start

  • 🟩 execution_time seen in benchmark [20.883ms; 21.255ms]; SLO is < 23.500ms
  • 🟩 max_rss_usage seen in benchmark [47.279MB; 47.308MB]; SLO is < 47.500MB

span-start-finish

  • 🟩 execution_time seen in benchmark [50.259ms; 50.535ms]; SLO is < 52.500ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

span-start-finish-telemetry

  • 🟩 execution_time seen in benchmark [51.516ms; 51.726ms]; SLO is < 55.300ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

span-start-finish-traceid128

  • 🟩 execution_time seen in benchmark [53.501ms; 53.639ms]; SLO is < 56.050ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

span-start-traceid128

  • 🟩 execution_time seen in benchmark [21.307ms; 21.701ms]; SLO is < 24.600ms
  • 🟩 max_rss_usage seen in benchmark [47.294MB; 47.327MB]; SLO is < 47.500MB

span-update-name

  • 🟩 execution_time seen in benchmark [21.745ms; 22.104ms]; SLO is < 24.100ms
  • 🟩 max_rss_usage seen in benchmark [47.802MB; 47.833MB]; SLO is < 48.000MB

telemetryaddmetric-1-count-metric-1-times

  • 🟩 execution_time seen in benchmark [3.212µs; 3.262µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-count-metrics-100-times

  • 🟩 execution_time seen in benchmark [214.400µs; 215.552µs]; SLO is < 240.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-distribution-metric-1-times

  • 🟩 execution_time seen in benchmark [3.295µs; 3.318µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-distribution-metrics-100-times

  • 🟩 execution_time seen in benchmark [193.432µs; 195.508µs]; SLO is < 210.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-gauge-metric-1-times

  • 🟩 execution_time seen in benchmark [2.094µs; 2.110µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-gauge-metrics-100-times

  • 🟩 execution_time seen in benchmark [123.197µs; 123.885µs]; SLO is < 140.000µs
  • 🟩 max_rss_usage seen in benchmark [29.064MB; 29.132MB]; SLO is < 31.000MB

telemetryaddmetric-1-rate-metric-1-times

  • 🟩 execution_time seen in benchmark [3.161µs; 3.194µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-1-rate-metrics-100-times

  • 🟩 execution_time seen in benchmark [214.220µs; 215.345µs]; SLO is < 230.000µs
  • 🟩 max_rss_usage seen in benchmark [29.001MB; 29.077MB]; SLO is < 31.000MB

telemetryaddmetric-100-count-metrics-100-times

  • 🟩 execution_time seen in benchmark [21.332ms; 21.447ms]; SLO is < 22.500ms
  • 🟩 max_rss_usage seen in benchmark [29.055MB; 29.101MB]; SLO is < 31.000MB

telemetryaddmetric-100-distribution-metrics-100-times

  • 🟩 execution_time seen in benchmark [2.000ms; 2.016ms]; SLO is < 2.100ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-100-gauge-metrics-100-times

  • 🟩 execution_time seen in benchmark [1.270ms; 1.275ms]; SLO is < 1.400ms
  • 🟩 max_rss_usage seen in benchmark [29.027MB; 29.090MB]; SLO is < 31.000MB

telemetryaddmetric-100-rate-metrics-100-times

  • 🟩 execution_time seen in benchmark [2.206ms; 2.217ms]; SLO is < 2.400ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-flush-1-metric

  • 🟩 execution_time seen in benchmark [4.147µs; 4.199µs]; SLO is < 10.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

telemetryaddmetric-flush-100-metrics

  • 🟩 execution_time seen in benchmark [179.293µs; 179.978µs]; SLO is < 200.000µs
  • 🟩 max_rss_usage seen in benchmark [29.055MB; 29.101MB]; SLO is < 31.000MB

telemetryaddmetric-flush-1000-metrics

  • 🟩 execution_time seen in benchmark [2.169ms; 2.176ms]; SLO is < 2.350ms
  • 🟩 max_rss_usage seen in benchmark [30.278MB; 30.278MB]; SLO is < 31.000MB

tracer-large

  • 🟩 execution_time seen in benchmark [29.547ms; 29.962ms]; SLO is < 32.950ms
  • 🟩 max_rss_usage seen in benchmark [30.278MB; 30.278MB]; SLO is < 31.000MB

tracer-medium

  • 🟩 execution_time seen in benchmark [2.915ms; 2.948ms]; SLO is < 3.200ms
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

tracer-small

  • 🟩 execution_time seen in benchmark [330.981µs; 332.756µs]; SLO is < 370.000µs
  • 🟩 max_rss_usage seen in benchmark [29.098MB; 29.098MB]; SLO is < 31.000MB

Legend:

  • 🟩 pass
  • 🟥 breach
  • 🟨 warning
  • (unstable) unstable

Note: All comparisons are against the mean unless a different statistic (e.g., p95) is explicitly shown.

sabrenner
sabrenner commented Jul 19, 2025
View reviewed changes
tests/contrib/openai/test_openai_llmobs.py
Comment on lines -1752 to -1761
metadata={
"reasoning": {"effort": "medium", "summary": "detailed"},
"stream": True,
"temperature": 1.0,
"top_p": 1.0,
"tools": [],
"tool_choice": "auto",
"truncation": "disabled",
"text": {"format": {"type": "text"}},
"reasoning_tokens": 128,
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

metadata differs too much between versions for whatever reasons. we only really care about asserting a) no error, and b) specific properties like reasoning summary and assistant content are set

@sabrenner sabrenner marked this pull request as ready for review July 19, 2025 03:05
@sabrenner sabrenner requested review from a team as code owners July 19, 2025 03:05
@sabrenner sabrenner requested review from lievan and erikayasuda July 19, 2025 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lievan lievan Awaiting requested review from lievan lievan is a code owner automatically assigned from DataDog/apm-python

@erikayasuda erikayasuda Awaiting requested review from erikayasuda erikayasuda is a code owner automatically assigned from DataDog/apm-python

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sabrenner